2023-01-01T17:29:30.128 INFO:root:teuthology version: 0.0.1.dev18+g19d18db 2023-01-01T17:29:30.128 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/vshankar-2023-01-01_15:14:18-fs-wip-vshankar-testing-20221221.044733-testing-default-smithi/7130185 --owner scheduled_vshankar@teuthology --verbose --description fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone} --name vshankar-2023-01-01_15:14:18-fs-wip-vshankar-testing-20221221.044733-testing-default-smithi -- /home/teuthworker/archive/vshankar-2023-01-01_15:14:18-fs-wip-vshankar-testing-20221221.044733-testing-default-smithi/7130185/orig.config.yaml 2023-01-01T17:29:30.173 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2023-01-01T17:29:30.231 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-01-01_15:14:18-fs-wip-vshankar-testing-20221221.044733-testing-default-smithi/7130185 branch: wip-vshankar-testing-20221221.044733 description: fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone} email: vshankar@redhat.com first_in_suite: false job_id: '7130185' kclient-workload: sequential: - kclient: - client.1 - workunit: clients: client.1: - suites/dbench.sh kernel: client: sha1: distro flavor: default kdb: true sha1: 937d5e0c86d70ca5fb80d65cdf2379d67b3bb37b last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-01-01_15:14:18-fs-wip-vshankar-testing-20221221.044733-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-vshankar-testing-20221221.044733 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: flavor: default sha1: 2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20221221.044733 sha1: 2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a owner: scheduled_vshankar@teuthology priority: 150 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 sha1: 2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a sleep_before_teardown: 0 suite: fs suite_branch: wip-vshankar-testing-20221221.044733 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi061.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= smithi149.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - parallel: - user-workload - kclient-workload teuthology_branch: main teuthology_sha1: 19d18db866afdc31fd6586f558fc29b95a87ccfb timestamp: 2023-01-01_15:14:18 tube: smithi user: vshankar user-workload: sequential: - ceph-fuse: - client.0 - workunit: clients: client.0: - suites/iozone.sh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.32458 2023-01-01T17:29:30.232 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa; will attempt to use it 2023-01-01T17:29:30.232 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks 2023-01-01T17:29:30.233 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-01-01T17:29:30.234 INFO:teuthology.task.internal:Checking packages... 2023-01-01T17:29:30.262 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a' 2023-01-01T17:29:30.262 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-01-01T17:29:30.262 INFO:teuthology.packaging:ref: None 2023-01-01T17:29:30.262 INFO:teuthology.packaging:tag: None 2023-01-01T17:29:30.262 INFO:teuthology.packaging:branch: wip-vshankar-testing-20221221.044733 2023-01-01T17:29:30.262 INFO:teuthology.packaging:sha1: 2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a 2023-01-01T17:29:30.263 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-vshankar-testing-20221221.044733 2023-01-01T17:29:30.411 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-1638.g2d451fdb 2023-01-01T17:29:30.411 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-01-01T17:29:30.419 INFO:teuthology.task.internal:no buildpackages task found 2023-01-01T17:29:30.419 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-01-01T17:29:30.467 INFO:teuthology.task.internal:Saving configuration 2023-01-01T17:29:30.488 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-01-01T17:29:30.494 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-01-01T17:29:30.513 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi061.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-01-01_15:14:18-fs-wip-vshankar-testing-20221221.044733-testing-default-smithi/7130185', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-01-01 17:24:25.846463', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-01-01T17:29:30.532 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-01-01_15:14:18-fs-wip-vshankar-testing-20221221.044733-testing-default-smithi/7130185', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-01-01 17:24:25.845212', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-01-01T17:29:30.532 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-01-01T17:29:30.539 INFO:teuthology.task.internal:roles: ubuntu@smithi061.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-01-01T17:29:30.539 INFO:teuthology.task.internal:roles: ubuntu@smithi149.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2023-01-01T17:29:30.539 INFO:teuthology.run_tasks:Running task console_log... 2023-01-01T17:29:30.615 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc4a640edc0>, signals=[15]) 2023-01-01T17:29:30.615 INFO:teuthology.run_tasks:Running task internal.connect... 2023-01-01T17:29:30.621 INFO:teuthology.task.internal:Opening connections... 2023-01-01T17:29:30.621 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi061.front.sepia.ceph.com 2023-01-01T17:29:30.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-01T17:29:30.692 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi149.front.sepia.ceph.com 2023-01-01T17:29:30.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-01T17:29:30.762 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-01-01T17:29:30.769 DEBUG:teuthology.orchestra.run.smithi061:> uname -m 2023-01-01T17:29:30.791 INFO:teuthology.orchestra.run.smithi061.stdout:x86_64 2023-01-01T17:29:30.792 DEBUG:teuthology.orchestra.run.smithi061:> cat /etc/os-release 2023-01-01T17:29:30.852 INFO:teuthology.orchestra.run.smithi061.stdout:NAME="Red Hat Enterprise Linux" 2023-01-01T17:29:30.852 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION="8.6 (Ootpa)" 2023-01-01T17:29:30.852 INFO:teuthology.orchestra.run.smithi061.stdout:ID="rhel" 2023-01-01T17:29:30.852 INFO:teuthology.orchestra.run.smithi061.stdout:ID_LIKE="fedora" 2023-01-01T17:29:30.852 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_ID="8.6" 2023-01-01T17:29:30.852 INFO:teuthology.orchestra.run.smithi061.stdout:PLATFORM_ID="platform:el8" 2023-01-01T17:29:30.852 INFO:teuthology.orchestra.run.smithi061.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-01-01T17:29:30.852 INFO:teuthology.orchestra.run.smithi061.stdout:ANSI_COLOR="0;31" 2023-01-01T17:29:30.852 INFO:teuthology.orchestra.run.smithi061.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-01-01T17:29:30.853 INFO:teuthology.orchestra.run.smithi061.stdout:HOME_URL="https://www.redhat.com/" 2023-01-01T17:29:30.853 INFO:teuthology.orchestra.run.smithi061.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-01-01T17:29:30.853 INFO:teuthology.orchestra.run.smithi061.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-01-01T17:29:30.853 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:29:30.853 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-01-01T17:29:30.853 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-01-01T17:29:30.854 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-01-01T17:29:30.854 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-01-01T17:29:30.854 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server 2023-01-01T17:29:30.868 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2023-01-01T17:29:30.888 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2023-01-01T17:29:30.888 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-01-01T17:29:30.947 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Red Hat Enterprise Linux" 2023-01-01T17:29:30.948 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="8.6 (Ootpa)" 2023-01-01T17:29:30.948 INFO:teuthology.orchestra.run.smithi149.stdout:ID="rhel" 2023-01-01T17:29:30.948 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="fedora" 2023-01-01T17:29:30.948 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="8.6" 2023-01-01T17:29:30.948 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el8" 2023-01-01T17:29:30.948 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-01-01T17:29:30.948 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2023-01-01T17:29:30.948 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-01-01T17:29:30.948 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.redhat.com/" 2023-01-01T17:29:30.948 INFO:teuthology.orchestra.run.smithi149.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-01-01T17:29:30.949 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-01-01T17:29:30.949 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-01T17:29:30.949 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-01-01T17:29:30.949 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-01-01T17:29:30.949 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-01-01T17:29:30.949 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-01-01T17:29:30.949 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-01-01T17:29:30.962 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-01-01T17:29:30.974 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-01-01T17:29:31.000 INFO:teuthology.task.internal:Checking for old test directory... 2023-01-01T17:29:31.001 DEBUG:teuthology.orchestra.run.smithi061:> test '!' -e /home/ubuntu/cephtest 2023-01-01T17:29:31.003 DEBUG:teuthology.orchestra.run.smithi149:> test '!' -e /home/ubuntu/cephtest 2023-01-01T17:29:31.021 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-01-01T17:29:31.026 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-01-01T17:29:31.027 DEBUG:teuthology.orchestra.run.smithi061:> test -z $(ls -A /var/lib/ceph) 2023-01-01T17:29:31.063 DEBUG:teuthology.orchestra.run.smithi149:> test -z $(ls -A /var/lib/ceph) 2023-01-01T17:29:31.091 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-01-01T17:29:31.138 INFO:teuthology.run_tasks:Running task kernel... 2023-01-01T17:29:31.154 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '937d5e0c86d70ca5fb80d65cdf2379d67b3bb37b'} 2023-01-01T17:29:31.154 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}} 2023-01-01T17:29:31.154 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-01-01T17:29:31.155 DEBUG:teuthology.orchestra.run.smithi061:> test -f /run/.containerenv -o -f /.dockerenv 2023-01-01T17:29:31.155 DEBUG:teuthology.orchestra.run.smithi149:> test -f /run/.containerenv -o -f /.dockerenv 2023-01-01T17:29:31.173 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-01T17:29:31.174 DEBUG:teuthology.orchestra.run.smithi061:> uname -r 2023-01-01T17:29:31.174 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-01T17:29:31.176 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2023-01-01T17:29:31.233 INFO:teuthology.orchestra.run.smithi061.stdout:4.18.0-372.9.1.el8.x86_64 2023-01-01T17:29:31.234 INFO:teuthology.task.kernel:Running kernel on smithi061: 4.18.0-372.9.1.el8.x86_64 2023-01-01T17:29:31.234 DEBUG:teuthology.orchestra.run.smithi061:> sudo yum install -y kernel 2023-01-01T17:29:31.235 INFO:teuthology.orchestra.run.smithi149.stdout:4.18.0-372.9.1.el8.x86_64 2023-01-01T17:29:31.235 INFO:teuthology.task.kernel:Running kernel on smithi149: 4.18.0-372.9.1.el8.x86_64 2023-01-01T17:29:31.235 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum install -y kernel 2023-01-01T17:29:32.346 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-01-01T17:29:32.346 INFO:teuthology.orchestra.run.smithi149.stdout:Unable to read consumer identity 2023-01-01T17:29:32.374 INFO:teuthology.orchestra.run.smithi061.stdout:Updating Subscription Management repositories. 2023-01-01T17:29:32.374 INFO:teuthology.orchestra.run.smithi061.stdout:Unable to read consumer identity 2023-01-01T17:29:35.774 INFO:teuthology.orchestra.run.smithi061.stdout:Copr repo for python3-asyncssh owned by ceph 1.6 kB/s | 3.5 kB 00:02 2023-01-01T17:29:35.853 INFO:teuthology.orchestra.run.smithi149.stdout:Copr repo for python3-asyncssh owned by ceph 1.6 kB/s | 3.5 kB 00:02 2023-01-01T17:29:39.203 INFO:teuthology.orchestra.run.smithi149.stdout:Extra Packages for Enterprise Linux 4.0 MB/s | 13 MB 00:03 2023-01-01T17:29:39.249 INFO:teuthology.orchestra.run.smithi061.stdout:Extra Packages for Enterprise Linux 3.8 MB/s | 13 MB 00:03 2023-01-01T17:29:42.153 INFO:teuthology.orchestra.run.smithi149.stdout:lab-extras 451 kB/s | 24 kB 00:00 2023-01-01T17:29:42.624 INFO:teuthology.orchestra.run.smithi061.stdout:lab-extras 399 kB/s | 24 kB 00:00 2023-01-01T17:29:42.805 INFO:teuthology.orchestra.run.smithi149.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-01-01T17:29:42.855 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2023-01-01T17:29:42.856 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2023-01-01T17:29:42.856 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2023-01-01T17:29:42.988 DEBUG:teuthology.orchestra.run.smithi149:> echo no | sudo yum reinstall kernel || true 2023-01-01T17:29:43.302 INFO:teuthology.orchestra.run.smithi061.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-01-01T17:29:43.321 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-01-01T17:29:43.321 INFO:teuthology.orchestra.run.smithi149.stdout:Unable to read consumer identity 2023-01-01T17:29:43.349 INFO:teuthology.orchestra.run.smithi061.stdout:Dependencies resolved. 2023-01-01T17:29:43.350 INFO:teuthology.orchestra.run.smithi061.stdout:Nothing to do. 2023-01-01T17:29:43.351 INFO:teuthology.orchestra.run.smithi061.stdout:Complete! 2023-01-01T17:29:43.483 DEBUG:teuthology.orchestra.run.smithi061:> echo no | sudo yum reinstall kernel || true 2023-01-01T17:29:43.584 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:01 ago on Sun 01 Jan 2023 05:29:42 PM UTC. 2023-01-01T17:29:43.624 INFO:teuthology.orchestra.run.smithi149.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-01-01T17:29:43.668 INFO:teuthology.orchestra.run.smithi149.stderr:Error: No packages marked for reinstall. 2023-01-01T17:29:43.715 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum reinstall -y kernel || true 2023-01-01T17:29:43.842 INFO:teuthology.orchestra.run.smithi061.stdout:Updating Subscription Management repositories. 2023-01-01T17:29:43.842 INFO:teuthology.orchestra.run.smithi061.stdout:Unable to read consumer identity 2023-01-01T17:29:44.049 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-01-01T17:29:44.049 INFO:teuthology.orchestra.run.smithi149.stdout:Unable to read consumer identity 2023-01-01T17:29:44.104 INFO:teuthology.orchestra.run.smithi061.stdout:Last metadata expiration check: 0:00:02 ago on Sun 01 Jan 2023 05:29:42 PM UTC. 2023-01-01T17:29:44.146 INFO:teuthology.orchestra.run.smithi061.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-01-01T17:29:44.180 INFO:teuthology.orchestra.run.smithi061.stderr:Error: No packages marked for reinstall. 2023-01-01T17:29:44.227 DEBUG:teuthology.orchestra.run.smithi061:> sudo yum reinstall -y kernel || true 2023-01-01T17:29:44.311 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:02 ago on Sun 01 Jan 2023 05:29:42 PM UTC. 2023-01-01T17:29:44.350 INFO:teuthology.orchestra.run.smithi149.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-01-01T17:29:44.390 INFO:teuthology.orchestra.run.smithi149.stderr:Error: No packages marked for reinstall. 2023-01-01T17:29:44.443 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q kernel --last | head -n 1 2023-01-01T17:29:44.526 INFO:teuthology.orchestra.run.smithi149.stdout:kernel-4.18.0-372.9.1.el8.x86_64 Thu 14 Jul 2022 06:23:21 PM UTC 2023-01-01T17:29:44.527 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-01-01T17:29:44.527 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-01-01T17:29:44.527 DEBUG:teuthology.parallel:result is None 2023-01-01T17:29:44.576 INFO:teuthology.orchestra.run.smithi061.stdout:Updating Subscription Management repositories. 2023-01-01T17:29:44.576 INFO:teuthology.orchestra.run.smithi061.stdout:Unable to read consumer identity 2023-01-01T17:29:44.843 INFO:teuthology.orchestra.run.smithi061.stdout:Last metadata expiration check: 0:00:02 ago on Sun 01 Jan 2023 05:29:42 PM UTC. 2023-01-01T17:29:44.887 INFO:teuthology.orchestra.run.smithi061.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-01-01T17:29:44.907 INFO:teuthology.orchestra.run.smithi061.stderr:Error: No packages marked for reinstall. 2023-01-01T17:29:44.959 DEBUG:teuthology.orchestra.run.smithi061:> rpm -q kernel --last | head -n 1 2023-01-01T17:29:45.041 INFO:teuthology.orchestra.run.smithi061.stdout:kernel-4.18.0-372.9.1.el8.x86_64 Thu 14 Jul 2022 06:23:21 PM UTC 2023-01-01T17:29:45.043 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-01-01T17:29:45.043 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-01-01T17:29:45.043 DEBUG:teuthology.parallel:result is None 2023-01-01T17:29:45.043 INFO:teuthology.run_tasks:Running task internal.base... 2023-01-01T17:29:45.053 INFO:teuthology.task.internal:Creating test directory... 2023-01-01T17:29:45.053 DEBUG:teuthology.orchestra.run.smithi061:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-01-01T17:29:45.055 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-01-01T17:29:45.072 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-01-01T17:29:45.082 INFO:teuthology.run_tasks:Running task internal.archive... 2023-01-01T17:29:45.150 INFO:teuthology.task.internal:Creating archive directory... 2023-01-01T17:29:45.150 DEBUG:teuthology.orchestra.run.smithi061:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-01-01T17:29:45.152 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-01-01T17:29:45.190 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-01-01T17:29:45.197 INFO:teuthology.task.internal:Enabling coredump saving... 2023-01-01T17:29:45.197 DEBUG:teuthology.orchestra.run.smithi061:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-01-01T17:29:45.213 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-01-01T17:29:45.241 INFO:teuthology.orchestra.run.smithi061.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-01T17:29:45.253 INFO:teuthology.orchestra.run.smithi061.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-01T17:29:45.267 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-01T17:29:45.279 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-01T17:29:45.280 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-01-01T17:29:45.287 INFO:teuthology.task.internal:Configuring sudo... 2023-01-01T17:29:45.287 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-01-01T17:29:45.297 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-01-01T17:29:45.348 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-01-01T17:29:45.356 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-01-01T17:29:45.356 DEBUG:teuthology.orchestra.run.smithi061:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-01-01T17:29:45.366 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-01-01T17:29:45.405 DEBUG:teuthology.orchestra.run.smithi061:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-01T17:29:45.457 DEBUG:teuthology.orchestra.run.smithi061:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-01T17:29:45.520 DEBUG:teuthology.orchestra.run.smithi061:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-01T17:29:45.598 DEBUG:teuthology.orchestra.run.smithi061:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-01T17:29:45.646 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-01-01T17:29:45.646 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-01-01T17:29:45.714 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-01T17:29:45.752 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-01T17:29:45.818 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-01T17:29:45.898 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-01T17:29:45.946 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-01T17:29:45.946 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-01-01T17:29:46.015 DEBUG:teuthology.orchestra.run.smithi061:> sudo service rsyslog restart 2023-01-01T17:29:46.017 DEBUG:teuthology.orchestra.run.smithi149:> sudo service rsyslog restart 2023-01-01T17:29:46.060 INFO:teuthology.orchestra.run.smithi061.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-01-01T17:29:46.109 INFO:teuthology.orchestra.run.smithi149.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-01-01T17:29:46.573 INFO:teuthology.run_tasks:Running task internal.timer... 2023-01-01T17:29:46.581 INFO:teuthology.task.internal:Starting timer... 2023-01-01T17:29:46.581 INFO:teuthology.run_tasks:Running task pcp... 2023-01-01T17:29:46.621 INFO:teuthology.run_tasks:Running task selinux... 2023-01-01T17:29:46.644 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-01-01T17:29:46.645 DEBUG:teuthology.orchestra.run.smithi061:> sudo service auditd rotate 2023-01-01T17:29:46.721 INFO:teuthology.orchestra.run.smithi061.stdout:Rotating logs: 2023-01-01T17:29:46.723 DEBUG:teuthology.orchestra.run.smithi149:> sudo service auditd rotate 2023-01-01T17:29:46.788 INFO:teuthology.orchestra.run.smithi149.stdout:Rotating logs: 2023-01-01T17:29:46.790 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-01-01T17:29:46.790 DEBUG:teuthology.orchestra.run.smithi061:> /usr/sbin/getenforce 2023-01-01T17:29:46.812 INFO:teuthology.orchestra.run.smithi061.stdout:Permissive 2023-01-01T17:29:46.813 DEBUG:teuthology.orchestra.run.smithi149:> /usr/sbin/getenforce 2023-01-01T17:29:46.836 INFO:teuthology.orchestra.run.smithi149.stdout:Permissive 2023-01-01T17:29:46.836 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi061.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi149.front.sepia.ceph.com': 'permissive'} 2023-01-01T17:29:46.836 DEBUG:teuthology.orchestra.run.smithi061:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2023-01-01T17:29:46.881 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-01T17:29:46.881 DEBUG:teuthology.orchestra.run.smithi149:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2023-01-01T17:29:46.913 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-01T17:29:46.913 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-01-01T17:29:46.914 DEBUG:teuthology.orchestra.run.smithi061:> sudo /usr/sbin/setenforce permissive 2023-01-01T17:29:46.950 DEBUG:teuthology.orchestra.run.smithi149:> sudo /usr/sbin/setenforce permissive 2023-01-01T17:29:46.982 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-01-01T17:29:46.991 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-01-01T17:29:46.997 INFO:teuthology.repo_utils:Fetching main from origin 2023-01-01T17:29:47.144 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-01-01T17:29:47.162 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-01-01T17:29:47.163 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi061.front.sepia.ceph.com,smithi149.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-01-01T17:36:42.677 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi061.front.sepia.ceph.com'), Remote(name='ubuntu@smithi149.front.sepia.ceph.com')] 2023-01-01T17:36:42.678 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi061.front.sepia.ceph.com' 2023-01-01T17:36:42.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-01T17:36:42.747 DEBUG:teuthology.orchestra.run.smithi061:> true 2023-01-01T17:36:42.815 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-01-01T17:36:42.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-01T17:36:42.884 DEBUG:teuthology.orchestra.run.smithi149:> true 2023-01-01T17:36:42.953 INFO:teuthology.run_tasks:Running task clock... 2023-01-01T17:36:42.965 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-01-01T17:36:42.965 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-01-01T17:36:42.966 DEBUG:teuthology.orchestra.run.smithi061:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-01-01T17:36:42.971 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-01-01T17:36:42.972 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-01-01T17:36:43.003 INFO:teuthology.orchestra.run.smithi061.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-01-01T17:36:43.019 INFO:teuthology.orchestra.run.smithi061.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-01-01T17:36:43.029 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-01-01T17:36:43.041 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-01-01T17:36:43.089 INFO:teuthology.orchestra.run.smithi061.stderr:sudo: ntpd: command not found 2023-01-01T17:36:43.102 INFO:teuthology.orchestra.run.smithi061.stdout:506 Cannot talk to daemon 2023-01-01T17:36:43.117 INFO:teuthology.orchestra.run.smithi061.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-01-01T17:36:43.120 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: ntpd: command not found 2023-01-01T17:36:43.131 INFO:teuthology.orchestra.run.smithi061.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-01-01T17:36:43.132 INFO:teuthology.orchestra.run.smithi149.stdout:506 Cannot talk to daemon 2023-01-01T17:36:43.146 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-01-01T17:36:43.160 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-01-01T17:36:43.216 INFO:teuthology.orchestra.run.smithi061.stderr:bash: ntpq: command not found 2023-01-01T17:36:43.220 INFO:teuthology.orchestra.run.smithi061.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-01-01T17:36:43.220 INFO:teuthology.orchestra.run.smithi061.stdout:=============================================================================== 2023-01-01T17:36:43.220 INFO:teuthology.orchestra.run.smithi061.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-01T17:36:43.220 INFO:teuthology.orchestra.run.smithi061.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-01T17:36:43.220 INFO:teuthology.orchestra.run.smithi061.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-01T17:36:43.220 INFO:teuthology.orchestra.run.smithi061.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-01T17:36:43.225 INFO:teuthology.orchestra.run.smithi149.stderr:bash: ntpq: command not found 2023-01-01T17:36:43.226 INFO:teuthology.orchestra.run.smithi149.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-01-01T17:36:43.226 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================== 2023-01-01T17:36:43.226 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-01T17:36:43.226 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-01T17:36:43.226 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-01T17:36:43.226 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-01T17:36:43.227 INFO:teuthology.run_tasks:Running task install... 2023-01-01T17:36:43.240 DEBUG:teuthology.task.install:project ceph 2023-01-01T17:36:43.240 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a'}} 2023-01-01T17:36:43.240 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a'} 2023-01-01T17:36:43.240 INFO:teuthology.task.install:Using flavor: default 2023-01-01T17:36:43.248 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-01-01T17:36:43.248 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-01-01T17:36:43.248 DEBUG:teuthology.orchestra.run.smithi061:> sudo lsb_release -is 2023-01-01T17:36:43.304 INFO:teuthology.orchestra.run.smithi061.stdout:RedHatEnterprise 2023-01-01T17:36:43.306 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2023-01-01T17:36:43.306 DEBUG:teuthology.orchestra.run.smithi149:> sudo lsb_release -is 2023-01-01T17:36:43.306 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a', 'tag': None, 'wait_for_package': False} 2023-01-01T17:36:43.307 DEBUG:teuthology.orchestra.run.smithi061:> sudo lsb_release -is 2023-01-01T17:36:43.347 INFO:teuthology.orchestra.run.smithi149.stdout:RedHatEnterprise 2023-01-01T17:36:43.348 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2023-01-01T17:36:43.349 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a', 'tag': None, 'wait_for_package': False} 2023-01-01T17:36:43.349 DEBUG:teuthology.orchestra.run.smithi149:> sudo lsb_release -is 2023-01-01T17:36:43.387 INFO:teuthology.orchestra.run.smithi061.stdout:RedHatEnterprise 2023-01-01T17:36:43.389 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2023-01-01T17:36:43.389 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a 2023-01-01T17:36:43.433 INFO:teuthology.orchestra.run.smithi149.stdout:RedHatEnterprise 2023-01-01T17:36:43.434 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2023-01-01T17:36:43.434 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a 2023-01-01T17:36:43.545 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20221221.044733/2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/centos/8/flavors/default/ 2023-01-01T17:36:43.545 INFO:teuthology.task.install.rpm:Package version is 18.0.0-1638.g2d451fdb 2023-01-01T17:36:43.583 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20221221.044733/2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/centos/8/flavors/default/ 2023-01-01T17:36:43.583 INFO:teuthology.task.install.rpm:Package version is 18.0.0-1638.g2d451fdb 2023-01-01T17:36:43.662 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20221221.044733/2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20221221.044733/2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20221221.044733/2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-01-01T17:36:43.662 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-01-01T17:36:43.662 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-01-01T17:36:43.694 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-01-01T17:36:43.694 DEBUG:teuthology.orchestra.run.smithi061:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-01-01T17:36:43.697 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20221221.044733/2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20221221.044733/2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20221221.044733/2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-01-01T17:36:43.697 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-01T17:36:43.697 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-01-01T17:36:43.724 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-01-01T17:36:43.724 DEBUG:teuthology.orchestra.run.smithi149:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-01-01T17:36:43.762 DEBUG:teuthology.orchestra.run.smithi061:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-01-01T17:36:43.793 DEBUG:teuthology.orchestra.run.smithi149:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-01-01T17:36:43.840 DEBUG:teuthology.orchestra.run.smithi061:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-01-01T17:36:43.870 DEBUG:teuthology.orchestra.run.smithi149:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-01-01T17:36:43.906 INFO:teuthology.orchestra.run.smithi061.stdout:check_obsoletes = 1 2023-01-01T17:36:43.908 DEBUG:teuthology.orchestra.run.smithi061:> sudo yum clean all 2023-01-01T17:36:43.939 INFO:teuthology.orchestra.run.smithi149.stdout:check_obsoletes = 1 2023-01-01T17:36:43.940 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum clean all 2023-01-01T17:36:44.299 INFO:teuthology.orchestra.run.smithi061.stdout:Updating Subscription Management repositories. 2023-01-01T17:36:44.312 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-01-01T17:36:44.674 INFO:teuthology.orchestra.run.smithi061.stdout:43 files removed 2023-01-01T17:36:44.688 INFO:teuthology.orchestra.run.smithi149.stdout:43 files removed 2023-01-01T17:36:44.722 DEBUG:teuthology.orchestra.run.smithi061:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-01-01T17:36:44.735 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-01-01T17:36:45.068 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-01-01T17:36:45.071 INFO:teuthology.orchestra.run.smithi061.stdout:Updating Subscription Management repositories. 2023-01-01T17:36:45.818 INFO:teuthology.orchestra.run.smithi149.stdout:ceph packages for x86_64 310 kB/s | 81 kB 00:00 2023-01-01T17:36:45.819 INFO:teuthology.orchestra.run.smithi061.stdout:ceph packages for x86_64 313 kB/s | 81 kB 00:00 2023-01-01T17:36:46.093 INFO:teuthology.orchestra.run.smithi149.stdout:ceph noarch packages 38 kB/s | 9.4 kB 00:00 2023-01-01T17:36:46.095 INFO:teuthology.orchestra.run.smithi061.stdout:ceph noarch packages 39 kB/s | 9.4 kB 00:00 2023-01-01T17:36:46.362 INFO:teuthology.orchestra.run.smithi061.stdout:ceph source packages 6.2 kB/s | 1.5 kB 00:00 2023-01-01T17:36:46.386 INFO:teuthology.orchestra.run.smithi149.stdout:ceph source packages 5.6 kB/s | 1.5 kB 00:00 2023-01-01T17:36:48.795 INFO:teuthology.orchestra.run.smithi149.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-01-01T17:36:48.796 INFO:teuthology.orchestra.run.smithi061.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-01-01T17:36:49.763 INFO:teuthology.orchestra.run.smithi061.stdout:Extra Packages for Enterprise Linux 14 MB/s | 13 MB 00:00 2023-01-01T17:36:49.828 INFO:teuthology.orchestra.run.smithi149.stdout:Extra Packages for Enterprise Linux 13 MB/s | 13 MB 00:01 2023-01-01T17:36:52.812 INFO:teuthology.orchestra.run.smithi149.stdout:lab-extras 523 kB/s | 24 kB 00:00 2023-01-01T17:36:52.880 INFO:teuthology.orchestra.run.smithi061.stdout:lab-extras 568 kB/s | 24 kB 00:00 2023-01-01T17:36:53.722 INFO:teuthology.orchestra.run.smithi149.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 63 MB/s | 53 MB 00:00 2023-01-01T17:36:53.856 INFO:teuthology.orchestra.run.smithi061.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 58 MB/s | 53 MB 00:00 2023-01-01T17:37:01.781 INFO:teuthology.orchestra.run.smithi149.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 58 MB/s | 47 MB 00:00 2023-01-01T17:37:02.624 INFO:teuthology.orchestra.run.smithi061.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 57 MB/s | 47 MB 00:00 2023-01-01T17:37:12.712 INFO:teuthology.orchestra.run.smithi149.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-01-01T17:37:12.713 INFO:teuthology.orchestra.run.smithi149.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-01-01T17:37:12.728 INFO:teuthology.orchestra.run.smithi149.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-01-01T17:37:12.729 INFO:teuthology.orchestra.run.smithi149.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-01-01T17:37:12.730 INFO:teuthology.orchestra.run.smithi149.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-01-01T17:37:12.731 INFO:teuthology.orchestra.run.smithi149.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-01-01T17:37:12.733 INFO:teuthology.orchestra.run.smithi149.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-01-01T17:37:12.736 INFO:teuthology.orchestra.run.smithi149.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-01-01T17:37:12.737 INFO:teuthology.orchestra.run.smithi149.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-01-01T17:37:12.869 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2023-01-01T17:37:12.886 INFO:teuthology.orchestra.run.smithi149.stdout:=========================================================================================================================== 2023-01-01T17:37:12.886 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2023-01-01T17:37:12.886 INFO:teuthology.orchestra.run.smithi149.stdout:=========================================================================================================================== 2023-01-01T17:37:12.886 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2023-01-01T17:37:12.886 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-01-01T17:37:12.886 INFO:teuthology.orchestra.run.smithi149.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-01-01T17:37:12.886 INFO:teuthology.orchestra.run.smithi149.stdout: ceph x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 6.4 k 2023-01-01T17:37:12.886 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 5.2 M 2023-01-01T17:37:12.886 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 845 k 2023-01-01T17:37:12.886 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 165 k 2023-01-01T17:37:12.888 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 1.5 M 2023-01-01T17:37:12.888 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm noarch 2:18.0.0-1638.g2d451fdb.el8 ceph-noarch 119 k 2023-01-01T17:37:12.888 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard noarch 2:18.0.0-1638.g2d451fdb.el8 ceph-noarch 1.7 M 2023-01-01T17:37:12.888 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-1638.g2d451fdb.el8 ceph-noarch 7.4 M 2023-01-01T17:37:12.888 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook noarch 2:18.0.0-1638.g2d451fdb.el8 ceph-noarch 47 k 2023-01-01T17:37:12.888 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 13 M 2023-01-01T17:37:12.890 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 48 M 2023-01-01T17:37:12.890 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-volume noarch 2:18.0.0-1638.g2d451fdb.el8 ceph-noarch 263 k 2023-01-01T17:37:12.890 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm noarch 2:18.0.0-1638.g2d451fdb.el8 ceph-noarch 81 k 2023-01-01T17:37:12.890 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-mirror x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 257 k 2023-01-01T17:37:12.890 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-top noarch 2:18.0.0-1638.g2d451fdb.el8 ceph-noarch 17 k 2023-01-01T17:37:12.890 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-01-01T17:37:12.890 INFO:teuthology.orchestra.run.smithi149.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-01-01T17:37:12.891 INFO:teuthology.orchestra.run.smithi149.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-01-01T17:37:12.891 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 30 k 2023-01-01T17:37:12.891 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2 x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 768 k 2023-01-01T17:37:12.891 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 139 k 2023-01-01T17:37:12.891 INFO:teuthology.orchestra.run.smithi149.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-01-01T17:37:12.891 INFO:teuthology.orchestra.run.smithi149.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-01-01T17:37:12.891 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-01-01T17:37:12.891 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-01-01T17:37:12.891 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-01-01T17:37:12.891 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-01-01T17:37:12.891 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 190 k 2023-01-01T17:37:12.892 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 371 k 2023-01-01T17:37:12.892 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 365 k 2023-01-01T17:37:12.892 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 107 k 2023-01-01T17:37:12.892 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 94 k 2023-01-01T17:37:12.892 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 3.4 M 2023-01-01T17:37:12.892 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 180 k 2023-01-01T17:37:12.892 INFO:teuthology.orchestra.run.smithi149.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-01-01T17:37:12.892 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrading: 2023-01-01T17:37:12.892 INFO:teuthology.orchestra.run.smithi149.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-01-01T17:37:12.892 INFO:teuthology.orchestra.run.smithi149.stdout: librados2 x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 3.6 M 2023-01-01T17:37:12.892 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1 x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 3.6 M 2023-01-01T17:37:12.893 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2023-01-01T17:37:12.893 INFO:teuthology.orchestra.run.smithi149.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-01-01T17:37:12.893 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 24 M 2023-01-01T17:37:12.894 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards noarch 2:18.0.0-1638.g2d451fdb.el8 ceph-noarch 23 k 2023-01-01T17:37:12.894 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 2.3 M 2023-01-01T17:37:12.894 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core noarch 2:18.0.0-1638.g2d451fdb.el8 ceph-noarch 234 k 2023-01-01T17:37:12.894 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 3.9 M 2023-01-01T17:37:12.894 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 17 M 2023-01-01T17:37:12.894 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts noarch 2:18.0.0-1638.g2d451fdb.el8 ceph-noarch 15 k 2023-01-01T17:37:12.894 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 24 k 2023-01-01T17:37:12.894 INFO:teuthology.orchestra.run.smithi149.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-01-01T17:37:12.894 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-01-01T17:37:12.895 INFO:teuthology.orchestra.run.smithi149.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-01-01T17:37:12.895 INFO:teuthology.orchestra.run.smithi149.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-01-01T17:37:12.895 INFO:teuthology.orchestra.run.smithi149.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-01-01T17:37:12.895 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 137 k 2023-01-01T17:37:12.895 INFO:teuthology.orchestra.run.smithi149.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-01-01T17:37:12.895 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-01-01T17:37:12.895 INFO:teuthology.orchestra.run.smithi149.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-01-01T17:37:12.895 INFO:teuthology.orchestra.run.smithi149.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-01-01T17:37:12.895 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-01-01T17:37:12.895 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-01-01T17:37:12.895 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1 x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 474 k 2023-01-01T17:37:12.895 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-01-01T17:37:12.896 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2 x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 6.5 M 2023-01-01T17:37:12.896 INFO:teuthology.orchestra.run.smithi149.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-01-01T17:37:12.896 INFO:teuthology.orchestra.run.smithi149.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-01-01T17:37:12.896 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-01-01T17:37:12.896 INFO:teuthology.orchestra.run.smithi149.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-01-01T17:37:12.896 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-01-01T17:37:12.896 INFO:teuthology.orchestra.run.smithi149.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-01-01T17:37:12.896 INFO:teuthology.orchestra.run.smithi149.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-01-01T17:37:12.896 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-01-01T17:37:12.896 INFO:teuthology.orchestra.run.smithi149.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-01-01T17:37:12.896 INFO:teuthology.orchestra.run.smithi149.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-01-01T17:37:12.896 INFO:teuthology.orchestra.run.smithi149.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-01-01T17:37:12.897 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-01-01T17:37:12.897 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-01-01T17:37:12.897 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-01-01T17:37:12.897 INFO:teuthology.orchestra.run.smithi149.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-01-01T17:37:12.897 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-01-01T17:37:12.897 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 45 k 2023-01-01T17:37:12.897 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 114 k 2023-01-01T17:37:12.897 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-01-01T17:37:12.897 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-01-01T17:37:12.897 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-01-01T17:37:12.897 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-01-01T17:37:12.899 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-01-01T17:37:12.899 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-01-01T17:37:12.899 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-01-01T17:37:12.899 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-01-01T17:37:12.899 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-01-01T17:37:12.899 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-01-01T17:37:12.899 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-01-01T17:37:12.900 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-01-01T17:37:12.900 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-01-01T17:37:12.900 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-01-01T17:37:12.900 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-01-01T17:37:12.900 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-01-01T17:37:12.900 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-01-01T17:37:12.900 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-01-01T17:37:12.900 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-01-01T17:37:12.900 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-01-01T17:37:12.900 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-01-01T17:37:12.900 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-01-01T17:37:12.901 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-01-01T17:37:12.901 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-01-01T17:37:12.901 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-01-01T17:37:12.901 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-01-01T17:37:12.901 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-01-01T17:37:12.901 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-01-01T17:37:12.901 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-01-01T17:37:12.901 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-01-01T17:37:12.901 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-01-01T17:37:12.901 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-01-01T17:37:12.901 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-01-01T17:37:12.902 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-01-01T17:37:12.902 INFO:teuthology.orchestra.run.smithi149.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-01-01T17:37:12.902 INFO:teuthology.orchestra.run.smithi149.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-01-01T17:37:12.902 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-01-01T17:37:12.902 INFO:teuthology.orchestra.run.smithi149.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-01-01T17:37:12.902 INFO:teuthology.orchestra.run.smithi149.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-01-01T17:37:12.902 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-01-01T17:37:12.902 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-01-01T17:37:12.902 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-01-01T17:37:12.902 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-01-01T17:37:12.902 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-01-01T17:37:12.902 INFO:teuthology.orchestra.run.smithi149.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-01-01T17:37:12.903 INFO:teuthology.orchestra.run.smithi149.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-01-01T17:37:12.903 INFO:teuthology.orchestra.run.smithi149.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-01-01T17:37:12.903 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-01-01T17:37:12.903 INFO:teuthology.orchestra.run.smithi149.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-01-01T17:37:12.903 INFO:teuthology.orchestra.run.smithi149.stdout:Enabling module streams: 2023-01-01T17:37:12.903 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql 10 2023-01-01T17:37:12.903 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-01T17:37:12.903 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2023-01-01T17:37:12.904 INFO:teuthology.orchestra.run.smithi149.stdout:=========================================================================================================================== 2023-01-01T17:37:12.904 INFO:teuthology.orchestra.run.smithi149.stdout:Install 128 Packages 2023-01-01T17:37:12.904 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrade 3 Packages 2023-01-01T17:37:12.904 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-01T17:37:12.905 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 205 M 2023-01-01T17:37:12.905 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2023-01-01T17:37:13.062 INFO:teuthology.orchestra.run.smithi149.stdout:(1/131): ceph-18.0.0-1638.g2d451fdb.el8.x86_64. 39 kB/s | 6.4 kB 00:00 2023-01-01T17:37:13.290 INFO:teuthology.orchestra.run.smithi149.stdout:(2/131): ceph-fuse-18.0.0-1638.g2d451fdb.el8.x8 3.6 MB/s | 845 kB 00:00 2023-01-01T17:37:13.365 INFO:teuthology.orchestra.run.smithi149.stdout:(3/131): ceph-immutable-object-cache-18.0.0-163 2.2 MB/s | 165 kB 00:00 2023-01-01T17:37:13.615 INFO:teuthology.orchestra.run.smithi149.stdout:(4/131): ceph-base-18.0.0-1638.g2d451fdb.el8.x8 7.2 MB/s | 5.2 MB 00:00 2023-01-01T17:37:13.733 INFO:teuthology.orchestra.run.smithi149.stdout:(5/131): ceph-mds-18.0.0-1638.g2d451fdb.el8.x86 6.2 MB/s | 2.3 MB 00:00 2023-01-01T17:37:13.799 INFO:teuthology.orchestra.run.smithi149.stdout:(6/131): ceph-mgr-18.0.0-1638.g2d451fdb.el8.x86 8.3 MB/s | 1.5 MB 00:00 2023-01-01T17:37:14.291 INFO:teuthology.orchestra.run.smithi149.stdout:(7/131): ceph-mon-18.0.0-1638.g2d451fdb.el8.x86 7.0 MB/s | 3.9 MB 00:00 2023-01-01T17:37:14.482 INFO:teuthology.orchestra.run.smithi061.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-01-01T17:37:14.483 INFO:teuthology.orchestra.run.smithi061.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-01-01T17:37:14.498 INFO:teuthology.orchestra.run.smithi061.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-01-01T17:37:14.499 INFO:teuthology.orchestra.run.smithi061.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-01-01T17:37:14.500 INFO:teuthology.orchestra.run.smithi061.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-01-01T17:37:14.501 INFO:teuthology.orchestra.run.smithi061.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-01-01T17:37:14.503 INFO:teuthology.orchestra.run.smithi061.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-01-01T17:37:14.507 INFO:teuthology.orchestra.run.smithi061.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-01-01T17:37:14.508 INFO:teuthology.orchestra.run.smithi061.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-01-01T17:37:14.654 INFO:teuthology.orchestra.run.smithi061.stdout:Dependencies resolved. 2023-01-01T17:37:14.671 INFO:teuthology.orchestra.run.smithi061.stdout:=========================================================================================================================== 2023-01-01T17:37:14.671 INFO:teuthology.orchestra.run.smithi061.stdout: Package Arch Version Repository Size 2023-01-01T17:37:14.671 INFO:teuthology.orchestra.run.smithi061.stdout:=========================================================================================================================== 2023-01-01T17:37:14.671 INFO:teuthology.orchestra.run.smithi061.stdout:Installing: 2023-01-01T17:37:14.671 INFO:teuthology.orchestra.run.smithi061.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-01-01T17:37:14.671 INFO:teuthology.orchestra.run.smithi061.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-01-01T17:37:14.671 INFO:teuthology.orchestra.run.smithi061.stdout: ceph x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 6.4 k 2023-01-01T17:37:14.672 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-base x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 5.2 M 2023-01-01T17:37:14.672 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-fuse x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 845 k 2023-01-01T17:37:14.672 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 165 k 2023-01-01T17:37:14.672 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-mgr x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 1.5 M 2023-01-01T17:37:14.672 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-mgr-cephadm noarch 2:18.0.0-1638.g2d451fdb.el8 ceph-noarch 119 k 2023-01-01T17:37:14.672 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-mgr-dashboard noarch 2:18.0.0-1638.g2d451fdb.el8 ceph-noarch 1.7 M 2023-01-01T17:37:14.672 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-1638.g2d451fdb.el8 ceph-noarch 7.4 M 2023-01-01T17:37:14.672 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-mgr-rook noarch 2:18.0.0-1638.g2d451fdb.el8 ceph-noarch 47 k 2023-01-01T17:37:14.672 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-radosgw x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 13 M 2023-01-01T17:37:14.673 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-test x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 48 M 2023-01-01T17:37:14.673 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-volume noarch 2:18.0.0-1638.g2d451fdb.el8 ceph-noarch 263 k 2023-01-01T17:37:14.673 INFO:teuthology.orchestra.run.smithi061.stdout: cephadm noarch 2:18.0.0-1638.g2d451fdb.el8 ceph-noarch 81 k 2023-01-01T17:37:14.673 INFO:teuthology.orchestra.run.smithi061.stdout: cephfs-mirror x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 257 k 2023-01-01T17:37:14.673 INFO:teuthology.orchestra.run.smithi061.stdout: cephfs-top noarch 2:18.0.0-1638.g2d451fdb.el8 ceph-noarch 17 k 2023-01-01T17:37:14.674 INFO:teuthology.orchestra.run.smithi061.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-01-01T17:37:14.674 INFO:teuthology.orchestra.run.smithi061.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-01-01T17:37:14.674 INFO:teuthology.orchestra.run.smithi061.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-01-01T17:37:14.674 INFO:teuthology.orchestra.run.smithi061.stdout: libcephfs-devel x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 30 k 2023-01-01T17:37:14.674 INFO:teuthology.orchestra.run.smithi061.stdout: libcephfs2 x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 768 k 2023-01-01T17:37:14.674 INFO:teuthology.orchestra.run.smithi061.stdout: librados-devel x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 139 k 2023-01-01T17:37:14.674 INFO:teuthology.orchestra.run.smithi061.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-01-01T17:37:14.674 INFO:teuthology.orchestra.run.smithi061.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-01-01T17:37:14.674 INFO:teuthology.orchestra.run.smithi061.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-01-01T17:37:14.674 INFO:teuthology.orchestra.run.smithi061.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-01-01T17:37:14.675 INFO:teuthology.orchestra.run.smithi061.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-01-01T17:37:14.675 INFO:teuthology.orchestra.run.smithi061.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-01-01T17:37:14.675 INFO:teuthology.orchestra.run.smithi061.stdout: python3-cephfs x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 190 k 2023-01-01T17:37:14.675 INFO:teuthology.orchestra.run.smithi061.stdout: python3-rados x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 371 k 2023-01-01T17:37:14.675 INFO:teuthology.orchestra.run.smithi061.stdout: python3-rbd x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 365 k 2023-01-01T17:37:14.676 INFO:teuthology.orchestra.run.smithi061.stdout: python3-rgw x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 107 k 2023-01-01T17:37:14.676 INFO:teuthology.orchestra.run.smithi061.stdout: rbd-fuse x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 94 k 2023-01-01T17:37:14.676 INFO:teuthology.orchestra.run.smithi061.stdout: rbd-mirror x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 3.4 M 2023-01-01T17:37:14.676 INFO:teuthology.orchestra.run.smithi061.stdout: rbd-nbd x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 180 k 2023-01-01T17:37:14.676 INFO:teuthology.orchestra.run.smithi061.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-01-01T17:37:14.676 INFO:teuthology.orchestra.run.smithi061.stdout:Upgrading: 2023-01-01T17:37:14.676 INFO:teuthology.orchestra.run.smithi061.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-01-01T17:37:14.676 INFO:teuthology.orchestra.run.smithi061.stdout: librados2 x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 3.6 M 2023-01-01T17:37:14.676 INFO:teuthology.orchestra.run.smithi061.stdout: librbd1 x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 3.6 M 2023-01-01T17:37:14.676 INFO:teuthology.orchestra.run.smithi061.stdout:Installing dependencies: 2023-01-01T17:37:14.676 INFO:teuthology.orchestra.run.smithi061.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-01-01T17:37:14.676 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-common x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 24 M 2023-01-01T17:37:14.677 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-grafana-dashboards noarch 2:18.0.0-1638.g2d451fdb.el8 ceph-noarch 23 k 2023-01-01T17:37:14.677 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-mds x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 2.3 M 2023-01-01T17:37:14.677 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-mgr-modules-core noarch 2:18.0.0-1638.g2d451fdb.el8 ceph-noarch 234 k 2023-01-01T17:37:14.677 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-mon x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 3.9 M 2023-01-01T17:37:14.677 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-osd x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 17 M 2023-01-01T17:37:14.677 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-prometheus-alerts noarch 2:18.0.0-1638.g2d451fdb.el8 ceph-noarch 15 k 2023-01-01T17:37:14.677 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-selinux x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 24 k 2023-01-01T17:37:14.677 INFO:teuthology.orchestra.run.smithi061.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-01-01T17:37:14.677 INFO:teuthology.orchestra.run.smithi061.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-01-01T17:37:14.677 INFO:teuthology.orchestra.run.smithi061.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-01-01T17:37:14.677 INFO:teuthology.orchestra.run.smithi061.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-01-01T17:37:14.677 INFO:teuthology.orchestra.run.smithi061.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-01-01T17:37:14.678 INFO:teuthology.orchestra.run.smithi061.stdout: libcephsqlite x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 137 k 2023-01-01T17:37:14.678 INFO:teuthology.orchestra.run.smithi061.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-01-01T17:37:14.678 INFO:teuthology.orchestra.run.smithi061.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-01-01T17:37:14.678 INFO:teuthology.orchestra.run.smithi061.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-01-01T17:37:14.678 INFO:teuthology.orchestra.run.smithi061.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-01-01T17:37:14.678 INFO:teuthology.orchestra.run.smithi061.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-01-01T17:37:14.678 INFO:teuthology.orchestra.run.smithi061.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-01-01T17:37:14.678 INFO:teuthology.orchestra.run.smithi061.stdout: libradosstriper1 x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 474 k 2023-01-01T17:37:14.678 INFO:teuthology.orchestra.run.smithi061.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-01-01T17:37:14.678 INFO:teuthology.orchestra.run.smithi061.stdout: librgw2 x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 6.5 M 2023-01-01T17:37:14.678 INFO:teuthology.orchestra.run.smithi061.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-01-01T17:37:14.679 INFO:teuthology.orchestra.run.smithi061.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-01-01T17:37:14.679 INFO:teuthology.orchestra.run.smithi061.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-01-01T17:37:14.679 INFO:teuthology.orchestra.run.smithi061.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-01-01T17:37:14.679 INFO:teuthology.orchestra.run.smithi061.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-01-01T17:37:14.679 INFO:teuthology.orchestra.run.smithi061.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-01-01T17:37:14.679 INFO:teuthology.orchestra.run.smithi061.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-01-01T17:37:14.679 INFO:teuthology.orchestra.run.smithi061.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-01-01T17:37:14.679 INFO:teuthology.orchestra.run.smithi061.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-01-01T17:37:14.679 INFO:teuthology.orchestra.run.smithi061.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-01-01T17:37:14.679 INFO:teuthology.orchestra.run.smithi061.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-01-01T17:37:14.679 INFO:teuthology.orchestra.run.smithi061.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-01-01T17:37:14.680 INFO:teuthology.orchestra.run.smithi061.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-01-01T17:37:14.680 INFO:teuthology.orchestra.run.smithi061.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-01-01T17:37:14.680 INFO:teuthology.orchestra.run.smithi061.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-01-01T17:37:14.680 INFO:teuthology.orchestra.run.smithi061.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-01-01T17:37:14.680 INFO:teuthology.orchestra.run.smithi061.stdout: python3-ceph-argparse x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 45 k 2023-01-01T17:37:14.680 INFO:teuthology.orchestra.run.smithi061.stdout: python3-ceph-common x86_64 2:18.0.0-1638.g2d451fdb.el8 ceph 114 k 2023-01-01T17:37:14.680 INFO:teuthology.orchestra.run.smithi061.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-01-01T17:37:14.680 INFO:teuthology.orchestra.run.smithi061.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-01-01T17:37:14.680 INFO:teuthology.orchestra.run.smithi061.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-01-01T17:37:14.680 INFO:teuthology.orchestra.run.smithi061.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-01-01T17:37:14.680 INFO:teuthology.orchestra.run.smithi061.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-01-01T17:37:14.681 INFO:teuthology.orchestra.run.smithi061.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-01-01T17:37:14.681 INFO:teuthology.orchestra.run.smithi061.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-01-01T17:37:14.681 INFO:teuthology.orchestra.run.smithi061.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-01-01T17:37:14.681 INFO:teuthology.orchestra.run.smithi061.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-01-01T17:37:14.681 INFO:teuthology.orchestra.run.smithi061.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-01-01T17:37:14.681 INFO:teuthology.orchestra.run.smithi061.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-01-01T17:37:14.681 INFO:teuthology.orchestra.run.smithi061.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-01-01T17:37:14.681 INFO:teuthology.orchestra.run.smithi061.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-01-01T17:37:14.681 INFO:teuthology.orchestra.run.smithi061.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-01-01T17:37:14.681 INFO:teuthology.orchestra.run.smithi061.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-01-01T17:37:14.681 INFO:teuthology.orchestra.run.smithi061.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-01-01T17:37:14.682 INFO:teuthology.orchestra.run.smithi061.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-01-01T17:37:14.682 INFO:teuthology.orchestra.run.smithi061.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-01-01T17:37:14.682 INFO:teuthology.orchestra.run.smithi061.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-01-01T17:37:14.682 INFO:teuthology.orchestra.run.smithi061.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-01-01T17:37:14.682 INFO:teuthology.orchestra.run.smithi061.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-01-01T17:37:14.682 INFO:teuthology.orchestra.run.smithi061.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-01-01T17:37:14.682 INFO:teuthology.orchestra.run.smithi061.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-01-01T17:37:14.682 INFO:teuthology.orchestra.run.smithi061.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-01-01T17:37:14.682 INFO:teuthology.orchestra.run.smithi061.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-01-01T17:37:14.682 INFO:teuthology.orchestra.run.smithi061.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-01-01T17:37:14.683 INFO:teuthology.orchestra.run.smithi061.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-01-01T17:37:14.683 INFO:teuthology.orchestra.run.smithi061.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-01-01T17:37:14.683 INFO:teuthology.orchestra.run.smithi061.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-01-01T17:37:14.683 INFO:teuthology.orchestra.run.smithi061.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-01-01T17:37:14.683 INFO:teuthology.orchestra.run.smithi061.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-01-01T17:37:14.683 INFO:teuthology.orchestra.run.smithi061.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-01-01T17:37:14.683 INFO:teuthology.orchestra.run.smithi061.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-01-01T17:37:14.683 INFO:teuthology.orchestra.run.smithi061.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-01-01T17:37:14.683 INFO:teuthology.orchestra.run.smithi061.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-01-01T17:37:14.683 INFO:teuthology.orchestra.run.smithi061.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-01-01T17:37:14.683 INFO:teuthology.orchestra.run.smithi061.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-01-01T17:37:14.683 INFO:teuthology.orchestra.run.smithi061.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-01-01T17:37:14.684 INFO:teuthology.orchestra.run.smithi061.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-01-01T17:37:14.684 INFO:teuthology.orchestra.run.smithi061.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-01-01T17:37:14.684 INFO:teuthology.orchestra.run.smithi061.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-01-01T17:37:14.684 INFO:teuthology.orchestra.run.smithi061.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-01-01T17:37:14.684 INFO:teuthology.orchestra.run.smithi061.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-01-01T17:37:14.684 INFO:teuthology.orchestra.run.smithi061.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-01-01T17:37:14.684 INFO:teuthology.orchestra.run.smithi061.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-01-01T17:37:14.684 INFO:teuthology.orchestra.run.smithi061.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-01-01T17:37:14.684 INFO:teuthology.orchestra.run.smithi061.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-01-01T17:37:14.684 INFO:teuthology.orchestra.run.smithi061.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-01-01T17:37:14.684 INFO:teuthology.orchestra.run.smithi061.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-01-01T17:37:14.684 INFO:teuthology.orchestra.run.smithi061.stdout:Enabling module streams: 2023-01-01T17:37:14.685 INFO:teuthology.orchestra.run.smithi061.stdout: postgresql 10 2023-01-01T17:37:14.685 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:37:14.685 INFO:teuthology.orchestra.run.smithi061.stdout:Transaction Summary 2023-01-01T17:37:14.685 INFO:teuthology.orchestra.run.smithi061.stdout:=========================================================================================================================== 2023-01-01T17:37:14.685 INFO:teuthology.orchestra.run.smithi061.stdout:Install 128 Packages 2023-01-01T17:37:14.685 INFO:teuthology.orchestra.run.smithi061.stdout:Upgrade 3 Packages 2023-01-01T17:37:14.685 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:37:14.686 INFO:teuthology.orchestra.run.smithi061.stdout:Total download size: 205 M 2023-01-01T17:37:14.686 INFO:teuthology.orchestra.run.smithi061.stdout:Downloading Packages: 2023-01-01T17:37:14.975 INFO:teuthology.orchestra.run.smithi061.stdout:(1/131): ceph-18.0.0-1638.g2d451fdb.el8.x86_64. 22 kB/s | 6.4 kB 00:00 2023-01-01T17:37:15.341 INFO:teuthology.orchestra.run.smithi149.stdout:(8/131): ceph-common-18.0.0-1638.g2d451fdb.el8. 10 MB/s | 24 MB 00:02 2023-01-01T17:37:15.435 INFO:teuthology.orchestra.run.smithi149.stdout:(9/131): ceph-selinux-18.0.0-1638.g2d451fdb.el8 265 kB/s | 24 kB 00:00 2023-01-01T17:37:15.533 INFO:teuthology.orchestra.run.smithi061.stdout:(2/131): ceph-fuse-18.0.0-1638.g2d451fdb.el8.x8 1.5 MB/s | 845 kB 00:00 2023-01-01T17:37:15.617 INFO:teuthology.orchestra.run.smithi149.stdout:(10/131): ceph-osd-18.0.0-1638.g2d451fdb.el8.x8 9.3 MB/s | 17 MB 00:01 2023-01-01T17:37:15.700 INFO:teuthology.orchestra.run.smithi061.stdout:(3/131): ceph-immutable-object-cache-18.0.0-163 992 kB/s | 165 kB 00:00 2023-01-01T17:37:16.092 INFO:teuthology.orchestra.run.smithi061.stdout:(4/131): ceph-base-18.0.0-1638.g2d451fdb.el8.x8 3.7 MB/s | 5.2 MB 00:01 2023-01-01T17:37:16.226 INFO:teuthology.orchestra.run.smithi149.stdout:(11/131): cephfs-mirror-18.0.0-1638.g2d451fdb.e 423 kB/s | 257 kB 00:00 2023-01-01T17:37:16.484 INFO:teuthology.orchestra.run.smithi061.stdout:(5/131): ceph-mgr-18.0.0-1638.g2d451fdb.el8.x86 3.9 MB/s | 1.5 MB 00:00 2023-01-01T17:37:16.526 INFO:teuthology.orchestra.run.smithi149.stdout:(12/131): ceph-radosgw-18.0.0-1638.g2d451fdb.el 5.8 MB/s | 13 MB 00:02 2023-01-01T17:37:16.601 INFO:teuthology.orchestra.run.smithi061.stdout:(6/131): ceph-mds-18.0.0-1638.g2d451fdb.el8.x86 2.5 MB/s | 2.3 MB 00:00 2023-01-01T17:37:16.768 INFO:teuthology.orchestra.run.smithi149.stdout:(13/131): libcephfs2-18.0.0-1638.g2d451fdb.el8. 3.1 MB/s | 768 kB 00:00 2023-01-01T17:37:16.793 INFO:teuthology.orchestra.run.smithi149.stdout:(14/131): libcephfs-devel-18.0.0-1638.g2d451fdb 54 kB/s | 30 kB 00:00 2023-01-01T17:37:16.868 INFO:teuthology.orchestra.run.smithi149.stdout:(15/131): libcephsqlite-18.0.0-1638.g2d451fdb.e 1.3 MB/s | 137 kB 00:00 2023-01-01T17:37:16.902 INFO:teuthology.orchestra.run.smithi149.stdout:(16/131): librados-devel-18.0.0-1638.g2d451fdb. 1.3 MB/s | 139 kB 00:00 2023-01-01T17:37:17.136 INFO:teuthology.orchestra.run.smithi149.stdout:(17/131): libradosstriper1-18.0.0-1638.g2d451fd 1.7 MB/s | 474 kB 00:00 2023-01-01T17:37:17.219 INFO:teuthology.orchestra.run.smithi149.stdout:(18/131): python3-ceph-argparse-18.0.0-1638.g2d 535 kB/s | 45 kB 00:00 2023-01-01T17:37:17.305 INFO:teuthology.orchestra.run.smithi149.stdout:(19/131): python3-ceph-common-18.0.0-1638.g2d45 1.3 MB/s | 114 kB 00:00 2023-01-01T17:37:17.314 INFO:teuthology.orchestra.run.smithi061.stdout:(7/131): ceph-mon-18.0.0-1638.g2d451fdb.el8.x86 4.7 MB/s | 3.9 MB 00:00 2023-01-01T17:37:17.361 INFO:teuthology.orchestra.run.smithi149.stdout:(20/131): python3-cephfs-18.0.0-1638.g2d451fdb. 3.2 MB/s | 190 kB 00:00 2023-01-01T17:37:17.520 INFO:teuthology.orchestra.run.smithi149.stdout:(21/131): python3-rados-18.0.0-1638.g2d451fdb.e 2.3 MB/s | 371 kB 00:00 2023-01-01T17:37:17.678 INFO:teuthology.orchestra.run.smithi149.stdout:(22/131): python3-rbd-18.0.0-1638.g2d451fdb.el8 2.3 MB/s | 365 kB 00:00 2023-01-01T17:37:17.770 INFO:teuthology.orchestra.run.smithi149.stdout:(23/131): python3-rgw-18.0.0-1638.g2d451fdb.el8 1.1 MB/s | 107 kB 00:00 2023-01-01T17:37:17.862 INFO:teuthology.orchestra.run.smithi149.stdout:(24/131): rbd-fuse-18.0.0-1638.g2d451fdb.el8.x8 1.0 MB/s | 94 kB 00:00 2023-01-01T17:37:18.210 INFO:teuthology.orchestra.run.smithi061.stdout:(8/131): ceph-common-18.0.0-1638.g2d451fdb.el8. 6.9 MB/s | 24 MB 00:03 2023-01-01T17:37:18.277 INFO:teuthology.orchestra.run.smithi061.stdout:(9/131): ceph-selinux-18.0.0-1638.g2d451fdb.el8 366 kB/s | 24 kB 00:00 2023-01-01T17:37:18.455 INFO:teuthology.orchestra.run.smithi149.stdout:(25/131): librgw2-18.0.0-1638.g2d451fdb.el8.x86 4.2 MB/s | 6.5 MB 00:01 2023-01-01T17:37:18.546 INFO:teuthology.orchestra.run.smithi149.stdout:(26/131): rbd-nbd-18.0.0-1638.g2d451fdb.el8.x86 1.9 MB/s | 180 kB 00:00 2023-01-01T17:37:18.630 INFO:teuthology.orchestra.run.smithi149.stdout:(27/131): ceph-grafana-dashboards-18.0.0-1638.g 276 kB/s | 23 kB 00:00 2023-01-01T17:37:18.722 INFO:teuthology.orchestra.run.smithi149.stdout:(28/131): ceph-mgr-cephadm-18.0.0-1638.g2d451fd 1.3 MB/s | 119 kB 00:00 2023-01-01T17:37:18.937 INFO:teuthology.orchestra.run.smithi149.stdout:(29/131): rbd-mirror-18.0.0-1638.g2d451fdb.el8. 3.2 MB/s | 3.4 MB 00:01 2023-01-01T17:37:19.189 INFO:teuthology.orchestra.run.smithi149.stdout:(30/131): ceph-mgr-dashboard-18.0.0-1638.g2d451 3.6 MB/s | 1.7 MB 00:00 2023-01-01T17:37:19.281 INFO:teuthology.orchestra.run.smithi149.stdout:(31/131): ceph-mgr-modules-core-18.0.0-1638.g2d 2.5 MB/s | 234 kB 00:00 2023-01-01T17:37:19.365 INFO:teuthology.orchestra.run.smithi149.stdout:(32/131): ceph-mgr-rook-18.0.0-1638.g2d451fdb.e 564 kB/s | 47 kB 00:00 2023-01-01T17:37:19.424 INFO:teuthology.orchestra.run.smithi149.stdout:(33/131): ceph-prometheus-alerts-18.0.0-1638.g2 249 kB/s | 15 kB 00:00 2023-01-01T17:37:19.469 INFO:teuthology.orchestra.run.smithi061.stdout:(10/131): ceph-radosgw-18.0.0-1638.g2d451fdb.el 6.0 MB/s | 13 MB 00:02 2023-01-01T17:37:19.499 INFO:teuthology.orchestra.run.smithi149.stdout:(34/131): ceph-volume-18.0.0-1638.g2d451fdb.el8 3.4 MB/s | 263 kB 00:00 2023-01-01T17:37:19.561 INFO:teuthology.orchestra.run.smithi061.stdout:(11/131): cephfs-mirror-18.0.0-1638.g2d451fdb.e 2.7 MB/s | 257 kB 00:00 2023-01-01T17:37:19.591 INFO:teuthology.orchestra.run.smithi149.stdout:(35/131): cephadm-18.0.0-1638.g2d451fdb.el8.noa 890 kB/s | 81 kB 00:00 2023-01-01T17:37:19.627 INFO:teuthology.orchestra.run.smithi061.stdout:(12/131): libcephfs-devel-18.0.0-1638.g2d451fdb 458 kB/s | 30 kB 00:00 2023-01-01T17:37:19.668 INFO:teuthology.orchestra.run.smithi149.stdout:(36/131): cephfs-top-18.0.0-1638.g2d451fdb.el8. 232 kB/s | 17 kB 00:00 2023-01-01T17:37:19.786 INFO:teuthology.orchestra.run.smithi061.stdout:(13/131): libcephfs2-18.0.0-1638.g2d451fdb.el8. 4.7 MB/s | 768 kB 00:00 2023-01-01T17:37:19.866 INFO:teuthology.orchestra.run.smithi149.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.5 MB/s | 306 kB 00:00 2023-01-01T17:37:19.870 INFO:teuthology.orchestra.run.smithi061.stdout:(14/131): libcephsqlite-18.0.0-1638.g2d451fdb.e 1.6 MB/s | 137 kB 00:00 2023-01-01T17:37:19.908 INFO:teuthology.orchestra.run.smithi149.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 1.4 MB/s | 59 kB 00:00 2023-01-01T17:37:19.955 INFO:teuthology.orchestra.run.smithi061.stdout:(15/131): librados-devel-18.0.0-1638.g2d451fdb. 1.6 MB/s | 139 kB 00:00 2023-01-01T17:37:19.958 INFO:teuthology.orchestra.run.smithi149.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 1.5 MB/s | 75 kB 00:00 2023-01-01T17:37:20.084 INFO:teuthology.orchestra.run.smithi149.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 3.7 MB/s | 476 kB 00:00 2023-01-01T17:37:20.121 INFO:teuthology.orchestra.run.smithi061.stdout:(16/131): libradosstriper1-18.0.0-1638.g2d451fd 2.8 MB/s | 474 kB 00:00 2023-01-01T17:37:20.151 INFO:teuthology.orchestra.run.smithi149.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 654 kB/s | 44 kB 00:00 2023-01-01T17:37:20.218 INFO:teuthology.orchestra.run.smithi149.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 2.7 MB/s | 185 kB 00:00 2023-01-01T17:37:20.278 INFO:teuthology.orchestra.run.smithi149.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 565 kB/s | 33 kB 00:00 2023-01-01T17:37:20.339 INFO:teuthology.orchestra.run.smithi149.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 280 kB/s | 16 kB 00:00 2023-01-01T17:37:20.411 INFO:teuthology.orchestra.run.smithi149.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 2.3 MB/s | 173 kB 00:00 2023-01-01T17:37:20.536 INFO:teuthology.orchestra.run.smithi149.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 3.0 MB/s | 384 kB 00:00 2023-01-01T17:37:20.620 INFO:teuthology.orchestra.run.smithi149.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 975 kB/s | 81 kB 00:00 2023-01-01T17:37:20.697 INFO:teuthology.orchestra.run.smithi149.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 148 kB/s | 11 kB 00:00 2023-01-01T17:37:20.772 INFO:teuthology.orchestra.run.smithi149.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 235 kB/s | 18 kB 00:00 2023-01-01T17:37:20.926 INFO:teuthology.orchestra.run.smithi149.stdout:(50/131): python3-kubernetes-11.0.0-6.el8.noarc 7.8 MB/s | 1.2 MB 00:00 2023-01-01T17:37:20.970 INFO:teuthology.orchestra.run.smithi149.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 974 kB/s | 49 kB 00:00 2023-01-01T17:37:21.029 INFO:teuthology.orchestra.run.smithi149.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 1.1 MB/s | 59 kB 00:00 2023-01-01T17:37:21.072 INFO:teuthology.orchestra.run.smithi149.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.2 MB/s | 60 kB 00:00 2023-01-01T17:37:21.146 INFO:teuthology.orchestra.run.smithi061.stdout:(17/131): librgw2-18.0.0-1638.g2d451fdb.el8.x86 6.3 MB/s | 6.5 MB 00:01 2023-01-01T17:37:21.205 INFO:teuthology.orchestra.run.smithi149.stdout:(54/131): ceph-mgr-diskprediction-local-18.0.0- 3.3 MB/s | 7.4 MB 00:02 2023-01-01T17:37:21.213 INFO:teuthology.orchestra.run.smithi061.stdout:(18/131): python3-ceph-argparse-18.0.0-1638.g2d 671 kB/s | 45 kB 00:00 2023-01-01T17:37:21.232 INFO:teuthology.orchestra.run.smithi149.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.7 MB/s | 283 kB 00:00 2023-01-01T17:37:21.280 INFO:teuthology.orchestra.run.smithi061.stdout:(19/131): python3-ceph-common-18.0.0-1638.g2d45 1.7 MB/s | 114 kB 00:00 2023-01-01T17:37:21.283 INFO:teuthology.orchestra.run.smithi149.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 645 kB/s | 34 kB 00:00 2023-01-01T17:37:21.316 INFO:teuthology.orchestra.run.smithi149.stdout:(57/131): python3-portend-2.6-1.el8.noarch.rpm 140 kB/s | 16 kB 00:00 2023-01-01T17:37:21.339 INFO:teuthology.orchestra.run.smithi061.stdout:(20/131): python3-cephfs-18.0.0-1638.g2d451fdb. 3.2 MB/s | 190 kB 00:00 2023-01-01T17:37:21.341 INFO:teuthology.orchestra.run.smithi149.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 3.3 MB/s | 196 kB 00:00 2023-01-01T17:37:21.393 INFO:teuthology.orchestra.run.smithi149.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 375 kB/s | 19 kB 00:00 2023-01-01T17:37:21.405 INFO:teuthology.orchestra.run.smithi061.stdout:(21/131): python3-rados-18.0.0-1638.g2d451fdb.e 5.4 MB/s | 371 kB 00:00 2023-01-01T17:37:21.442 INFO:teuthology.orchestra.run.smithi149.stdout:(60/131): python3-rsa-4.8-1.el8.noarch.rpm 493 kB/s | 61 kB 00:00 2023-01-01T17:37:21.467 INFO:teuthology.orchestra.run.smithi149.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 318 kB/s | 24 kB 00:00 2023-01-01T17:37:21.481 INFO:teuthology.orchestra.run.smithi061.stdout:(22/131): python3-rbd-18.0.0-1638.g2d451fdb.el8 4.8 MB/s | 365 kB 00:00 2023-01-01T17:37:21.493 INFO:teuthology.orchestra.run.smithi149.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 573 kB/s | 29 kB 00:00 2023-01-01T17:37:21.543 INFO:teuthology.orchestra.run.smithi061.stdout:(23/131): python3-rgw-18.0.0-1638.g2d451fdb.el8 1.8 MB/s | 107 kB 00:00 2023-01-01T17:37:21.598 INFO:teuthology.orchestra.run.smithi061.stdout:(24/131): rbd-fuse-18.0.0-1638.g2d451fdb.el8.x8 1.6 MB/s | 94 kB 00:00 2023-01-01T17:37:21.901 INFO:teuthology.orchestra.run.smithi149.stdout:(63/131): ceph-test-18.0.0-1638.g2d451fdb.el8.x 7.4 MB/s | 48 MB 00:06 2023-01-01T17:37:21.927 INFO:teuthology.orchestra.run.smithi149.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 60 kB/s | 27 kB 00:00 2023-01-01T17:37:21.952 INFO:teuthology.orchestra.run.smithi149.stdout:(65/131): python3-waitress-1.2.1-2.el8.1.noarch 525 kB/s | 241 kB 00:00 2023-01-01T17:37:21.977 INFO:teuthology.orchestra.run.smithi149.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2023-01-01T17:37:21.990 INFO:teuthology.orchestra.run.smithi061.stdout:(25/131): rbd-mirror-18.0.0-1638.g2d451fdb.el8. 8.8 MB/s | 3.4 MB 00:00 2023-01-01T17:37:22.002 INFO:teuthology.orchestra.run.smithi149.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.7 MB/s | 85 kB 00:00 2023-01-01T17:37:22.028 INFO:teuthology.orchestra.run.smithi149.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 457 kB/s | 23 kB 00:00 2023-01-01T17:37:22.048 INFO:teuthology.orchestra.run.smithi061.stdout:(26/131): rbd-nbd-18.0.0-1638.g2d451fdb.el8.x86 3.0 MB/s | 180 kB 00:00 2023-01-01T17:37:22.053 INFO:teuthology.orchestra.run.smithi149.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-01-01T17:37:22.103 INFO:teuthology.orchestra.run.smithi149.stdout:(70/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 359 kB/s | 18 kB 00:00 2023-01-01T17:37:22.115 INFO:teuthology.orchestra.run.smithi061.stdout:(27/131): ceph-grafana-dashboards-18.0.0-1638.g 346 kB/s | 23 kB 00:00 2023-01-01T17:37:22.128 INFO:teuthology.orchestra.run.smithi149.stdout:(71/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.1 MB/s | 251 kB 00:00 2023-01-01T17:37:22.164 INFO:teuthology.orchestra.run.smithi149.stdout:(72/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-01-01T17:37:22.191 INFO:teuthology.orchestra.run.smithi061.stdout:(28/131): ceph-mgr-cephadm-18.0.0-1638.g2d451fd 1.6 MB/s | 119 kB 00:00 2023-01-01T17:37:22.196 INFO:teuthology.orchestra.run.smithi149.stdout:(73/131): python3-pycparser-2.14-14.el8.noarch. 1.6 MB/s | 109 kB 00:00 2023-01-01T17:37:22.237 INFO:teuthology.orchestra.run.smithi149.stdout:(74/131): thrift-0.13.0-2.el8.x86_64.rpm 7.4 MB/s | 1.7 MB 00:00 2023-01-01T17:37:22.288 INFO:teuthology.orchestra.run.smithi149.stdout:(75/131): python3-oauthlib-2.1.0-1.el8.noarch.r 1.3 MB/s | 155 kB 00:00 2023-01-01T17:37:22.313 INFO:teuthology.orchestra.run.smithi149.stdout:(76/131): python3-requests-oauthlib-1.0.0-1.el8 365 kB/s | 43 kB 00:00 2023-01-01T17:37:22.331 INFO:teuthology.orchestra.run.smithi149.stdout:(77/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 513 kB/s | 19 kB 00:00 2023-01-01T17:37:22.357 INFO:teuthology.orchestra.run.smithi149.stdout:(78/131): python3-jwt-1.6.1-2.el8.noarch.rpm 363 kB/s | 43 kB 00:00 2023-01-01T17:37:22.372 INFO:teuthology.orchestra.run.smithi149.stdout:(79/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.8 MB/s | 229 kB 00:00 2023-01-01T17:37:22.400 INFO:teuthology.orchestra.run.smithi149.stdout:(80/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.2 MB/s | 220 kB 00:00 2023-01-01T17:37:22.407 INFO:teuthology.orchestra.run.smithi061.stdout:(29/131): ceph-mgr-dashboard-18.0.0-1638.g2d451 7.7 MB/s | 1.7 MB 00:00 2023-01-01T17:37:22.423 INFO:teuthology.orchestra.run.smithi149.stdout:(81/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 934 kB/s | 47 kB 00:00 2023-01-01T17:37:22.448 INFO:teuthology.orchestra.run.smithi149.stdout:(82/131): libselinux-devel-2.9-5.el8.x86_64.rpm 3.9 MB/s | 200 kB 00:00 2023-01-01T17:37:22.474 INFO:teuthology.orchestra.run.smithi149.stdout:(83/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 962 kB/s | 48 kB 00:00 2023-01-01T17:37:22.505 INFO:teuthology.orchestra.run.smithi149.stdout:(84/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-01-01T17:37:22.532 INFO:teuthology.orchestra.run.smithi149.stdout:(85/131): pcre2-devel-10.32-2.el8.x86_64.rpm 3.3 MB/s | 605 kB 00:00 2023-01-01T17:37:22.566 INFO:teuthology.orchestra.run.smithi149.stdout:(86/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 5.9 MB/s | 560 kB 00:00 2023-01-01T17:37:22.591 INFO:teuthology.orchestra.run.smithi149.stdout:(87/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 981 kB/s | 58 kB 00:00 2023-01-01T17:37:22.624 INFO:teuthology.orchestra.run.smithi149.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.4 MB/s | 72 kB 00:00 2023-01-01T17:37:22.642 INFO:teuthology.orchestra.run.smithi149.stdout:(89/131): python3-cryptography-3.2.1-5.el8.x86_ 3.8 MB/s | 559 kB 00:00 2023-01-01T17:37:22.642 INFO:teuthology.orchestra.run.smithi061.stdout:(30/131): ceph-osd-18.0.0-1638.g2d451fdb.el8.x8 2.8 MB/s | 17 MB 00:06 2023-01-01T17:37:22.667 INFO:teuthology.orchestra.run.smithi149.stdout:(90/131): fuse-2.9.7-15.el8.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2023-01-01T17:37:22.692 INFO:teuthology.orchestra.run.smithi149.stdout:(91/131): elfutils-libelf-devel-0.186-1.el8.x86 795 kB/s | 60 kB 00:00 2023-01-01T17:37:22.718 INFO:teuthology.orchestra.run.smithi149.stdout:(92/131): libcom_err-devel-1.45.6-4.el8.x86_64. 770 kB/s | 39 kB 00:00 2023-01-01T17:37:22.743 INFO:teuthology.orchestra.run.smithi149.stdout:(93/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 975 kB/s | 98 kB 00:00 2023-01-01T17:37:22.777 INFO:teuthology.orchestra.run.smithi149.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 11 MB/s | 644 kB 00:00 2023-01-01T17:37:22.805 INFO:teuthology.orchestra.run.smithi149.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.9 MB/s | 171 kB 00:00 2023-01-01T17:37:22.827 INFO:teuthology.orchestra.run.smithi149.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-01-01T17:37:22.869 INFO:teuthology.orchestra.run.smithi149.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.6 MB/s | 110 kB 00:00 2023-01-01T17:37:22.919 INFO:teuthology.orchestra.run.smithi149.stdout:(98/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 10 MB/s | 2.3 MB 00:00 2023-01-01T17:37:22.936 INFO:teuthology.orchestra.run.smithi149.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 810 kB/s | 54 kB 00:00 2023-01-01T17:37:22.961 INFO:teuthology.orchestra.run.smithi149.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-01-01T17:37:22.987 INFO:teuthology.orchestra.run.smithi149.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 6.3 MB/s | 323 kB 00:00 2023-01-01T17:37:23.004 INFO:teuthology.orchestra.run.smithi149.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 927 kB/s | 39 kB 00:00 2023-01-01T17:37:23.037 INFO:teuthology.orchestra.run.smithi149.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 13 MB/s | 688 kB 00:00 2023-01-01T17:37:23.084 INFO:teuthology.orchestra.run.smithi061.stdout:(31/131): ceph-test-18.0.0-1638.g2d451fdb.el8.x 10 MB/s | 48 MB 00:04 2023-01-01T17:37:23.096 INFO:teuthology.orchestra.run.smithi149.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 5.7 MB/s | 538 kB 00:00 2023-01-01T17:37:23.109 INFO:teuthology.orchestra.run.smithi061.stdout:(32/131): ceph-mgr-modules-core-18.0.0-1638.g2d 502 kB/s | 234 kB 00:00 2023-01-01T17:37:23.129 INFO:teuthology.orchestra.run.smithi149.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 1.7 MB/s | 157 kB 00:00 2023-01-01T17:37:23.142 INFO:teuthology.orchestra.run.smithi061.stdout:(33/131): ceph-mgr-rook-18.0.0-1638.g2d451fdb.e 808 kB/s | 47 kB 00:00 2023-01-01T17:37:23.155 INFO:teuthology.orchestra.run.smithi149.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2023-01-01T17:37:23.167 INFO:teuthology.orchestra.run.smithi061.stdout:(34/131): ceph-prometheus-alerts-18.0.0-1638.g2 248 kB/s | 15 kB 00:00 2023-01-01T17:37:23.197 INFO:teuthology.orchestra.run.smithi149.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-01-01T17:37:23.218 INFO:teuthology.orchestra.run.smithi061.stdout:(35/131): cephadm-18.0.0-1638.g2d451fdb.el8.noa 1.6 MB/s | 81 kB 00:00 2023-01-01T17:37:23.239 INFO:teuthology.orchestra.run.smithi149.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 640 kB/s | 27 kB 00:00 2023-01-01T17:37:23.243 INFO:teuthology.orchestra.run.smithi061.stdout:(36/131): ceph-volume-18.0.0-1638.g2d451fdb.el8 2.6 MB/s | 263 kB 00:00 2023-01-01T17:37:23.263 INFO:teuthology.orchestra.run.smithi061.stdout:(37/131): cephfs-top-18.0.0-1638.g2d451fdb.el8. 415 kB/s | 17 kB 00:00 2023-01-01T17:37:23.281 INFO:teuthology.orchestra.run.smithi149.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-01-01T17:37:23.314 INFO:teuthology.orchestra.run.smithi149.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.3 MB/s | 44 kB 00:00 2023-01-01T17:37:23.345 INFO:teuthology.orchestra.run.smithi061.stdout:(38/131): ceph-mgr-diskprediction-local-18.0.0- 7.9 MB/s | 7.4 MB 00:00 2023-01-01T17:37:23.406 INFO:teuthology.orchestra.run.smithi149.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 19 MB/s | 4.8 MB 00:00 2023-01-01T17:37:23.448 INFO:teuthology.orchestra.run.smithi149.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 11 MB/s | 457 kB 00:00 2023-01-01T17:37:23.490 INFO:teuthology.orchestra.run.smithi149.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-01-01T17:37:23.502 INFO:teuthology.orchestra.run.smithi061.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.2 MB/s | 306 kB 00:00 2023-01-01T17:37:23.540 INFO:teuthology.orchestra.run.smithi149.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 17 MB/s | 3.7 MB 00:00 2023-01-01T17:37:23.565 INFO:teuthology.orchestra.run.smithi149.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 851 kB/s | 64 kB 00:00 2023-01-01T17:37:23.587 INFO:teuthology.orchestra.run.smithi061.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 5.6 MB/s | 476 kB 00:00 2023-01-01T17:37:23.594 INFO:teuthology.orchestra.run.smithi149.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.5 MB/s | 126 kB 00:00 2023-01-01T17:37:23.616 INFO:teuthology.orchestra.run.smithi149.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 397 kB/s | 20 kB 00:00 2023-01-01T17:37:23.628 INFO:teuthology.orchestra.run.smithi061.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.0 MB/s | 44 kB 00:00 2023-01-01T17:37:23.641 INFO:teuthology.orchestra.run.smithi149.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2023-01-01T17:37:23.675 INFO:teuthology.orchestra.run.smithi149.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-01-01T17:37:23.678 INFO:teuthology.orchestra.run.smithi061.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 3.6 MB/s | 185 kB 00:00 2023-01-01T17:37:23.717 INFO:teuthology.orchestra.run.smithi149.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-01-01T17:37:23.728 INFO:teuthology.orchestra.run.smithi061.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 655 kB/s | 33 kB 00:00 2023-01-01T17:37:23.770 INFO:teuthology.orchestra.run.smithi061.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 393 kB/s | 16 kB 00:00 2023-01-01T17:37:23.821 INFO:teuthology.orchestra.run.smithi061.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 3.4 MB/s | 173 kB 00:00 2023-01-01T17:37:23.859 INFO:teuthology.orchestra.run.smithi149.stdout:(121/131): python3-scipy-1.0.0-21.module+el8.5. 13 MB/s | 14 MB 00:01 2023-01-01T17:37:23.871 INFO:teuthology.orchestra.run.smithi061.stdout:(46/131): liboath-2.6.2-3.el8.x86_64.rpm 96 kB/s | 59 kB 00:00 2023-01-01T17:37:23.896 INFO:teuthology.orchestra.run.smithi061.stdout:(47/131): libunwind-1.3.1-3.el8.x86_64.rpm 136 kB/s | 75 kB 00:00 2023-01-01T17:37:23.921 INFO:teuthology.orchestra.run.smithi061.stdout:(48/131): python3-cherrypy-18.4.0-1.el8.noarch. 3.7 MB/s | 384 kB 00:00 2023-01-01T17:37:23.932 INFO:teuthology.orchestra.run.smithi149.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 2.7 MB/s | 202 kB 00:00 2023-01-01T17:37:23.947 INFO:teuthology.orchestra.run.smithi061.stdout:(49/131): python3-google-auth-1.1.1-10.el8.noar 1.0 MB/s | 81 kB 00:00 2023-01-01T17:37:23.972 INFO:teuthology.orchestra.run.smithi061.stdout:(50/131): python3-jaraco-6.2-6.el8.noarch.rpm 147 kB/s | 11 kB 00:00 2023-01-01T17:37:23.976 INFO:teuthology.orchestra.run.smithi149.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 7.8 MB/s | 354 kB 00:00 2023-01-01T17:37:23.997 INFO:teuthology.orchestra.run.smithi061.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 233 kB/s | 18 kB 00:00 2023-01-01T17:37:24.023 INFO:teuthology.orchestra.run.smithi061.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 971 kB/s | 49 kB 00:00 2023-01-01T17:37:24.048 INFO:teuthology.orchestra.run.smithi061.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 1.1 MB/s | 59 kB 00:00 2023-01-01T17:37:24.068 INFO:teuthology.orchestra.run.smithi149.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 11 MB/s | 4.9 MB 00:00 2023-01-01T17:37:24.073 INFO:teuthology.orchestra.run.smithi061.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.2 MB/s | 60 kB 00:00 2023-01-01T17:37:24.101 INFO:teuthology.orchestra.run.smithi061.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 5.5 MB/s | 283 kB 00:00 2023-01-01T17:37:24.125 INFO:teuthology.orchestra.run.smithi061.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 309 kB/s | 16 kB 00:00 2023-01-01T17:37:24.143 INFO:teuthology.orchestra.run.smithi149.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 11 MB/s | 4.7 MB 00:00 2023-01-01T17:37:24.157 INFO:teuthology.orchestra.run.smithi061.stdout:(57/131): python3-kubernetes-11.0.0-6.el8.noarc 5.5 MB/s | 1.2 MB 00:00 2023-01-01T17:37:24.177 INFO:teuthology.orchestra.run.smithi149.stdout:(126/131): postgresql-contrib-10.21-2.module+el 7.3 MB/s | 808 kB 00:00 2023-01-01T17:37:24.183 INFO:teuthology.orchestra.run.smithi061.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 402 kB/s | 34 kB 00:00 2023-01-01T17:37:24.208 INFO:teuthology.orchestra.run.smithi061.stdout:(59/131): python3-rsa-4.8-1.el8.noarch.rpm 1.2 MB/s | 61 kB 00:00 2023-01-01T17:37:24.227 INFO:teuthology.orchestra.run.smithi149.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 18 MB/s | 1.5 MB 00:00 2023-01-01T17:37:24.233 INFO:teuthology.orchestra.run.smithi061.stdout:(60/131): python3-routes-2.4.1-12.el8.noarch.rp 1.8 MB/s | 196 kB 00:00 2023-01-01T17:37:24.258 INFO:teuthology.orchestra.run.smithi061.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 248 kB/s | 19 kB 00:00 2023-01-01T17:37:24.284 INFO:teuthology.orchestra.run.smithi061.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 318 kB/s | 24 kB 00:00 2023-01-01T17:37:24.309 INFO:teuthology.orchestra.run.smithi061.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 387 kB/s | 29 kB 00:00 2023-01-01T17:37:24.311 INFO:teuthology.orchestra.run.smithi149.stdout:(128/131): postgresql-server-10.21-2.module+el8 15 MB/s | 5.1 MB 00:00 2023-01-01T17:37:24.334 INFO:teuthology.orchestra.run.smithi061.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 364 kB/s | 27 kB 00:00 2023-01-01T17:37:24.359 INFO:teuthology.orchestra.run.smithi061.stdout:(65/131): python3-waitress-1.2.1-2.el8.1.noarch 3.1 MB/s | 241 kB 00:00 2023-01-01T17:37:24.369 INFO:teuthology.orchestra.run.smithi149.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-01-01T17:37:24.385 INFO:teuthology.orchestra.run.smithi061.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2023-01-01T17:37:24.410 INFO:teuthology.orchestra.run.smithi061.stdout:(67/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.4 MB/s | 251 kB 00:00 2023-01-01T17:37:24.435 INFO:teuthology.orchestra.run.smithi061.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2023-01-01T17:37:24.460 INFO:teuthology.orchestra.run.smithi061.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 304 kB/s | 23 kB 00:00 2023-01-01T17:37:24.486 INFO:teuthology.orchestra.run.smithi061.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-01-01T17:37:24.536 INFO:teuthology.orchestra.run.smithi061.stdout:(71/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 238 kB/s | 18 kB 00:00 2023-01-01T17:37:24.561 INFO:teuthology.orchestra.run.smithi061.stdout:(72/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.5 MB/s | 238 kB 00:00 2023-01-01T17:37:24.587 INFO:teuthology.orchestra.run.smithi061.stdout:(73/131): python3-pycparser-2.14-14.el8.noarch. 2.1 MB/s | 109 kB 00:00 2023-01-01T17:37:24.687 INFO:teuthology.orchestra.run.smithi061.stdout:(74/131): python3-oauthlib-2.1.0-1.el8.noarch.r 1.2 MB/s | 155 kB 00:00 2023-01-01T17:37:24.776 INFO:teuthology.orchestra.run.smithi149.stdout:(130/131): librbd1-18.0.0-1638.g2d451fdb.el8.x8 6.5 MB/s | 3.6 MB 00:00 2023-01-01T17:37:24.814 INFO:teuthology.orchestra.run.smithi061.stdout:(75/131): python3-requests-oauthlib-1.0.0-1.el8 189 kB/s | 43 kB 00:00 2023-01-01T17:37:24.845 INFO:teuthology.orchestra.run.smithi149.stdout:(131/131): librados2-18.0.0-1638.g2d451fdb.el8. 5.4 MB/s | 3.6 MB 00:00 2023-01-01T17:37:24.848 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2023-01-01T17:37:24.848 INFO:teuthology.orchestra.run.smithi149.stdout:Total 17 MB/s | 205 MB 00:11 2023-01-01T17:37:24.854 INFO:teuthology.orchestra.run.smithi061.stdout:(76/131): thrift-0.13.0-2.el8.x86_64.rpm 3.9 MB/s | 1.7 MB 00:00 2023-01-01T17:37:24.904 INFO:teuthology.orchestra.run.smithi061.stdout:(77/131): python3-jwt-1.6.1-2.el8.noarch.rpm 198 kB/s | 43 kB 00:00 2023-01-01T17:37:24.930 INFO:teuthology.orchestra.run.smithi061.stdout:(78/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 160 kB/s | 19 kB 00:00 2023-01-01T17:37:24.955 INFO:teuthology.orchestra.run.smithi061.stdout:(79/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.9 MB/s | 220 kB 00:00 2023-01-01T17:37:24.980 INFO:teuthology.orchestra.run.smithi061.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.8 MB/s | 229 kB 00:00 2023-01-01T17:37:24.997 INFO:teuthology.orchestra.run.smithi061.stdout:(81/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2023-01-01T17:37:25.023 INFO:teuthology.orchestra.run.smithi061.stdout:(82/131): libselinux-devel-2.9-5.el8.x86_64.rpm 4.7 MB/s | 200 kB 00:00 2023-01-01T17:37:25.041 INFO:teuthology.orchestra.run.smithi061.stdout:(83/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 1.1 MB/s | 48 kB 00:00 2023-01-01T17:37:25.056 INFO:teuthology.orchestra.run.smithi061.stdout:(84/131): libsepol-devel-2.9-3.el8.x86_64.rpm 2.5 MB/s | 87 kB 00:00 2023-01-01T17:37:25.090 INFO:teuthology.orchestra.run.smithi061.stdout:(85/131): pcre2-devel-10.32-2.el8.x86_64.rpm 3.7 MB/s | 605 kB 00:00 2023-01-01T17:37:25.132 INFO:teuthology.orchestra.run.smithi061.stdout:(86/131): python3-cryptography-3.2.1-5.el8.x86_ 7.3 MB/s | 559 kB 00:00 2023-01-01T17:37:25.157 INFO:teuthology.orchestra.run.smithi061.stdout:(87/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 4.7 MB/s | 560 kB 00:00 2023-01-01T17:37:25.183 INFO:teuthology.orchestra.run.smithi061.stdout:(88/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 627 kB/s | 58 kB 00:00 2023-01-01T17:37:25.208 INFO:teuthology.orchestra.run.smithi061.stdout:(89/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 962 kB/s | 72 kB 00:00 2023-01-01T17:37:25.233 INFO:teuthology.orchestra.run.smithi061.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.2 MB/s | 60 kB 00:00 2023-01-01T17:37:25.267 INFO:teuthology.orchestra.run.smithi061.stdout:(91/131): fuse-2.9.7-15.el8.x86_64.rpm 758 kB/s | 83 kB 00:00 2023-01-01T17:37:25.292 INFO:teuthology.orchestra.run.smithi061.stdout:(92/131): libcom_err-devel-1.45.6-4.el8.x86_64. 661 kB/s | 39 kB 00:00 2023-01-01T17:37:25.317 INFO:teuthology.orchestra.run.smithi061.stdout:(93/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 901 kB/s | 98 kB 00:00 2023-01-01T17:37:25.359 INFO:teuthology.orchestra.run.smithi061.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 9.4 MB/s | 644 kB 00:00 2023-01-01T17:37:25.385 INFO:teuthology.orchestra.run.smithi061.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.5 MB/s | 171 kB 00:00 2023-01-01T17:37:25.410 INFO:teuthology.orchestra.run.smithi061.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-01-01T17:37:25.443 INFO:teuthology.orchestra.run.smithi061.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 3.2 MB/s | 110 kB 00:00 2023-01-01T17:37:25.477 INFO:teuthology.orchestra.run.smithi061.stdout:(98/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.6 MB/s | 54 kB 00:00 2023-01-01T17:37:25.519 INFO:teuthology.orchestra.run.smithi061.stdout:(99/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 9.2 MB/s | 2.3 MB 00:00 2023-01-01T17:37:25.553 INFO:teuthology.orchestra.run.smithi061.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.4 MB/s | 259 kB 00:00 2023-01-01T17:37:25.579 INFO:teuthology.orchestra.run.smithi061.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-01-01T17:37:25.603 INFO:teuthology.orchestra.run.smithi061.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 772 kB/s | 39 kB 00:00 2023-01-01T17:37:25.646 INFO:teuthology.orchestra.run.smithi061.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 10 MB/s | 688 kB 00:00 2023-01-01T17:37:25.676 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2023-01-01T17:37:25.687 INFO:teuthology.orchestra.run.smithi061.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 6.3 MB/s | 538 kB 00:00 2023-01-01T17:37:25.717 INFO:teuthology.orchestra.run.smithi061.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2023-01-01T17:37:25.731 INFO:teuthology.orchestra.run.smithi061.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-01-01T17:37:25.772 INFO:teuthology.orchestra.run.smithi061.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-01-01T17:37:25.796 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2023-01-01T17:37:25.796 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2023-01-01T17:37:25.805 INFO:teuthology.orchestra.run.smithi061.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 801 kB/s | 27 kB 00:00 2023-01-01T17:37:25.847 INFO:teuthology.orchestra.run.smithi061.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-01-01T17:37:25.881 INFO:teuthology.orchestra.run.smithi061.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.3 MB/s | 44 kB 00:00 2023-01-01T17:37:25.998 INFO:teuthology.orchestra.run.smithi061.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 18 MB/s | 4.8 MB 00:00 2023-01-01T17:37:26.049 INFO:teuthology.orchestra.run.smithi061.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 9.0 MB/s | 457 kB 00:00 2023-01-01T17:37:26.115 INFO:teuthology.orchestra.run.smithi061.stdout:(113/131): python3-numpy-1.14.3-10.el8.x86_64.r 16 MB/s | 3.7 MB 00:00 2023-01-01T17:37:26.140 INFO:teuthology.orchestra.run.smithi061.stdout:(114/131): python3-numpy-f2py-1.14.3-10.el8.x86 2.4 MB/s | 225 kB 00:00 2023-01-01T17:37:26.157 INFO:teuthology.orchestra.run.smithi061.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2023-01-01T17:37:26.182 INFO:teuthology.orchestra.run.smithi061.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 3.0 MB/s | 126 kB 00:00 2023-01-01T17:37:26.199 INFO:teuthology.orchestra.run.smithi061.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 479 kB/s | 20 kB 00:00 2023-01-01T17:37:26.224 INFO:teuthology.orchestra.run.smithi061.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.4 MB/s | 103 kB 00:00 2023-01-01T17:37:26.266 INFO:teuthology.orchestra.run.smithi061.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2023-01-01T17:37:26.308 INFO:teuthology.orchestra.run.smithi061.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-01-01T17:37:26.450 INFO:teuthology.orchestra.run.smithi061.stdout:(121/131): python3-scipy-1.0.0-21.module+el8.5. 13 MB/s | 14 MB 00:01 2023-01-01T17:37:26.493 INFO:teuthology.orchestra.run.smithi061.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-01-01T17:37:26.534 INFO:teuthology.orchestra.run.smithi061.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-01-01T17:37:26.618 INFO:teuthology.orchestra.run.smithi061.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 12 MB/s | 4.9 MB 00:00 2023-01-01T17:37:26.701 INFO:teuthology.orchestra.run.smithi061.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 12 MB/s | 4.7 MB 00:00 2023-01-01T17:37:26.745 INFO:teuthology.orchestra.run.smithi061.stdout:(126/131): postgresql-contrib-10.21-2.module+el 6.3 MB/s | 808 kB 00:00 2023-01-01T17:37:26.802 INFO:teuthology.orchestra.run.smithi061.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 15 MB/s | 1.5 MB 00:00 2023-01-01T17:37:26.886 INFO:teuthology.orchestra.run.smithi061.stdout:(128/131): postgresql-server-10.21-2.module+el8 14 MB/s | 5.1 MB 00:00 2023-01-01T17:37:26.903 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2023-01-01T17:37:26.907 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2023-01-01T17:37:26.944 INFO:teuthology.orchestra.run.smithi061.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-01-01T17:37:27.219 INFO:teuthology.orchestra.run.smithi061.stdout:(130/131): librbd1-18.0.0-1638.g2d451fdb.el8.x8 8.5 MB/s | 3.6 MB 00:00 2023-01-01T17:37:27.569 INFO:teuthology.orchestra.run.smithi061.stdout:(131/131): librados2-18.0.0-1638.g2d451fdb.el8. 4.4 MB/s | 3.6 MB 00:00 2023-01-01T17:37:27.572 INFO:teuthology.orchestra.run.smithi061.stdout:-------------------------------------------------------------------------------- 2023-01-01T17:37:27.572 INFO:teuthology.orchestra.run.smithi061.stdout:Total 16 MB/s | 205 MB 00:12 2023-01-01T17:37:28.423 INFO:teuthology.orchestra.run.smithi061.stdout:Running transaction check 2023-01-01T17:37:28.555 INFO:teuthology.orchestra.run.smithi061.stdout:Transaction check succeeded. 2023-01-01T17:37:28.555 INFO:teuthology.orchestra.run.smithi061.stdout:Running transaction test 2023-01-01T17:37:29.734 INFO:teuthology.orchestra.run.smithi061.stdout:Transaction test succeeded. 2023-01-01T17:37:29.738 INFO:teuthology.orchestra.run.smithi061.stdout:Running transaction 2023-01-01T17:37:31.909 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2023-01-01T17:37:32.084 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-01-01T17:37:32.276 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-01-01T17:37:32.469 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-01-01T17:37:32.576 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-01-01T17:37:32.779 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-01-01T17:37:33.188 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-01-01T17:37:33.419 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librados2-2:18.0.0-1638.g2d451fdb.el8.x86_64 5/134 2023-01-01T17:37:33.825 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-2:18.0.0-1638.g2d451fdb.el8.x86_64 5/134 2023-01-01T17:37:34.019 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librbd1-2:18.0.0-1638.g2d451fdb.el8.x86_64 6/134 2023-01-01T17:37:34.151 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-2:18.0.0-1638.g2d451fdb.el8.x86_64 6/134 2023-01-01T17:37:34.327 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs2-2:18.0.0-1638.g2d451fdb.el8.x86_64 7/134 2023-01-01T17:37:34.412 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephfs2-2:18.0.0-1638.g2d451fdb.el8.x86_64 7/134 2023-01-01T17:37:34.582 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rados-2:18.0.0-1638.g2d451fdb.el8.x86_64 8/134 2023-01-01T17:37:34.620 INFO:teuthology.orchestra.run.smithi061.stdout: Preparing : 1/1 2023-01-01T17:37:34.806 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-01-01T17:37:34.807 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-01-01T17:37:35.000 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-01-01T17:37:35.074 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-01-01T17:37:35.158 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-01-01T17:37:35.280 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-01-01T17:37:35.280 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-01-01T17:37:35.706 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-01-01T17:37:35.733 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-01-01T17:37:35.948 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-01-01T17:37:36.127 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephsqlite-2:18.0.0-1638.g2d451fdb.el8.x86_64 14/134 2023-01-01T17:37:36.157 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-01-01T17:37:36.236 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephsqlite-2:18.0.0-1638.g2d451fdb.el8.x86_64 14/134 2023-01-01T17:37:36.333 INFO:teuthology.orchestra.run.smithi061.stdout: Upgrading : librados2-2:18.0.0-1638.g2d451fdb.el8.x86_64 5/134 2023-01-01T17:37:36.418 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libradosstriper1-2:18.0.0-1638.g2d451fdb.el8.x86 15/134 2023-01-01T17:37:36.600 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libradosstriper1-2:18.0.0-1638.g2d451fdb.el8.x86 15/134 2023-01-01T17:37:36.742 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: librados2-2:18.0.0-1638.g2d451fdb.el8.x86_64 5/134 2023-01-01T17:37:36.789 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-01-01T17:37:36.950 INFO:teuthology.orchestra.run.smithi061.stdout: Upgrading : librbd1-2:18.0.0-1638.g2d451fdb.el8.x86_64 6/134 2023-01-01T17:37:37.064 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: librbd1-2:18.0.0-1638.g2d451fdb.el8.x86_64 6/134 2023-01-01T17:37:37.066 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-01-01T17:37:37.255 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-01-01T17:37:37.266 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : libcephfs2-2:18.0.0-1638.g2d451fdb.el8.x86_64 7/134 2023-01-01T17:37:37.351 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: libcephfs2-2:18.0.0-1638.g2d451fdb.el8.x86_64 7/134 2023-01-01T17:37:37.426 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-01-01T17:37:37.531 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-rados-2:18.0.0-1638.g2d451fdb.el8.x86_64 8/134 2023-01-01T17:37:37.561 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-01-01T17:37:37.702 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-01-01T17:37:37.709 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-01-01T17:37:37.933 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-01-01T17:37:38.128 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-01-01T17:37:38.335 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-01-01T17:37:38.520 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-01-01T17:37:38.527 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-01-01T17:37:38.746 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-01-01T17:37:38.924 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : libcephsqlite-2:18.0.0-1638.g2d451fdb.el8.x86_64 14/134 2023-01-01T17:37:39.034 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: libcephsqlite-2:18.0.0-1638.g2d451fdb.el8.x86_64 14/134 2023-01-01T17:37:39.150 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-01-01T17:37:39.199 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : libradosstriper1-2:18.0.0-1638.g2d451fdb.el8.x86 15/134 2023-01-01T17:37:39.338 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: libradosstriper1-2:18.0.0-1638.g2d451fdb.el8.x86 15/134 2023-01-01T17:37:39.343 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-01-01T17:37:39.512 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-01-01T17:37:39.673 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-01-01T17:37:39.835 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-01-01T17:37:39.965 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-01-01T17:37:40.065 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-01-01T17:37:40.101 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-01-01T17:37:40.241 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-01-01T17:37:40.341 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-01-01T17:37:40.532 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-01-01T17:37:40.786 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-01-01T17:37:40.886 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-01-01T17:37:40.966 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-common-2:18.0.0-1638.g2d451fdb.el8. 26/134 2023-01-01T17:37:41.095 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-argparse-2:18.0.0-1638.g2d451fdb.el 27/134 2023-01-01T17:37:41.324 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-01-01T17:37:41.348 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cephfs-2:18.0.0-1638.g2d451fdb.el8.x86_6 28/134 2023-01-01T17:37:41.559 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-01-01T17:37:41.963 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-01-01T17:37:42.140 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-01-01T17:37:42.906 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-01-01T17:37:43.158 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-01-01T17:37:43.351 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-01-01T17:37:43.381 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-01-01T17:37:43.569 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-01-01T17:37:43.722 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-ceph-common-2:18.0.0-1638.g2d451fdb.el8. 26/134 2023-01-01T17:37:43.868 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-ceph-argparse-2:18.0.0-1638.g2d451fdb.el 27/134 2023-01-01T17:37:44.116 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-cephfs-2:18.0.0-1638.g2d451fdb.el8.x86_6 28/134 2023-01-01T17:37:44.307 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-01-01T17:37:44.390 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-01-01T17:37:44.699 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-01-01T17:37:44.995 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-01-01T17:37:45.210 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-01-01T17:37:45.396 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-01-01T17:37:45.595 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-01-01T17:37:45.833 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rbd-2:18.0.0-1638.g2d451fdb.el8.x86_64 36/134 2023-01-01T17:37:46.007 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librados-devel-2:18.0.0-1638.g2d451fdb.el8.x86_6 37/134 2023-01-01T17:37:46.157 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-01-01T17:37:46.216 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-01-01T17:37:46.316 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-01-01T17:37:46.533 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-01-01T17:37:46.603 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-01-01T17:37:46.812 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-01-01T17:37:47.029 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-01-01T17:37:47.184 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-01-01T17:37:47.265 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-01-01T17:37:47.268 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-01-01T17:37:47.505 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-01-01T17:37:47.579 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-01-01T17:37:47.679 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-01-01T17:37:47.846 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-01-01T17:37:48.038 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-01-01T17:37:48.209 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-01-01T17:37:48.237 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-01-01T17:37:48.393 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-01-01T17:37:48.436 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-01-01T17:37:48.601 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-01-01T17:37:48.604 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-rbd-2:18.0.0-1638.g2d451fdb.el8.x86_64 36/134 2023-01-01T17:37:48.763 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : librados-devel-2:18.0.0-1638.g2d451fdb.el8.x86_6 37/134 2023-01-01T17:37:48.776 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 49/134 2023-01-01T17:37:48.897 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-01-01T17:37:48.945 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 50/134 2023-01-01T17:37:49.033 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-01-01T17:37:49.161 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 51/134 2023-01-01T17:37:49.314 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-01-01T17:37:49.369 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-01-01T17:37:49.466 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 52/134 2023-01-01T17:37:49.597 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-01-01T17:37:49.706 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 53/134 2023-01-01T17:37:49.829 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-01-01T17:37:49.937 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 54/134 2023-01-01T17:37:49.989 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-01-01T17:37:50.072 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-01-01T17:37:50.146 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 55/134 2023-01-01T17:37:50.324 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-01-01T17:37:50.486 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-01-01T17:37:50.523 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 56/134 2023-01-01T17:37:50.645 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-01-01T17:37:50.826 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-01-01T17:37:50.827 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 57/134 2023-01-01T17:37:51.029 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-01-01T17:37:51.044 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 58/134 2023-01-01T17:37:51.190 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 49/134 2023-01-01T17:37:51.288 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 59/134 2023-01-01T17:37:51.353 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 50/134 2023-01-01T17:37:51.528 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 51/134 2023-01-01T17:37:51.579 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 60/134 2023-01-01T17:37:51.856 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 52/134 2023-01-01T17:37:51.909 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 61/134 2023-01-01T17:37:52.137 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 53/134 2023-01-01T17:37:52.141 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 62/134 2023-01-01T17:37:52.323 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/134 2023-01-01T17:37:52.445 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 54/134 2023-01-01T17:37:52.536 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 64/134 2023-01-01T17:37:52.644 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 55/134 2023-01-01T17:37:52.727 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 65/134 2023-01-01T17:37:52.993 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-01-01T17:37:52.993 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 56/134 2023-01-01T17:37:53.134 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-01-01T17:37:53.276 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 57/134 2023-01-01T17:37:53.344 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-01-01T17:37:53.468 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 58/134 2023-01-01T17:37:53.596 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-01-01T17:37:53.733 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 59/134 2023-01-01T17:37:53.806 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 70/134 2023-01-01T17:37:53.970 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-01-01T17:37:53.988 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 60/134 2023-01-01T17:37:54.159 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-01-01T17:37:54.308 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 61/134 2023-01-01T17:37:54.356 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-01-01T17:37:54.522 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 62/134 2023-01-01T17:37:54.560 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-01-01T17:37:54.699 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/134 2023-01-01T17:37:54.759 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-01-01T17:37:54.891 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 64/134 2023-01-01T17:37:54.918 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-01-01T17:37:55.076 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 65/134 2023-01-01T17:37:55.079 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-01-01T17:37:55.298 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-01-01T17:37:55.308 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-01-01T17:37:55.456 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-01-01T17:37:55.501 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-01-01T17:37:55.614 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-01-01T17:37:55.696 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-01-01T17:37:55.866 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-01-01T17:37:55.967 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-01-01T17:37:56.074 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 70/134 2023-01-01T17:37:56.206 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-01-01T17:37:56.210 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-01-01T17:37:56.351 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-01-01T17:37:56.362 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-01-01T17:37:56.573 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-01-01T17:37:56.573 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-01-01T17:37:56.745 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-01-01T17:37:56.911 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-01-01T17:37:57.067 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-01-01T17:37:57.213 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-01-01T17:37:57.433 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-01-01T17:37:57.627 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-01-01T17:37:57.659 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-01-01T17:37:57.803 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-01-01T17:37:57.894 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-01-01T17:37:58.086 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-01-01T17:37:58.114 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-01-01T17:37:58.296 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-01-01T17:37:58.398 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-01-01T17:37:58.455 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-01-01T17:37:58.652 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-01-01T17:37:58.717 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-01-01T17:37:58.931 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-01-01T17:37:59.688 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-01-01T17:37:59.795 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-01-01T17:37:59.856 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librgw2-2:18.0.0-1638.g2d451fdb.el8.x86_64 92/134 2023-01-01T17:37:59.929 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librgw2-2:18.0.0-1638.g2d451fdb.el8.x86_64 92/134 2023-01-01T17:38:00.020 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-01-01T17:38:00.124 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rgw-2:18.0.0-1638.g2d451fdb.el8.x86_64 93/134 2023-01-01T17:38:00.240 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-01-01T17:38:00.540 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-01-01T17:38:00.807 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-01-01T17:38:00.977 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-01-01T17:38:01.777 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-01-01T17:38:01.929 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : librgw2-2:18.0.0-1638.g2d451fdb.el8.x86_64 92/134 2023-01-01T17:38:02.031 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: librgw2-2:18.0.0-1638.g2d451fdb.el8.x86_64 92/134 2023-01-01T17:38:02.197 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-rgw-2:18.0.0-1638.g2d451fdb.el8.x86_64 93/134 2023-01-01T17:38:03.892 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:18.0.0-1638.g2d451fdb.el8.x86_64 94/134 2023-01-01T17:38:04.231 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-common-2:18.0.0-1638.g2d451fdb.el8.x86_64 94/134 2023-01-01T17:38:04.798 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:18.0.0-1638.g2d451fdb.el8.x86_64 94/134 2023-01-01T17:38:05.106 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-base-2:18.0.0-1638.g2d451fdb.el8.x86_64 95/134 2023-01-01T17:38:05.198 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-base-2:18.0.0-1638.g2d451fdb.el8.x86_64 95/134 2023-01-01T17:38:05.347 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-selinux-2:18.0.0-1638.g2d451fdb.el8.x86_64 96/134 2023-01-01T17:38:06.153 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: ceph-common-2:18.0.0-1638.g2d451fdb.el8.x86_64 94/134 2023-01-01T17:38:06.338 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-common-2:18.0.0-1638.g2d451fdb.el8.x86_64 94/134 2023-01-01T17:38:06.941 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: ceph-common-2:18.0.0-1638.g2d451fdb.el8.x86_64 94/134 2023-01-01T17:38:07.658 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-base-2:18.0.0-1638.g2d451fdb.el8.x86_64 95/134 2023-01-01T17:38:07.752 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: ceph-base-2:18.0.0-1638.g2d451fdb.el8.x86_64 95/134 2023-01-01T17:38:07.912 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-selinux-2:18.0.0-1638.g2d451fdb.el8.x86_64 96/134 2023-01-01T17:38:24.375 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-selinux-2:18.0.0-1638.g2d451fdb.el8.x86_64 96/134 2023-01-01T17:38:24.375 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /sys 2023-01-01T17:38:24.375 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /proc 2023-01-01T17:38:24.375 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /dev 2023-01-01T17:38:24.376 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /run 2023-01-01T17:38:24.376 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /mnt 2023-01-01T17:38:24.376 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /var/tmp 2023-01-01T17:38:24.376 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /home 2023-01-01T17:38:24.376 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /tmp 2023-01-01T17:38:24.376 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /dev 2023-01-01T17:38:24.376 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-01T17:38:24.720 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-volume-2:18.0.0-1638.g2d451fdb.el8.noarch 97/134 2023-01-01T17:38:26.210 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-volume-2:18.0.0-1638.g2d451fdb.el8.noarch 97/134 2023-01-01T17:38:26.378 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-osd-2:18.0.0-1638.g2d451fdb.el8.x86_64 98/134 2023-01-01T17:38:26.595 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-osd-2:18.0.0-1638.g2d451fdb.el8.x86_64 98/134 2023-01-01T17:38:26.728 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mds-2:18.0.0-1638.g2d451fdb.el8.x86_64 99/134 2023-01-01T17:38:27.109 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mds-2:18.0.0-1638.g2d451fdb.el8.x86_64 99/134 2023-01-01T17:38:27.276 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: ceph-selinux-2:18.0.0-1638.g2d451fdb.el8.x86_64 96/134 2023-01-01T17:38:27.276 INFO:teuthology.orchestra.run.smithi061.stdout:skipping the directory /sys 2023-01-01T17:38:27.276 INFO:teuthology.orchestra.run.smithi061.stdout:skipping the directory /proc 2023-01-01T17:38:27.276 INFO:teuthology.orchestra.run.smithi061.stdout:skipping the directory /dev 2023-01-01T17:38:27.276 INFO:teuthology.orchestra.run.smithi061.stdout:skipping the directory /run 2023-01-01T17:38:27.276 INFO:teuthology.orchestra.run.smithi061.stdout:skipping the directory /mnt 2023-01-01T17:38:27.276 INFO:teuthology.orchestra.run.smithi061.stdout:skipping the directory /var/tmp 2023-01-01T17:38:27.276 INFO:teuthology.orchestra.run.smithi061.stdout:skipping the directory /home 2023-01-01T17:38:27.277 INFO:teuthology.orchestra.run.smithi061.stdout:skipping the directory /tmp 2023-01-01T17:38:27.277 INFO:teuthology.orchestra.run.smithi061.stdout:skipping the directory /dev 2023-01-01T17:38:27.277 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:38:27.277 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mon-2:18.0.0-1638.g2d451fdb.el8.x86_64 100/134 2023-01-01T17:38:27.295 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mon-2:18.0.0-1638.g2d451fdb.el8.x86_64 100/134 2023-01-01T17:38:27.618 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-volume-2:18.0.0-1638.g2d451fdb.el8.noarch 97/134 2023-01-01T17:38:28.845 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: cephadm-2:18.0.0-1638.g2d451fdb.el8.noarch 101/134 2023-01-01T17:38:29.038 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephadm-2:18.0.0-1638.g2d451fdb.el8.noarch 101/134 2023-01-01T17:38:29.167 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-1638.g2d451fdb.e 102/134 2023-01-01T17:38:29.209 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: ceph-volume-2:18.0.0-1638.g2d451fdb.el8.noarch 97/134 2023-01-01T17:38:29.371 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-osd-2:18.0.0-1638.g2d451fdb.el8.x86_64 98/134 2023-01-01T17:38:29.373 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-1638.g2d451fdb. 103/134 2023-01-01T17:38:29.585 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-1638.g2d451fdb.el8.noa 104/134 2023-01-01T17:38:29.601 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: ceph-osd-2:18.0.0-1638.g2d451fdb.el8.x86_64 98/134 2023-01-01T17:38:29.760 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-mds-2:18.0.0-1638.g2d451fdb.el8.x86_64 99/134 2023-01-01T17:38:29.796 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-1638.g2d451fdb.el8.noa 104/134 2023-01-01T17:38:30.043 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-1638.g2d451fdb.el8.n 105/134 2023-01-01T17:38:30.170 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: ceph-mds-2:18.0.0-1638.g2d451fdb.el8.x86_64 99/134 2023-01-01T17:38:30.343 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-mon-2:18.0.0-1638.g2d451fdb.el8.x86_64 100/134 2023-01-01T17:38:30.361 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: ceph-mon-2:18.0.0-1638.g2d451fdb.el8.x86_64 100/134 2023-01-01T17:38:31.010 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-1638.g2d451fdb.el8.n 105/134 2023-01-01T17:38:31.160 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-1638.g2d4 106/134 2023-01-01T17:38:31.250 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-1638.g2d4 106/134 2023-01-01T17:38:31.619 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-1638.g2d451fdb.el 107/134 2023-01-01T17:38:31.844 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-2:18.0.0-1638.g2d451fdb.el8.x86_64 108/134 2023-01-01T17:38:31.879 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-2:18.0.0-1638.g2d451fdb.el8.x86_64 108/134 2023-01-01T17:38:32.051 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-rook-2:18.0.0-1638.g2d451fdb.el8.noarch 109/134 2023-01-01T17:38:32.052 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: cephadm-2:18.0.0-1638.g2d451fdb.el8.noarch 101/134 2023-01-01T17:38:32.063 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-1638.g2d451fdb.el8.noarch 109/134 2023-01-01T17:38:32.257 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : cephadm-2:18.0.0-1638.g2d451fdb.el8.noarch 101/134 2023-01-01T17:38:32.382 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-1638.g2d451fdb.e 102/134 2023-01-01T17:38:32.566 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-1638.g2d451fdb. 103/134 2023-01-01T17:38:32.742 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-1638.g2d451fdb.el8.noa 104/134 2023-01-01T17:38:32.959 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-1638.g2d451fdb.el8.noa 104/134 2023-01-01T17:38:33.230 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-1638.g2d451fdb.el8.n 105/134 2023-01-01T17:38:33.305 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-2:18.0.0-1638.g2d451fdb.el8.x86_64 110/134 2023-01-01T17:38:33.551 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-radosgw-2:18.0.0-1638.g2d451fdb.el8.x86_64 111/134 2023-01-01T17:38:33.595 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-1638.g2d451fdb.el8.x86_64 111/134 2023-01-01T17:38:33.760 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-1638.g2d451 112/134 2023-01-01T17:38:33.801 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-1638.g2d451 112/134 2023-01-01T17:38:33.935 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephfs-mirror-2:18.0.0-1638.g2d451fdb.el8.x86_64 113/134 2023-01-01T17:38:34.255 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-1638.g2d451fdb.el8.n 105/134 2023-01-01T17:38:34.280 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-1638.g2d451fdb.el8.x86_64 113/134 2023-01-01T17:38:34.400 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-1638.g2d4 106/134 2023-01-01T17:38:34.452 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-mirror-2:18.0.0-1638.g2d451fdb.el8.x86_64 114/134 2023-01-01T17:38:34.495 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-1638.g2d4 106/134 2023-01-01T17:38:34.860 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-1638.g2d451fdb.el 107/134 2023-01-01T17:38:35.029 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-mgr-2:18.0.0-1638.g2d451fdb.el8.x86_64 108/134 2023-01-01T17:38:35.066 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: ceph-mgr-2:18.0.0-1638.g2d451fdb.el8.x86_64 108/134 2023-01-01T17:38:35.242 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-mgr-rook-2:18.0.0-1638.g2d451fdb.el8.noarch 109/134 2023-01-01T17:38:35.254 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-1638.g2d451fdb.el8.noarch 109/134 2023-01-01T17:38:36.597 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-2:18.0.0-1638.g2d451fdb.el8.x86_64 110/134 2023-01-01T17:38:36.809 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-radosgw-2:18.0.0-1638.g2d451fdb.el8.x86_64 111/134 2023-01-01T17:38:36.844 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-1638.g2d451fdb.el8.x86_64 111/134 2023-01-01T17:38:36.983 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-1638.g2d451 112/134 2023-01-01T17:38:37.027 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-1638.g2d451 112/134 2023-01-01T17:38:37.142 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : cephfs-mirror-2:18.0.0-1638.g2d451fdb.el8.x86_64 113/134 2023-01-01T17:38:37.510 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-1638.g2d451fdb.el8.x86_64 113/134 2023-01-01T17:38:37.677 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : rbd-mirror-2:18.0.0-1638.g2d451fdb.el8.x86_64 114/134 2023-01-01T17:38:39.047 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: rbd-mirror-2:18.0.0-1638.g2d451fdb.el8.x86_64 114/134 2023-01-01T17:38:39.913 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-test-2:18.0.0-1638.g2d451fdb.el8.x86_64 115/134 2023-01-01T17:38:40.240 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-01-01T17:38:40.436 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-fuse-2:18.0.0-1638.g2d451fdb.el8.x86_64 117/134 2023-01-01T17:38:40.684 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-01-01T17:38:40.833 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-01-01T17:38:41.023 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-01-01T17:38:41.279 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-01-01T17:38:41.454 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs-devel-2:18.0.0-1638.g2d451fdb.el8.x86_ 121/134 2023-01-01T17:38:41.620 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-01-01T17:38:42.572 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: rbd-mirror-2:18.0.0-1638.g2d451fdb.el8.x86_64 114/134 2023-01-01T17:38:43.481 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-test-2:18.0.0-1638.g2d451fdb.el8.x86_64 115/134 2023-01-01T17:38:43.750 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-01-01T17:38:43.827 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-01-01T17:38:43.992 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-01-01T17:38:43.995 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : ceph-fuse-2:18.0.0-1638.g2d451fdb.el8.x86_64 117/134 2023-01-01T17:38:44.013 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-01-01T17:38:44.215 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephfs-top-2:18.0.0-1638.g2d451fdb.el8.noarch 124/134 2023-01-01T17:38:44.243 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-01-01T17:38:44.391 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-01-01T17:38:44.474 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-fuse-2:18.0.0-1638.g2d451fdb.el8.x86_64 125/134 2023-01-01T17:38:44.599 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-01-01T17:38:44.781 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-nbd-2:18.0.0-1638.g2d451fdb.el8.x86_64 126/134 2023-01-01T17:38:44.812 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-01-01T17:38:44.973 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : libcephfs-devel-2:18.0.0-1638.g2d451fdb.el8.x86_ 121/134 2023-01-01T17:38:45.100 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-01-01T17:38:45.128 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-01-01T17:38:45.349 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-01-01T17:38:45.433 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-01-01T17:38:45.649 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-01-01T17:38:45.665 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-01-01T17:38:45.808 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-01-01T17:38:45.816 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-01-01T17:38:45.918 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-01-01T17:38:45.919 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-01-01T17:38:46.144 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-01-01T17:38:46.144 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-01-01T17:38:46.364 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-01-01T17:38:46.531 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-01-01T17:38:47.048 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-01-01T17:38:47.048 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-2:18.0.0-1638.g2d451fdb.el8.x86_64 1/134 2023-01-01T17:38:47.048 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-base-2:18.0.0-1638.g2d451fdb.el8.x86_64 2/134 2023-01-01T17:38:47.048 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-common-2:18.0.0-1638.g2d451fdb.el8.x86_64 3/134 2023-01-01T17:38:47.048 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-fuse-2:18.0.0-1638.g2d451fdb.el8.x86_64 4/134 2023-01-01T17:38:47.048 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-1638.g2d451 5/134 2023-01-01T17:38:47.049 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mds-2:18.0.0-1638.g2d451fdb.el8.x86_64 6/134 2023-01-01T17:38:47.049 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-2:18.0.0-1638.g2d451fdb.el8.x86_64 7/134 2023-01-01T17:38:47.049 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mon-2:18.0.0-1638.g2d451fdb.el8.x86_64 8/134 2023-01-01T17:38:47.049 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-osd-2:18.0.0-1638.g2d451fdb.el8.x86_64 9/134 2023-01-01T17:38:47.049 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-radosgw-2:18.0.0-1638.g2d451fdb.el8.x86_64 10/134 2023-01-01T17:38:47.049 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-selinux-2:18.0.0-1638.g2d451fdb.el8.x86_64 11/134 2023-01-01T17:38:47.049 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-test-2:18.0.0-1638.g2d451fdb.el8.x86_64 12/134 2023-01-01T17:38:47.049 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephfs-mirror-2:18.0.0-1638.g2d451fdb.el8.x86_64 13/134 2023-01-01T17:38:47.049 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs-devel-2:18.0.0-1638.g2d451fdb.el8.x86_ 14/134 2023-01-01T17:38:47.049 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs2-2:18.0.0-1638.g2d451fdb.el8.x86_64 15/134 2023-01-01T17:38:47.049 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephsqlite-2:18.0.0-1638.g2d451fdb.el8.x86_64 16/134 2023-01-01T17:38:47.049 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados-devel-2:18.0.0-1638.g2d451fdb.el8.x86_6 17/134 2023-01-01T17:38:47.050 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libradosstriper1-2:18.0.0-1638.g2d451fdb.el8.x86 18/134 2023-01-01T17:38:47.050 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librgw2-2:18.0.0-1638.g2d451fdb.el8.x86_64 19/134 2023-01-01T17:38:47.050 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-argparse-2:18.0.0-1638.g2d451fdb.el 20/134 2023-01-01T17:38:47.050 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-common-2:18.0.0-1638.g2d451fdb.el8. 21/134 2023-01-01T17:38:47.050 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cephfs-2:18.0.0-1638.g2d451fdb.el8.x86_6 22/134 2023-01-01T17:38:47.050 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rados-2:18.0.0-1638.g2d451fdb.el8.x86_64 23/134 2023-01-01T17:38:47.050 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rbd-2:18.0.0-1638.g2d451fdb.el8.x86_64 24/134 2023-01-01T17:38:47.050 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rgw-2:18.0.0-1638.g2d451fdb.el8.x86_64 25/134 2023-01-01T17:38:47.050 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-fuse-2:18.0.0-1638.g2d451fdb.el8.x86_64 26/134 2023-01-01T17:38:47.050 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-mirror-2:18.0.0-1638.g2d451fdb.el8.x86_64 27/134 2023-01-01T17:38:47.050 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-nbd-2:18.0.0-1638.g2d451fdb.el8.x86_64 28/134 2023-01-01T17:38:47.050 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-1638.g2d451fdb. 29/134 2023-01-01T17:38:47.051 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-1638.g2d451fdb.el8.noa 30/134 2023-01-01T17:38:47.051 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-1638.g2d451fdb.el8.n 31/134 2023-01-01T17:38:47.051 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-1638.g2d4 32/134 2023-01-01T17:38:47.051 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-1638.g2d451fdb.el 33/134 2023-01-01T17:38:47.051 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-rook-2:18.0.0-1638.g2d451fdb.el8.noarch 34/134 2023-01-01T17:38:47.051 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-1638.g2d451fdb.e 35/134 2023-01-01T17:38:47.051 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-volume-2:18.0.0-1638.g2d451fdb.el8.noarch 36/134 2023-01-01T17:38:47.051 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephadm-2:18.0.0-1638.g2d451fdb.el8.noarch 37/134 2023-01-01T17:38:47.051 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephfs-top-2:18.0.0-1638.g2d451fdb.el8.noarch 38/134 2023-01-01T17:38:47.051 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-01-01T17:38:47.052 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-01-01T17:38:47.052 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-01-01T17:38:47.052 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-01-01T17:38:47.052 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-01-01T17:38:47.052 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-01-01T17:38:47.052 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-01-01T17:38:47.052 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-01-01T17:38:47.052 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-01-01T17:38:47.052 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-01-01T17:38:47.052 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-01-01T17:38:47.052 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-01-01T17:38:47.053 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-01-01T17:38:47.053 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-01-01T17:38:47.053 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-01-01T17:38:47.053 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-01-01T17:38:47.053 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-01-01T17:38:47.053 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-01-01T17:38:47.053 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-01-01T17:38:47.053 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-01-01T17:38:47.053 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-01-01T17:38:47.053 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-01-01T17:38:47.053 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-01-01T17:38:47.053 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-01-01T17:38:47.054 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-01-01T17:38:47.054 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-01-01T17:38:47.054 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/134 2023-01-01T17:38:47.054 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-01-01T17:38:47.054 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-01-01T17:38:47.054 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-01-01T17:38:47.054 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-01-01T17:38:47.054 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-01-01T17:38:47.054 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-01-01T17:38:47.054 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 72/134 2023-01-01T17:38:47.054 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 73/134 2023-01-01T17:38:47.055 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 74/134 2023-01-01T17:38:47.055 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/134 2023-01-01T17:38:47.055 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/134 2023-01-01T17:38:47.055 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 77/134 2023-01-01T17:38:47.055 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 78/134 2023-01-01T17:38:47.055 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 79/134 2023-01-01T17:38:47.055 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 80/134 2023-01-01T17:38:47.055 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/134 2023-01-01T17:38:47.055 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 82/134 2023-01-01T17:38:47.055 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 83/134 2023-01-01T17:38:47.055 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 84/134 2023-01-01T17:38:47.056 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 85/134 2023-01-01T17:38:47.056 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 86/134 2023-01-01T17:38:47.056 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 87/134 2023-01-01T17:38:47.056 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 88/134 2023-01-01T17:38:47.056 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-01-01T17:38:47.056 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-01-01T17:38:47.056 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-01-01T17:38:47.056 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-01-01T17:38:47.056 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 93/134 2023-01-01T17:38:47.056 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 94/134 2023-01-01T17:38:47.056 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-01-01T17:38:47.057 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-01-01T17:38:47.057 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-01-01T17:38:47.057 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-01-01T17:38:47.057 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-01-01T17:38:47.057 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-01-01T17:38:47.057 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-01-01T17:38:47.058 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-01-01T17:38:47.058 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-01-01T17:38:47.058 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-01-01T17:38:47.058 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-01-01T17:38:47.058 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-01-01T17:38:47.058 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-01-01T17:38:47.058 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-01-01T17:38:47.058 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-01-01T17:38:47.058 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-01-01T17:38:47.058 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-01-01T17:38:47.058 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-01-01T17:38:47.059 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-01-01T17:38:47.059 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-01-01T17:38:47.059 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-01-01T17:38:47.059 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-01-01T17:38:47.059 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-01-01T17:38:47.059 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-01-01T17:38:47.059 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-01-01T17:38:47.059 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-01-01T17:38:47.060 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-01-01T17:38:47.060 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-01-01T17:38:47.060 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-01-01T17:38:47.060 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-01-01T17:38:47.060 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-01-01T17:38:47.060 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-01-01T17:38:47.060 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-01-01T17:38:47.060 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-01-01T17:38:47.060 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-2:18.0.0-1638.g2d451fdb.el8.x86_64 129/134 2023-01-01T17:38:47.061 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-01-01T17:38:47.061 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-2:18.0.0-1638.g2d451fdb.el8.x86_64 131/134 2023-01-01T17:38:47.061 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-01-01T17:38:47.061 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-01-01T17:38:47.288 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-01-01T17:38:47.532 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-01-01T17:38:47.551 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-01-01T17:38:47.691 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : cephfs-top-2:18.0.0-1638.g2d451fdb.el8.noarch 124/134 2023-01-01T17:38:47.958 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : rbd-fuse-2:18.0.0-1638.g2d451fdb.el8.x86_64 125/134 2023-01-01T17:38:48.242 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : rbd-nbd-2:18.0.0-1638.g2d451fdb.el8.x86_64 126/134 2023-01-01T17:38:48.579 INFO:teuthology.orchestra.run.smithi061.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-01-01T17:38:48.756 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-01-01T17:38:48.840 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-01-01T17:38:49.048 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-01-01T17:38:49.063 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-01-01T17:38:49.198 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-01-01T17:38:49.207 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-01-01T17:38:49.335 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-01-01T17:38:49.335 INFO:teuthology.orchestra.run.smithi061.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-01-01T17:38:49.518 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-01-01T17:38:49.518 INFO:teuthology.orchestra.run.smithi061.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-01-01T17:38:49.751 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-01-01T17:38:49.751 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:48 ago on Sun 01 Jan 2023 05:37:01 PM UTC. 2023-01-01T17:38:49.754 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-01-01T17:38:49.956 INFO:teuthology.orchestra.run.smithi061.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-01-01T17:38:50.469 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-01-01T17:38:50.470 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-2:18.0.0-1638.g2d451fdb.el8.x86_64 1/134 2023-01-01T17:38:50.470 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-base-2:18.0.0-1638.g2d451fdb.el8.x86_64 2/134 2023-01-01T17:38:50.470 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-common-2:18.0.0-1638.g2d451fdb.el8.x86_64 3/134 2023-01-01T17:38:50.470 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-fuse-2:18.0.0-1638.g2d451fdb.el8.x86_64 4/134 2023-01-01T17:38:50.470 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-1638.g2d451 5/134 2023-01-01T17:38:50.470 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-mds-2:18.0.0-1638.g2d451fdb.el8.x86_64 6/134 2023-01-01T17:38:50.470 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-mgr-2:18.0.0-1638.g2d451fdb.el8.x86_64 7/134 2023-01-01T17:38:50.470 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-mon-2:18.0.0-1638.g2d451fdb.el8.x86_64 8/134 2023-01-01T17:38:50.470 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-osd-2:18.0.0-1638.g2d451fdb.el8.x86_64 9/134 2023-01-01T17:38:50.470 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-radosgw-2:18.0.0-1638.g2d451fdb.el8.x86_64 10/134 2023-01-01T17:38:50.471 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-selinux-2:18.0.0-1638.g2d451fdb.el8.x86_64 11/134 2023-01-01T17:38:50.471 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-test-2:18.0.0-1638.g2d451fdb.el8.x86_64 12/134 2023-01-01T17:38:50.471 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : cephfs-mirror-2:18.0.0-1638.g2d451fdb.el8.x86_64 13/134 2023-01-01T17:38:50.471 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libcephfs-devel-2:18.0.0-1638.g2d451fdb.el8.x86_ 14/134 2023-01-01T17:38:50.471 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libcephfs2-2:18.0.0-1638.g2d451fdb.el8.x86_64 15/134 2023-01-01T17:38:50.471 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libcephsqlite-2:18.0.0-1638.g2d451fdb.el8.x86_64 16/134 2023-01-01T17:38:50.471 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : librados-devel-2:18.0.0-1638.g2d451fdb.el8.x86_6 17/134 2023-01-01T17:38:50.472 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libradosstriper1-2:18.0.0-1638.g2d451fdb.el8.x86 18/134 2023-01-01T17:38:50.472 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : librgw2-2:18.0.0-1638.g2d451fdb.el8.x86_64 19/134 2023-01-01T17:38:50.472 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-ceph-argparse-2:18.0.0-1638.g2d451fdb.el 20/134 2023-01-01T17:38:50.472 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-ceph-common-2:18.0.0-1638.g2d451fdb.el8. 21/134 2023-01-01T17:38:50.472 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-cephfs-2:18.0.0-1638.g2d451fdb.el8.x86_6 22/134 2023-01-01T17:38:50.472 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-rados-2:18.0.0-1638.g2d451fdb.el8.x86_64 23/134 2023-01-01T17:38:50.472 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-rbd-2:18.0.0-1638.g2d451fdb.el8.x86_64 24/134 2023-01-01T17:38:50.472 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-rgw-2:18.0.0-1638.g2d451fdb.el8.x86_64 25/134 2023-01-01T17:38:50.473 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : rbd-fuse-2:18.0.0-1638.g2d451fdb.el8.x86_64 26/134 2023-01-01T17:38:50.473 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : rbd-mirror-2:18.0.0-1638.g2d451fdb.el8.x86_64 27/134 2023-01-01T17:38:50.473 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : rbd-nbd-2:18.0.0-1638.g2d451fdb.el8.x86_64 28/134 2023-01-01T17:38:50.473 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-1638.g2d451fdb. 29/134 2023-01-01T17:38:50.473 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-1638.g2d451fdb.el8.noa 30/134 2023-01-01T17:38:50.473 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-1638.g2d451fdb.el8.n 31/134 2023-01-01T17:38:50.473 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-1638.g2d4 32/134 2023-01-01T17:38:50.473 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-1638.g2d451fdb.el 33/134 2023-01-01T17:38:50.473 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-mgr-rook-2:18.0.0-1638.g2d451fdb.el8.noarch 34/134 2023-01-01T17:38:50.473 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-1638.g2d451fdb.e 35/134 2023-01-01T17:38:50.473 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : ceph-volume-2:18.0.0-1638.g2d451fdb.el8.noarch 36/134 2023-01-01T17:38:50.473 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : cephadm-2:18.0.0-1638.g2d451fdb.el8.noarch 37/134 2023-01-01T17:38:50.474 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : cephfs-top-2:18.0.0-1638.g2d451fdb.el8.noarch 38/134 2023-01-01T17:38:50.474 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-01-01T17:38:50.474 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-01-01T17:38:50.474 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-01-01T17:38:50.474 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-01-01T17:38:50.474 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-01-01T17:38:50.474 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-01-01T17:38:50.474 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-01-01T17:38:50.474 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-01-01T17:38:50.474 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-01-01T17:38:50.474 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-01-01T17:38:50.475 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-01-01T17:38:50.475 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-01-01T17:38:50.475 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-01-01T17:38:50.475 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-01-01T17:38:50.475 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-01-01T17:38:50.475 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-01-01T17:38:50.475 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-01-01T17:38:50.475 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-01-01T17:38:50.475 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-01-01T17:38:50.475 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-01-01T17:38:50.475 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-01-01T17:38:50.475 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-01-01T17:38:50.476 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-01-01T17:38:50.476 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-01-01T17:38:50.476 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-01-01T17:38:50.476 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-01-01T17:38:50.476 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/134 2023-01-01T17:38:50.476 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-01-01T17:38:50.476 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-01-01T17:38:50.476 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-01-01T17:38:50.476 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-01-01T17:38:50.476 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-01-01T17:38:50.476 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-01-01T17:38:50.476 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 72/134 2023-01-01T17:38:50.477 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 73/134 2023-01-01T17:38:50.477 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 74/134 2023-01-01T17:38:50.477 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/134 2023-01-01T17:38:50.477 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/134 2023-01-01T17:38:50.477 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 77/134 2023-01-01T17:38:50.477 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 78/134 2023-01-01T17:38:50.477 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 79/134 2023-01-01T17:38:50.477 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 80/134 2023-01-01T17:38:50.477 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/134 2023-01-01T17:38:50.477 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 82/134 2023-01-01T17:38:50.477 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 83/134 2023-01-01T17:38:50.478 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 84/134 2023-01-01T17:38:50.478 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 85/134 2023-01-01T17:38:50.478 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 86/134 2023-01-01T17:38:50.478 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 87/134 2023-01-01T17:38:50.478 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 88/134 2023-01-01T17:38:50.478 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-01-01T17:38:50.478 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-01-01T17:38:50.478 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-01-01T17:38:50.478 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-01-01T17:38:50.478 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 93/134 2023-01-01T17:38:50.478 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 94/134 2023-01-01T17:38:50.478 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-01-01T17:38:50.478 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-01-01T17:38:50.479 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-01-01T17:38:50.479 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-01-01T17:38:50.479 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-01-01T17:38:50.479 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-01-01T17:38:50.479 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-01-01T17:38:50.479 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-01-01T17:38:50.479 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-01-01T17:38:50.479 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-01-01T17:38:50.479 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-01-01T17:38:50.479 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-01-01T17:38:50.479 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-01-01T17:38:50.480 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-01-01T17:38:50.480 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-01-01T17:38:50.480 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-01-01T17:38:50.480 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-01-01T17:38:50.480 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-01-01T17:38:50.480 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-01-01T17:38:50.480 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-01-01T17:38:50.480 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-01-01T17:38:50.480 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-01-01T17:38:50.481 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-01-01T17:38:50.481 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-01-01T17:38:50.481 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-01-01T17:38:50.481 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-01-01T17:38:50.481 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-01-01T17:38:50.481 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-01-01T17:38:50.481 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-01-01T17:38:50.481 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-01-01T17:38:50.481 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-01-01T17:38:50.481 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-01-01T17:38:50.482 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-01-01T17:38:50.482 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-01-01T17:38:50.482 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : librados2-2:18.0.0-1638.g2d451fdb.el8.x86_64 129/134 2023-01-01T17:38:50.482 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-01-01T17:38:50.482 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : librbd1-2:18.0.0-1638.g2d451fdb.el8.x86_64 131/134 2023-01-01T17:38:50.482 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-01-01T17:38:50.482 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-01-01T17:38:52.517 INFO:teuthology.orchestra.run.smithi149.stdout:Installed products updated. 2023-01-01T17:38:52.738 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-01T17:38:52.738 INFO:teuthology.orchestra.run.smithi149.stdout:Upgraded: 2023-01-01T17:38:52.738 INFO:teuthology.orchestra.run.smithi149.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-01-01T17:38:52.738 INFO:teuthology.orchestra.run.smithi149.stdout: librados2-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:52.739 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:52.739 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2023-01-01T17:38:52.739 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-01-01T17:38:52.739 INFO:teuthology.orchestra.run.smithi149.stdout: automake-1.16.1-7.el8.noarch 2023-01-01T17:38:52.739 INFO:teuthology.orchestra.run.smithi149.stdout: bison-3.0.4-10.el8.x86_64 2023-01-01T17:38:52.739 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:52.739 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:52.739 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:52.739 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:52.739 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards-2:18.0.0-1638.g2d451fdb.el8.noarch 2023-01-01T17:38:52.739 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:52.740 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:52.740 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:52.740 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm-2:18.0.0-1638.g2d451fdb.el8.noarch 2023-01-01T17:38:52.740 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard-2:18.0.0-1638.g2d451fdb.el8.noarch 2023-01-01T17:38:52.740 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local-2:18.0.0-1638.g2d451fdb.el8.noarch 2023-01-01T17:38:52.740 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core-2:18.0.0-1638.g2d451fdb.el8.noarch 2023-01-01T17:38:52.740 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook-2:18.0.0-1638.g2d451fdb.el8.noarch 2023-01-01T17:38:52.740 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:52.740 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:52.740 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts-2:18.0.0-1638.g2d451fdb.el8.noarch 2023-01-01T17:38:52.740 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:52.741 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:52.741 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:52.741 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-volume-2:18.0.0-1638.g2d451fdb.el8.noarch 2023-01-01T17:38:52.741 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm-2:18.0.0-1638.g2d451fdb.el8.noarch 2023-01-01T17:38:52.741 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-mirror-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:52.741 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-top-2:18.0.0-1638.g2d451fdb.el8.noarch 2023-01-01T17:38:52.741 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-01-01T17:38:52.741 INFO:teuthology.orchestra.run.smithi149.stdout: flex-2.6.1-9.el8.x86_64 2023-01-01T17:38:52.741 INFO:teuthology.orchestra.run.smithi149.stdout: fuse-2.9.7-15.el8.x86_64 2023-01-01T17:38:52.741 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-01-01T17:38:52.742 INFO:teuthology.orchestra.run.smithi149.stdout: jq-1.6-3.el8.x86_64 2023-01-01T17:38:52.742 INFO:teuthology.orchestra.run.smithi149.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-01-01T17:38:52.742 INFO:teuthology.orchestra.run.smithi149.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-01-01T17:38:52.742 INFO:teuthology.orchestra.run.smithi149.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-01-01T17:38:52.742 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:52.742 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:52.742 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:52.742 INFO:teuthology.orchestra.run.smithi149.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-01-01T17:38:52.742 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-01-01T17:38:52.742 INFO:teuthology.orchestra.run.smithi149.stdout: liboath-2.6.2-3.el8.x86_64 2023-01-01T17:38:52.742 INFO:teuthology.orchestra.run.smithi149.stdout: libpq-13.5-1.el8.x86_64 2023-01-01T17:38:52.743 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-01-01T17:38:52.743 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-01-01T17:38:52.743 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:52.743 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:52.743 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-01-01T17:38:52.743 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:52.743 INFO:teuthology.orchestra.run.smithi149.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-01-01T17:38:52.743 INFO:teuthology.orchestra.run.smithi149.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-01-01T17:38:52.743 INFO:teuthology.orchestra.run.smithi149.stdout: libtool-2.4.6-25.el8.x86_64 2023-01-01T17:38:52.743 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind-1.3.1-3.el8.x86_64 2023-01-01T17:38:52.743 INFO:teuthology.orchestra.run.smithi149.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-01-01T17:38:52.744 INFO:teuthology.orchestra.run.smithi149.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-01-01T17:38:52.744 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-01-01T17:38:52.744 INFO:teuthology.orchestra.run.smithi149.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-01-01T17:38:52.744 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-0.3.15-3.el8.x86_64 2023-01-01T17:38:52.744 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-01-01T17:38:52.744 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-01-01T17:38:52.744 INFO:teuthology.orchestra.run.smithi149.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-01-01T17:38:52.744 INFO:teuthology.orchestra.run.smithi149.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-01-01T17:38:52.744 INFO:teuthology.orchestra.run.smithi149.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-01-01T17:38:52.744 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-01-01T17:38:52.744 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-01-01T17:38:52.745 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-01-01T17:38:52.745 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-01-01T17:38:52.745 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel-2.5.1-7.el8.noarch 2023-01-01T17:38:52.745 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-01-01T17:38:52.745 INFO:teuthology.orchestra.run.smithi149.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-01-01T17:38:52.745 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-01-01T17:38:52.745 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:52.745 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:52.745 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:52.745 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-01-01T17:38:52.746 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-01-01T17:38:52.746 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-01-01T17:38:52.746 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-01-01T17:38:52.746 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-01-01T17:38:52.746 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-01-01T17:38:52.746 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-6.2-6.el8.noarch 2023-01-01T17:38:52.746 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-01-01T17:38:52.746 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-01-01T17:38:52.746 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-01-01T17:38:52.746 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-01-01T17:38:52.746 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-01-01T17:38:52.746 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-01-01T17:38:52.747 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-01-01T17:38:52.747 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako-1.0.6-13.el8.noarch 2023-01-01T17:38:52.747 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-01-01T17:38:52.747 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-01-01T17:38:52.747 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-01-01T17:38:52.747 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-01-01T17:38:52.747 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-01-01T17:38:52.747 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-01-01T17:38:52.747 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-01-01T17:38:52.748 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend-2.6-1.el8.noarch 2023-01-01T17:38:52.748 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-01-01T17:38:52.748 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-01-01T17:38:52.748 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-01-01T17:38:52.748 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-01-01T17:38:52.748 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser-2.14-14.el8.noarch 2023-01-01T17:38:52.748 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz-2017.2-9.el8.noarch 2023-01-01T17:38:52.748 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:52.748 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:52.748 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-01-01T17:38:52.749 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-01-01T17:38:52.749 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:52.749 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes-2.4.1-12.el8.noarch 2023-01-01T17:38:52.749 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa-4.8-1.el8.noarch 2023-01-01T17:38:52.749 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-01-01T17:38:52.749 INFO:teuthology.orchestra.run.smithi149.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-01-01T17:38:52.749 INFO:teuthology.orchestra.run.smithi149.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-01-01T17:38:52.749 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-01-01T17:38:52.749 INFO:teuthology.orchestra.run.smithi149.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-01-01T17:38:52.749 INFO:teuthology.orchestra.run.smithi149.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-01-01T17:38:52.749 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-01-01T17:38:52.750 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-01-01T17:38:52.750 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-01-01T17:38:52.750 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-01-01T17:38:52.750 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-01-01T17:38:52.750 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:52.750 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:52.750 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:52.750 INFO:teuthology.orchestra.run.smithi149.stdout: socat-1.7.4.1-1.el8.x86_64 2023-01-01T17:38:52.750 INFO:teuthology.orchestra.run.smithi149.stdout: thrift-0.13.0-2.el8.x86_64 2023-01-01T17:38:52.750 INFO:teuthology.orchestra.run.smithi149.stdout: uuid-1.6.2-43.el8.x86_64 2023-01-01T17:38:52.750 INFO:teuthology.orchestra.run.smithi149.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-01-01T17:38:52.751 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-01-01T17:38:52.751 INFO:teuthology.orchestra.run.smithi149.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-01-01T17:38:52.751 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-01T17:38:52.751 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2023-01-01T17:38:52.958 DEBUG:teuthology.parallel:result is None 2023-01-01T17:38:53.055 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-01-01T17:38:53.055 INFO:teuthology.orchestra.run.smithi061.stdout:Last metadata expiration check: 0:01:51 ago on Sun 01 Jan 2023 05:37:02 PM UTC. 2023-01-01T17:38:56.286 INFO:teuthology.orchestra.run.smithi061.stdout:Installed products updated. 2023-01-01T17:38:56.527 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:38:56.527 INFO:teuthology.orchestra.run.smithi061.stdout:Upgraded: 2023-01-01T17:38:56.527 INFO:teuthology.orchestra.run.smithi061.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-01-01T17:38:56.528 INFO:teuthology.orchestra.run.smithi061.stdout: librados2-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:56.528 INFO:teuthology.orchestra.run.smithi061.stdout: librbd1-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:56.528 INFO:teuthology.orchestra.run.smithi061.stdout:Installed: 2023-01-01T17:38:56.528 INFO:teuthology.orchestra.run.smithi061.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-01-01T17:38:56.528 INFO:teuthology.orchestra.run.smithi061.stdout: automake-1.16.1-7.el8.noarch 2023-01-01T17:38:56.528 INFO:teuthology.orchestra.run.smithi061.stdout: bison-3.0.4-10.el8.x86_64 2023-01-01T17:38:56.528 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:56.528 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-base-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:56.528 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-common-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:56.528 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-fuse-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:56.528 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-grafana-dashboards-2:18.0.0-1638.g2d451fdb.el8.noarch 2023-01-01T17:38:56.529 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-immutable-object-cache-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:56.529 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-mds-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:56.529 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-mgr-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:56.529 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-mgr-cephadm-2:18.0.0-1638.g2d451fdb.el8.noarch 2023-01-01T17:38:56.529 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-mgr-dashboard-2:18.0.0-1638.g2d451fdb.el8.noarch 2023-01-01T17:38:56.529 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-mgr-diskprediction-local-2:18.0.0-1638.g2d451fdb.el8.noarch 2023-01-01T17:38:56.529 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-mgr-modules-core-2:18.0.0-1638.g2d451fdb.el8.noarch 2023-01-01T17:38:56.529 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-mgr-rook-2:18.0.0-1638.g2d451fdb.el8.noarch 2023-01-01T17:38:56.529 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-mon-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:56.529 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-osd-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:56.529 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-prometheus-alerts-2:18.0.0-1638.g2d451fdb.el8.noarch 2023-01-01T17:38:56.529 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-radosgw-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:56.530 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-selinux-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:56.530 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-test-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:56.530 INFO:teuthology.orchestra.run.smithi061.stdout: ceph-volume-2:18.0.0-1638.g2d451fdb.el8.noarch 2023-01-01T17:38:56.530 INFO:teuthology.orchestra.run.smithi061.stdout: cephadm-2:18.0.0-1638.g2d451fdb.el8.noarch 2023-01-01T17:38:56.530 INFO:teuthology.orchestra.run.smithi061.stdout: cephfs-mirror-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:56.530 INFO:teuthology.orchestra.run.smithi061.stdout: cephfs-top-2:18.0.0-1638.g2d451fdb.el8.noarch 2023-01-01T17:38:56.530 INFO:teuthology.orchestra.run.smithi061.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-01-01T17:38:56.530 INFO:teuthology.orchestra.run.smithi061.stdout: flex-2.6.1-9.el8.x86_64 2023-01-01T17:38:56.530 INFO:teuthology.orchestra.run.smithi061.stdout: fuse-2.9.7-15.el8.x86_64 2023-01-01T17:38:56.530 INFO:teuthology.orchestra.run.smithi061.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-01-01T17:38:56.530 INFO:teuthology.orchestra.run.smithi061.stdout: jq-1.6-3.el8.x86_64 2023-01-01T17:38:56.531 INFO:teuthology.orchestra.run.smithi061.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-01-01T17:38:56.531 INFO:teuthology.orchestra.run.smithi061.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-01-01T17:38:56.531 INFO:teuthology.orchestra.run.smithi061.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-01-01T17:38:56.531 INFO:teuthology.orchestra.run.smithi061.stdout: libcephfs-devel-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:56.531 INFO:teuthology.orchestra.run.smithi061.stdout: libcephfs2-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:56.531 INFO:teuthology.orchestra.run.smithi061.stdout: libcephsqlite-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:56.531 INFO:teuthology.orchestra.run.smithi061.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-01-01T17:38:56.531 INFO:teuthology.orchestra.run.smithi061.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-01-01T17:38:56.531 INFO:teuthology.orchestra.run.smithi061.stdout: liboath-2.6.2-3.el8.x86_64 2023-01-01T17:38:56.532 INFO:teuthology.orchestra.run.smithi061.stdout: libpq-13.5-1.el8.x86_64 2023-01-01T17:38:56.532 INFO:teuthology.orchestra.run.smithi061.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-01-01T17:38:56.532 INFO:teuthology.orchestra.run.smithi061.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-01-01T17:38:56.532 INFO:teuthology.orchestra.run.smithi061.stdout: librados-devel-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:56.532 INFO:teuthology.orchestra.run.smithi061.stdout: libradosstriper1-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:56.532 INFO:teuthology.orchestra.run.smithi061.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-01-01T17:38:56.532 INFO:teuthology.orchestra.run.smithi061.stdout: librgw2-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:56.532 INFO:teuthology.orchestra.run.smithi061.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-01-01T17:38:56.532 INFO:teuthology.orchestra.run.smithi061.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-01-01T17:38:56.532 INFO:teuthology.orchestra.run.smithi061.stdout: libtool-2.4.6-25.el8.x86_64 2023-01-01T17:38:56.532 INFO:teuthology.orchestra.run.smithi061.stdout: libunwind-1.3.1-3.el8.x86_64 2023-01-01T17:38:56.532 INFO:teuthology.orchestra.run.smithi061.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-01-01T17:38:56.532 INFO:teuthology.orchestra.run.smithi061.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-01-01T17:38:56.532 INFO:teuthology.orchestra.run.smithi061.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-01-01T17:38:56.533 INFO:teuthology.orchestra.run.smithi061.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-01-01T17:38:56.533 INFO:teuthology.orchestra.run.smithi061.stdout: openblas-0.3.15-3.el8.x86_64 2023-01-01T17:38:56.533 INFO:teuthology.orchestra.run.smithi061.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-01-01T17:38:56.533 INFO:teuthology.orchestra.run.smithi061.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-01-01T17:38:56.533 INFO:teuthology.orchestra.run.smithi061.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-01-01T17:38:56.533 INFO:teuthology.orchestra.run.smithi061.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-01-01T17:38:56.533 INFO:teuthology.orchestra.run.smithi061.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-01-01T17:38:56.533 INFO:teuthology.orchestra.run.smithi061.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-01-01T17:38:56.533 INFO:teuthology.orchestra.run.smithi061.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-01-01T17:38:56.533 INFO:teuthology.orchestra.run.smithi061.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-01-01T17:38:56.533 INFO:teuthology.orchestra.run.smithi061.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-01-01T17:38:56.533 INFO:teuthology.orchestra.run.smithi061.stdout: python3-babel-2.5.1-7.el8.noarch 2023-01-01T17:38:56.533 INFO:teuthology.orchestra.run.smithi061.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-01-01T17:38:56.534 INFO:teuthology.orchestra.run.smithi061.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-01-01T17:38:56.534 INFO:teuthology.orchestra.run.smithi061.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-01-01T17:38:56.534 INFO:teuthology.orchestra.run.smithi061.stdout: python3-ceph-argparse-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:56.534 INFO:teuthology.orchestra.run.smithi061.stdout: python3-ceph-common-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:56.534 INFO:teuthology.orchestra.run.smithi061.stdout: python3-cephfs-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:56.534 INFO:teuthology.orchestra.run.smithi061.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-01-01T17:38:56.534 INFO:teuthology.orchestra.run.smithi061.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-01-01T17:38:56.534 INFO:teuthology.orchestra.run.smithi061.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-01-01T17:38:56.534 INFO:teuthology.orchestra.run.smithi061.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-01-01T17:38:56.534 INFO:teuthology.orchestra.run.smithi061.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-01-01T17:38:56.534 INFO:teuthology.orchestra.run.smithi061.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-01-01T17:38:56.534 INFO:teuthology.orchestra.run.smithi061.stdout: python3-jaraco-6.2-6.el8.noarch 2023-01-01T17:38:56.534 INFO:teuthology.orchestra.run.smithi061.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-01-01T17:38:56.535 INFO:teuthology.orchestra.run.smithi061.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-01-01T17:38:56.535 INFO:teuthology.orchestra.run.smithi061.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-01-01T17:38:56.535 INFO:teuthology.orchestra.run.smithi061.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-01-01T17:38:56.535 INFO:teuthology.orchestra.run.smithi061.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-01-01T17:38:56.535 INFO:teuthology.orchestra.run.smithi061.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-01-01T17:38:56.535 INFO:teuthology.orchestra.run.smithi061.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-01-01T17:38:56.538 INFO:teuthology.orchestra.run.smithi061.stdout: python3-mako-1.0.6-13.el8.noarch 2023-01-01T17:38:56.538 INFO:teuthology.orchestra.run.smithi061.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-01-01T17:38:56.538 INFO:teuthology.orchestra.run.smithi061.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-01-01T17:38:56.538 INFO:teuthology.orchestra.run.smithi061.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-01-01T17:38:56.539 INFO:teuthology.orchestra.run.smithi061.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-01-01T17:38:56.539 INFO:teuthology.orchestra.run.smithi061.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-01-01T17:38:56.539 INFO:teuthology.orchestra.run.smithi061.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-01-01T17:38:56.539 INFO:teuthology.orchestra.run.smithi061.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-01-01T17:38:56.539 INFO:teuthology.orchestra.run.smithi061.stdout: python3-portend-2.6-1.el8.noarch 2023-01-01T17:38:56.540 INFO:teuthology.orchestra.run.smithi061.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-01-01T17:38:56.540 INFO:teuthology.orchestra.run.smithi061.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-01-01T17:38:56.540 INFO:teuthology.orchestra.run.smithi061.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-01-01T17:38:56.540 INFO:teuthology.orchestra.run.smithi061.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-01-01T17:38:56.540 INFO:teuthology.orchestra.run.smithi061.stdout: python3-pycparser-2.14-14.el8.noarch 2023-01-01T17:38:56.540 INFO:teuthology.orchestra.run.smithi061.stdout: python3-pytz-2017.2-9.el8.noarch 2023-01-01T17:38:56.540 INFO:teuthology.orchestra.run.smithi061.stdout: python3-rados-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:56.540 INFO:teuthology.orchestra.run.smithi061.stdout: python3-rbd-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:56.540 INFO:teuthology.orchestra.run.smithi061.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-01-01T17:38:56.540 INFO:teuthology.orchestra.run.smithi061.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-01-01T17:38:56.540 INFO:teuthology.orchestra.run.smithi061.stdout: python3-rgw-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:56.540 INFO:teuthology.orchestra.run.smithi061.stdout: python3-routes-2.4.1-12.el8.noarch 2023-01-01T17:38:56.540 INFO:teuthology.orchestra.run.smithi061.stdout: python3-rsa-4.8-1.el8.noarch 2023-01-01T17:38:56.541 INFO:teuthology.orchestra.run.smithi061.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-01-01T17:38:56.541 INFO:teuthology.orchestra.run.smithi061.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-01-01T17:38:56.541 INFO:teuthology.orchestra.run.smithi061.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-01-01T17:38:56.541 INFO:teuthology.orchestra.run.smithi061.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-01-01T17:38:56.541 INFO:teuthology.orchestra.run.smithi061.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-01-01T17:38:56.541 INFO:teuthology.orchestra.run.smithi061.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-01-01T17:38:56.541 INFO:teuthology.orchestra.run.smithi061.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-01-01T17:38:56.541 INFO:teuthology.orchestra.run.smithi061.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-01-01T17:38:56.541 INFO:teuthology.orchestra.run.smithi061.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-01-01T17:38:56.541 INFO:teuthology.orchestra.run.smithi061.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-01-01T17:38:56.541 INFO:teuthology.orchestra.run.smithi061.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-01-01T17:38:56.541 INFO:teuthology.orchestra.run.smithi061.stdout: rbd-fuse-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:56.542 INFO:teuthology.orchestra.run.smithi061.stdout: rbd-mirror-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:56.542 INFO:teuthology.orchestra.run.smithi061.stdout: rbd-nbd-2:18.0.0-1638.g2d451fdb.el8.x86_64 2023-01-01T17:38:56.542 INFO:teuthology.orchestra.run.smithi061.stdout: socat-1.7.4.1-1.el8.x86_64 2023-01-01T17:38:56.542 INFO:teuthology.orchestra.run.smithi061.stdout: thrift-0.13.0-2.el8.x86_64 2023-01-01T17:38:56.542 INFO:teuthology.orchestra.run.smithi061.stdout: uuid-1.6.2-43.el8.x86_64 2023-01-01T17:38:56.542 INFO:teuthology.orchestra.run.smithi061.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-01-01T17:38:56.542 INFO:teuthology.orchestra.run.smithi061.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-01-01T17:38:56.542 INFO:teuthology.orchestra.run.smithi061.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-01-01T17:38:56.543 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:38:56.543 INFO:teuthology.orchestra.run.smithi061.stdout:Complete! 2023-01-01T17:38:56.713 DEBUG:teuthology.parallel:result is None 2023-01-01T17:38:56.713 DEBUG:teuthology.orchestra.run.smithi061:> sudo lsb_release -is 2023-01-01T17:38:56.771 INFO:teuthology.orchestra.run.smithi061.stdout:RedHatEnterprise 2023-01-01T17:38:56.772 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2023-01-01T17:38:56.772 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a 2023-01-01T17:38:56.927 DEBUG:teuthology.orchestra.run.smithi061:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-01-01T17:38:56.950 INFO:teuthology.orchestra.run.smithi061.stdout:18.0.0-1638.g2d451fdb.el8 2023-01-01T17:38:56.950 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-1638.g2d451fdb.el8 2023-01-01T17:38:56.950 INFO:teuthology.task.install:The correct ceph version 18.0.0-1638.g2d451fdb is installed. 2023-01-01T17:38:56.951 DEBUG:teuthology.orchestra.run.smithi149:> sudo lsb_release -is 2023-01-01T17:38:57.015 INFO:teuthology.orchestra.run.smithi149.stdout:RedHatEnterprise 2023-01-01T17:38:57.017 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2023-01-01T17:38:57.017 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a 2023-01-01T17:38:57.185 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-01-01T17:38:57.210 INFO:teuthology.orchestra.run.smithi149.stdout:18.0.0-1638.g2d451fdb.el8 2023-01-01T17:38:57.210 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-1638.g2d451fdb.el8 2023-01-01T17:38:57.210 INFO:teuthology.task.install:The correct ceph version 18.0.0-1638.g2d451fdb is installed. 2023-01-01T17:38:57.211 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-01-01T17:38:57.212 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-01-01T17:38:57.212 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-01-01T17:38:57.240 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-01T17:38:57.240 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-01-01T17:38:57.279 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-01-01T17:38:57.279 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-01-01T17:38:57.279 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd of=/usr/bin/daemon-helper 2023-01-01T17:38:57.309 DEBUG:teuthology.orchestra.run.smithi061:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-01-01T17:38:57.377 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-01T17:38:57.378 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/daemon-helper 2023-01-01T17:38:57.405 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-01-01T17:38:57.473 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-01-01T17:38:57.474 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-01-01T17:38:57.474 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd of=/usr/bin/adjust-ulimits 2023-01-01T17:38:57.508 DEBUG:teuthology.orchestra.run.smithi061:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-01-01T17:38:57.576 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-01T17:38:57.576 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/adjust-ulimits 2023-01-01T17:38:57.603 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-01-01T17:38:57.671 INFO:teuthology.run_tasks:Running task ceph... 2023-01-01T17:38:57.747 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-01-01T17:38:57.747 DEBUG:teuthology.orchestra.run.smithi061:> sudo chmod 777 /var/log/ceph 2023-01-01T17:38:57.750 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 777 /var/log/ceph 2023-01-01T17:38:57.778 INFO:tasks.ceph:Disabling ceph logrotate... 2023-01-01T17:38:57.778 DEBUG:teuthology.orchestra.run.smithi061:> sudo rm -f -- /etc/logrotate.d/ceph 2023-01-01T17:38:57.818 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/logrotate.d/ceph 2023-01-01T17:38:57.844 INFO:tasks.ceph:Creating extra log directories... 2023-01-01T17:38:57.844 DEBUG:teuthology.orchestra.run.smithi061:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-01-01T17:38:57.886 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-01-01T17:38:57.920 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-01-01T17:38:57.921 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-01-01T17:38:57.921 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-01-01T17:38:57.921 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-01-01T17:38:57.921 DEBUG:teuthology.orchestra.run.smithi061:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-01-01T17:38:57.968 DEBUG:teuthology.orchestra.run.smithi061:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-01-01T17:38:58.104 DEBUG:teuthology.orchestra.run.smithi061:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-01-01T17:38:58.131 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-01T17:38:58.131 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-01-01T17:38:58.148 DEBUG:teuthology.orchestra.run.smithi149:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-01-01T17:38:58.277 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-01-01T17:38:58.310 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-01-01T17:38:58.310 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-01-01T17:38:58.310 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-01-01_15:14:18-fs-wip-vshankar-testing-20221221.044733-testing-default-smithi/7130185', 'branch': 'wip-vshankar-testing-20221221.044733', 'description': 'fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7130185', 'kclient-workload': {'sequential': [{'kclient': ['client.1']}, {'workunit': {'clients': {'client.1': ['suites/dbench.sh']}}}]}, 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '937d5e0c86d70ca5fb80d65cdf2379d67b3bb37b'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-01-01_15:14:18-fs-wip-vshankar-testing-20221221.044733-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20221221.044733'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20221221.044733', 'sha1': '2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 150, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'sha1': '2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20221221.044733', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi061.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac=', 'smithi149.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '937d5e0c86d70ca5fb80d65cdf2379d67b3bb37b'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a'}}, {'ceph': None}, {'parallel': ['user-workload', 'kclient-workload']}], 'teuthology_branch': 'main', 'teuthology_sha1': '19d18db866afdc31fd6586f558fc29b95a87ccfb', 'timestamp': '2023-01-01_15:14:18', 'tube': 'smithi', 'user': 'vshankar', 'user-workload': {'sequential': [{'ceph-fuse': ['client.0']}, {'workunit': {'clients': {'client.0': ['suites/iozone.sh']}}}]}, 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.32458'} 2023-01-01T17:38:58.311 DEBUG:teuthology.orchestra.run.smithi061:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-01-01T17:38:58.314 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-01-01T17:38:58.360 DEBUG:teuthology.orchestra.run.smithi061:> sudo install -d -m0777 -- /var/run/ceph 2023-01-01T17:38:58.371 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/run/ceph 2023-01-01T17:38:58.426 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-01-01T17:38:58.426 DEBUG:teuthology.orchestra.run.smithi061:> dd if=/scratch_devs of=/dev/stdout 2023-01-01T17:38:58.454 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-01-01T17:38:58.455 DEBUG:teuthology.orchestra.run.smithi061:> stat /dev/vg_nvme/lv_1 2023-01-01T17:38:58.512 INFO:teuthology.orchestra.run.smithi061.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-01-01T17:38:58.512 INFO:teuthology.orchestra.run.smithi061.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-01T17:38:58.512 INFO:teuthology.orchestra.run.smithi061.stdout:Device: 6h/6d Inode: 346709 Links: 1 2023-01-01T17:38:58.512 INFO:teuthology.orchestra.run.smithi061.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-01T17:38:58.512 INFO:teuthology.orchestra.run.smithi061.stdout:Context: system_u:object_r:device_t:s0 2023-01-01T17:38:58.512 INFO:teuthology.orchestra.run.smithi061.stdout:Access: 2023-01-01 17:38:50.151321708 +0000 2023-01-01T17:38:58.512 INFO:teuthology.orchestra.run.smithi061.stdout:Modify: 2023-01-01 17:36:14.194261306 +0000 2023-01-01T17:38:58.513 INFO:teuthology.orchestra.run.smithi061.stdout:Change: 2023-01-01 17:36:14.194261306 +0000 2023-01-01T17:38:58.513 INFO:teuthology.orchestra.run.smithi061.stdout: Birth: - 2023-01-01T17:38:58.513 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-01-01T17:38:58.579 INFO:teuthology.orchestra.run.smithi061.stderr:1+0 records in 2023-01-01T17:38:58.579 INFO:teuthology.orchestra.run.smithi061.stderr:1+0 records out 2023-01-01T17:38:58.579 INFO:teuthology.orchestra.run.smithi061.stderr:512 bytes copied, 0.000268188 s, 1.9 MB/s 2023-01-01T17:38:58.580 DEBUG:teuthology.orchestra.run.smithi061:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-01-01T17:38:58.639 DEBUG:teuthology.orchestra.run.smithi061:> stat /dev/vg_nvme/lv_2 2023-01-01T17:38:58.697 INFO:teuthology.orchestra.run.smithi061.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-01-01T17:38:58.697 INFO:teuthology.orchestra.run.smithi061.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-01T17:38:58.697 INFO:teuthology.orchestra.run.smithi061.stdout:Device: 6h/6d Inode: 341927 Links: 1 2023-01-01T17:38:58.697 INFO:teuthology.orchestra.run.smithi061.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-01T17:38:58.697 INFO:teuthology.orchestra.run.smithi061.stdout:Context: system_u:object_r:device_t:s0 2023-01-01T17:38:58.697 INFO:teuthology.orchestra.run.smithi061.stdout:Access: 2023-01-01 17:38:50.151321708 +0000 2023-01-01T17:38:58.697 INFO:teuthology.orchestra.run.smithi061.stdout:Modify: 2023-01-01 17:36:14.764251962 +0000 2023-01-01T17:38:58.698 INFO:teuthology.orchestra.run.smithi061.stdout:Change: 2023-01-01 17:36:14.764251962 +0000 2023-01-01T17:38:58.698 INFO:teuthology.orchestra.run.smithi061.stdout: Birth: - 2023-01-01T17:38:58.698 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-01-01T17:38:58.763 INFO:teuthology.orchestra.run.smithi061.stderr:1+0 records in 2023-01-01T17:38:58.763 INFO:teuthology.orchestra.run.smithi061.stderr:1+0 records out 2023-01-01T17:38:58.763 INFO:teuthology.orchestra.run.smithi061.stderr:512 bytes copied, 0.000220095 s, 2.3 MB/s 2023-01-01T17:38:58.764 DEBUG:teuthology.orchestra.run.smithi061:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-01-01T17:38:58.822 DEBUG:teuthology.orchestra.run.smithi061:> stat /dev/vg_nvme/lv_3 2023-01-01T17:38:58.881 INFO:teuthology.orchestra.run.smithi061.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-01-01T17:38:58.899 INFO:teuthology.orchestra.run.smithi061.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-01T17:38:58.899 INFO:teuthology.orchestra.run.smithi061.stdout:Device: 6h/6d Inode: 349681 Links: 1 2023-01-01T17:38:58.899 INFO:teuthology.orchestra.run.smithi061.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-01T17:38:58.899 INFO:teuthology.orchestra.run.smithi061.stdout:Context: system_u:object_r:device_t:s0 2023-01-01T17:38:58.899 INFO:teuthology.orchestra.run.smithi061.stdout:Access: 2023-01-01 17:38:50.151321708 +0000 2023-01-01T17:38:58.899 INFO:teuthology.orchestra.run.smithi061.stdout:Modify: 2023-01-01 17:36:15.311242995 +0000 2023-01-01T17:38:58.899 INFO:teuthology.orchestra.run.smithi061.stdout:Change: 2023-01-01 17:36:15.311242995 +0000 2023-01-01T17:38:58.899 INFO:teuthology.orchestra.run.smithi061.stdout: Birth: - 2023-01-01T17:38:58.900 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-01-01T17:38:58.949 INFO:teuthology.orchestra.run.smithi061.stderr:1+0 records in 2023-01-01T17:38:58.950 INFO:teuthology.orchestra.run.smithi061.stderr:1+0 records out 2023-01-01T17:38:58.950 INFO:teuthology.orchestra.run.smithi061.stderr:512 bytes copied, 0.000239122 s, 2.1 MB/s 2023-01-01T17:38:58.951 DEBUG:teuthology.orchestra.run.smithi061:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-01-01T17:38:59.009 DEBUG:teuthology.orchestra.run.smithi061:> stat /dev/vg_nvme/lv_4 2023-01-01T17:38:59.068 INFO:teuthology.orchestra.run.smithi061.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-01-01T17:38:59.069 INFO:teuthology.orchestra.run.smithi061.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-01T17:38:59.071 INFO:teuthology.orchestra.run.smithi061.stdout:Device: 6h/6d Inode: 355336 Links: 1 2023-01-01T17:38:59.071 INFO:teuthology.orchestra.run.smithi061.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-01T17:38:59.071 INFO:teuthology.orchestra.run.smithi061.stdout:Context: system_u:object_r:device_t:s0 2023-01-01T17:38:59.071 INFO:teuthology.orchestra.run.smithi061.stdout:Access: 2023-01-01 17:38:50.151321708 +0000 2023-01-01T17:38:59.071 INFO:teuthology.orchestra.run.smithi061.stdout:Modify: 2023-01-01 17:36:15.876233734 +0000 2023-01-01T17:38:59.072 INFO:teuthology.orchestra.run.smithi061.stdout:Change: 2023-01-01 17:36:15.876233734 +0000 2023-01-01T17:38:59.072 INFO:teuthology.orchestra.run.smithi061.stdout: Birth: - 2023-01-01T17:38:59.072 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-01-01T17:38:59.134 INFO:teuthology.orchestra.run.smithi061.stderr:1+0 records in 2023-01-01T17:38:59.134 INFO:teuthology.orchestra.run.smithi061.stderr:1+0 records out 2023-01-01T17:38:59.135 INFO:teuthology.orchestra.run.smithi061.stderr:512 bytes copied, 0.000191249 s, 2.7 MB/s 2023-01-01T17:38:59.135 DEBUG:teuthology.orchestra.run.smithi061:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-01-01T17:38:59.195 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-01T17:38:59.195 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-01T17:38:59.195 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/scratch_devs of=/dev/stdout 2023-01-01T17:38:59.214 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-01-01T17:38:59.214 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_1 2023-01-01T17:38:59.273 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-01-01T17:38:59.273 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-01T17:38:59.273 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 344650 Links: 1 2023-01-01T17:38:59.273 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-01T17:38:59.274 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2023-01-01T17:38:59.274 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2023-01-01 17:38:46.730684881 +0000 2023-01-01T17:38:59.274 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2023-01-01 17:36:04.935513569 +0000 2023-01-01T17:38:59.274 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2023-01-01 17:36:04.935513569 +0000 2023-01-01T17:38:59.274 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: - 2023-01-01T17:38:59.274 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-01-01T17:38:59.339 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2023-01-01T17:38:59.339 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2023-01-01T17:38:59.339 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000255069 s, 2.0 MB/s 2023-01-01T17:38:59.342 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-01-01T17:38:59.400 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_2 2023-01-01T17:38:59.458 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-01-01T17:38:59.458 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-01T17:38:59.458 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 351398 Links: 1 2023-01-01T17:38:59.458 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-01T17:38:59.458 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2023-01-01T17:38:59.458 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2023-01-01 17:38:46.730684881 +0000 2023-01-01T17:38:59.458 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2023-01-01 17:36:05.463503253 +0000 2023-01-01T17:38:59.458 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2023-01-01 17:36:05.463503253 +0000 2023-01-01T17:38:59.458 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: - 2023-01-01T17:38:59.459 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-01-01T17:38:59.524 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2023-01-01T17:38:59.524 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2023-01-01T17:38:59.524 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000242906 s, 2.1 MB/s 2023-01-01T17:38:59.525 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-01-01T17:38:59.583 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_3 2023-01-01T17:38:59.641 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-01-01T17:38:59.641 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-01T17:38:59.641 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 348675 Links: 1 2023-01-01T17:38:59.641 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-01T17:38:59.641 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2023-01-01T17:38:59.641 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2023-01-01 17:38:46.730684881 +0000 2023-01-01T17:38:59.642 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2023-01-01 17:36:05.984493074 +0000 2023-01-01T17:38:59.642 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2023-01-01 17:36:05.984493074 +0000 2023-01-01T17:38:59.642 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: - 2023-01-01T17:38:59.642 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-01-01T17:38:59.708 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2023-01-01T17:38:59.708 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2023-01-01T17:38:59.708 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000242879 s, 2.1 MB/s 2023-01-01T17:38:59.708 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-01-01T17:38:59.767 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_4 2023-01-01T17:38:59.824 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-01-01T17:38:59.824 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-01T17:38:59.824 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 349986 Links: 1 2023-01-01T17:38:59.824 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-01T17:38:59.825 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2023-01-01T17:38:59.825 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2023-01-01 17:38:46.730684881 +0000 2023-01-01T17:38:59.825 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2023-01-01 17:36:06.510482798 +0000 2023-01-01T17:38:59.825 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2023-01-01 17:36:06.510482798 +0000 2023-01-01T17:38:59.825 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: - 2023-01-01T17:38:59.825 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-01-01T17:38:59.890 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2023-01-01T17:38:59.890 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2023-01-01T17:38:59.890 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000224442 s, 2.3 MB/s 2023-01-01T17:38:59.891 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-01-01T17:38:59.949 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-01T17:38:59.949 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi061.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi149.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-01-01T17:38:59.949 INFO:tasks.ceph:Generating config... 2023-01-01T17:38:59.950 INFO:tasks.ceph:[client] client mount timeout = 600 2023-01-01T17:38:59.951 INFO:tasks.ceph:[client] debug client = 20 2023-01-01T17:38:59.951 INFO:tasks.ceph:[client] debug ms = 1 2023-01-01T17:38:59.951 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-01-01T17:38:59.951 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-01-01T17:38:59.951 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-01-01T17:38:59.951 INFO:tasks.ceph:[mds] debug mds = 20 2023-01-01T17:38:59.951 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-01-01T17:38:59.951 INFO:tasks.ceph:[mds] debug ms = 1 2023-01-01T17:38:59.951 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2023-01-01T17:38:59.951 INFO:tasks.ceph:[mds] mds bal merge size = 5 2023-01-01T17:38:59.951 INFO:tasks.ceph:[mds] mds bal split bits = 3 2023-01-01T17:38:59.952 INFO:tasks.ceph:[mds] mds bal split size = 100 2023-01-01T17:38:59.952 INFO:tasks.ceph:[mds] mds debug frag = True 2023-01-01T17:38:59.952 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-01-01T17:38:59.952 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-01-01T17:38:59.952 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-01-01T17:38:59.952 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-01-01T17:38:59.952 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-01-01T17:38:59.952 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-01-01T17:38:59.952 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-01-01T17:38:59.952 INFO:tasks.ceph:[mgr] debug ms = 1 2023-01-01T17:38:59.952 INFO:tasks.ceph:[mon] debug mon = 20 2023-01-01T17:38:59.953 INFO:tasks.ceph:[mon] debug ms = 1 2023-01-01T17:38:59.953 INFO:tasks.ceph:[mon] debug paxos = 20 2023-01-01T17:38:59.953 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-01-01T17:38:59.953 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-01-01T17:38:59.953 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2023-01-01T17:38:59.953 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-01-01T17:38:59.953 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-01-01T17:38:59.953 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-01-01T17:38:59.953 INFO:tasks.ceph:[osd] debug ms = 1 2023-01-01T17:38:59.953 INFO:tasks.ceph:[osd] debug osd = 20 2023-01-01T17:38:59.953 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-01-01T17:38:59.954 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-01-01T17:38:59.954 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-01-01T17:38:59.954 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-01-01T17:38:59.954 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-01-01T17:38:59.954 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-01-01T17:38:59.954 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-01-01T17:38:59.954 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-01-01T17:38:59.954 INFO:tasks.ceph:Setting up mon.a... 2023-01-01T17:38:59.955 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-01-01T17:39:00.015 INFO:teuthology.orchestra.run.smithi061.stdout:creating /etc/ceph/ceph.keyring 2023-01-01T17:39:00.018 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-01-01T17:39:00.068 DEBUG:teuthology.orchestra.run.smithi061:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-01-01T17:39:00.098 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.61'), ('mon.b', '172.21.15.149'), ('mon.c', '[v2:172.21.15.149:3301,v1:172.21.15.149:6790]')] 2023-01-01T17:39:00.098 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.61,172.21.15.149,[v2:172.21.15.149:3301,v1:172.21.15.149:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-01-01T17:39:00.099 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-01-01T17:39:00.099 DEBUG:teuthology.orchestra.run.smithi061:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-01-01T17:39:00.157 DEBUG:teuthology.orchestra.run.smithi061:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.61 --add b 172.21.15.149 --addv c '[v2:172.21.15.149:3301,v1:172.21.15.149:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-01-01T17:39:00.247 INFO:teuthology.orchestra.run.smithi061.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-01-01T17:39:00.247 INFO:teuthology.orchestra.run.smithi061.stdout:monmaptool: generated fsid fe0d3d8e-46ee-4ed9-92f8-749741721d01 2023-01-01T17:39:00.247 INFO:teuthology.orchestra.run.smithi061.stdout:setting min_mon_release = pacific 2023-01-01T17:39:00.247 INFO:teuthology.orchestra.run.smithi061.stdout:epoch 0 2023-01-01T17:39:00.247 INFO:teuthology.orchestra.run.smithi061.stdout:fsid fe0d3d8e-46ee-4ed9-92f8-749741721d01 2023-01-01T17:39:00.247 INFO:teuthology.orchestra.run.smithi061.stdout:last_changed 2023-01-01T17:39:00.248216+0000 2023-01-01T17:39:00.248 INFO:teuthology.orchestra.run.smithi061.stdout:created 2023-01-01T17:39:00.248216+0000 2023-01-01T17:39:00.248 INFO:teuthology.orchestra.run.smithi061.stdout:min_mon_release 16 (pacific) 2023-01-01T17:39:00.248 INFO:teuthology.orchestra.run.smithi061.stdout:election_strategy: 1 2023-01-01T17:39:00.248 INFO:teuthology.orchestra.run.smithi061.stdout:0: [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] mon.a 2023-01-01T17:39:00.248 INFO:teuthology.orchestra.run.smithi061.stdout:1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2023-01-01T17:39:00.248 INFO:teuthology.orchestra.run.smithi061.stdout:2: [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] mon.c 2023-01-01T17:39:00.248 INFO:teuthology.orchestra.run.smithi061.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-01-01T17:39:00.249 DEBUG:teuthology.orchestra.run.smithi061:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-01-01T17:39:00.270 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID fe0d3d8e-46ee-4ed9-92f8-749741721d01... 2023-01-01T17:39:00.271 DEBUG:teuthology.orchestra.run.smithi061:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-01-01T17:39:00.313 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-01-01T17:39:00.356 INFO:teuthology.orchestra.run.smithi061.stdout:[global] 2023-01-01T17:39:00.357 INFO:teuthology.orchestra.run.smithi061.stdout: chdir = "" 2023-01-01T17:39:00.357 INFO:teuthology.orchestra.run.smithi061.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-01-01T17:39:00.357 INFO:teuthology.orchestra.run.smithi061.stdout: auth supported = cephx 2023-01-01T17:39:00.357 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:00.357 INFO:teuthology.orchestra.run.smithi061.stdout: filestore xattr use omap = true 2023-01-01T17:39:00.357 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:00.357 INFO:teuthology.orchestra.run.smithi061.stdout: mon clock drift allowed = 1.000 2023-01-01T17:39:00.357 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:00.357 INFO:teuthology.orchestra.run.smithi061.stdout: osd crush chooseleaf type = 0 2023-01-01T17:39:00.357 INFO:teuthology.orchestra.run.smithi061.stdout: auth debug = true 2023-01-01T17:39:00.358 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:00.358 INFO:teuthology.orchestra.run.smithi061.stdout: ms die on old message = true 2023-01-01T17:39:00.358 INFO:teuthology.orchestra.run.smithi061.stdout: ms die on bug = true 2023-01-01T17:39:00.358 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:00.358 INFO:teuthology.orchestra.run.smithi061.stdout: mon max pg per osd = 10000 # >= luminous 2023-01-01T17:39:00.358 INFO:teuthology.orchestra.run.smithi061.stdout: mon pg warn max object skew = 0 2023-01-01T17:39:00.358 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:00.358 INFO:teuthology.orchestra.run.smithi061.stdout: # disable pg_autoscaler by default for new pools 2023-01-01T17:39:00.359 INFO:teuthology.orchestra.run.smithi061.stdout: osd_pool_default_pg_autoscale_mode = off 2023-01-01T17:39:00.359 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:00.359 INFO:teuthology.orchestra.run.smithi061.stdout: osd pool default size = 2 2023-01-01T17:39:00.359 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:00.359 INFO:teuthology.orchestra.run.smithi061.stdout: mon osd allow primary affinity = true 2023-01-01T17:39:00.359 INFO:teuthology.orchestra.run.smithi061.stdout: mon osd allow pg remap = true 2023-01-01T17:39:00.359 INFO:teuthology.orchestra.run.smithi061.stdout: mon warn on legacy crush tunables = false 2023-01-01T17:39:00.359 INFO:teuthology.orchestra.run.smithi061.stdout: mon warn on crush straw calc version zero = false 2023-01-01T17:39:00.359 INFO:teuthology.orchestra.run.smithi061.stdout: mon warn on no sortbitwise = false 2023-01-01T17:39:00.359 INFO:teuthology.orchestra.run.smithi061.stdout: mon warn on osd down out interval zero = false 2023-01-01T17:39:00.359 INFO:teuthology.orchestra.run.smithi061.stdout: mon warn on too few osds = false 2023-01-01T17:39:00.359 INFO:teuthology.orchestra.run.smithi061.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-01-01T17:39:00.360 INFO:teuthology.orchestra.run.smithi061.stdout: mon_warn_on_pool_no_redundancy = false 2023-01-01T17:39:00.360 INFO:teuthology.orchestra.run.smithi061.stdout: mon_allow_pool_size_one = true 2023-01-01T17:39:00.360 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:00.360 INFO:teuthology.orchestra.run.smithi061.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-01-01T17:39:00.360 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:00.360 INFO:teuthology.orchestra.run.smithi061.stdout: osd default data pool replay window = 5 2023-01-01T17:39:00.360 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:00.360 INFO:teuthology.orchestra.run.smithi061.stdout: mon allow pool delete = true 2023-01-01T17:39:00.360 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:00.360 INFO:teuthology.orchestra.run.smithi061.stdout: mon cluster log file level = debug 2023-01-01T17:39:00.360 INFO:teuthology.orchestra.run.smithi061.stdout: debug asserts on shutdown = true 2023-01-01T17:39:00.360 INFO:teuthology.orchestra.run.smithi061.stdout: mon health detail to clog = false 2023-01-01T17:39:00.361 INFO:teuthology.orchestra.run.smithi061.stdout: mon host = "172.21.15.61,172.21.15.149,[v2:172.21.15.149:3301,v1:172.21.15.149:6790]" 2023-01-01T17:39:00.361 INFO:teuthology.orchestra.run.smithi061.stdout: ms die on skipped message = False 2023-01-01T17:39:00.361 INFO:teuthology.orchestra.run.smithi061.stdout: fsid = fe0d3d8e-46ee-4ed9-92f8-749741721d01 2023-01-01T17:39:00.361 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:00.361 INFO:teuthology.orchestra.run.smithi061.stdout:[osd] 2023-01-01T17:39:00.361 INFO:teuthology.orchestra.run.smithi061.stdout: osd journal size = 100 2023-01-01T17:39:00.361 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:00.361 INFO:teuthology.orchestra.run.smithi061.stdout: osd scrub load threshold = 5.0 2023-01-01T17:39:00.361 INFO:teuthology.orchestra.run.smithi061.stdout: osd scrub max interval = 600 2023-01-01T17:39:00.361 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:00.361 INFO:teuthology.orchestra.run.smithi061.stdout: osd recover clone overlap = true 2023-01-01T17:39:00.362 INFO:teuthology.orchestra.run.smithi061.stdout: osd recovery max chunk = 1048576 2023-01-01T17:39:00.362 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:00.362 INFO:teuthology.orchestra.run.smithi061.stdout: osd debug shutdown = true 2023-01-01T17:39:00.362 INFO:teuthology.orchestra.run.smithi061.stdout: osd debug op order = true 2023-01-01T17:39:00.362 INFO:teuthology.orchestra.run.smithi061.stdout: osd debug verify stray on activate = true 2023-01-01T17:39:00.362 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:00.362 INFO:teuthology.orchestra.run.smithi061.stdout: osd open classes on start = true 2023-01-01T17:39:00.362 INFO:teuthology.orchestra.run.smithi061.stdout: osd debug pg log writeout = true 2023-01-01T17:39:00.362 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:00.362 INFO:teuthology.orchestra.run.smithi061.stdout: osd deep scrub update digest min age = 30 2023-01-01T17:39:00.362 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:00.362 INFO:teuthology.orchestra.run.smithi061.stdout: osd map max advance = 10 2023-01-01T17:39:00.363 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:00.363 INFO:teuthology.orchestra.run.smithi061.stdout: journal zero on create = true 2023-01-01T17:39:00.363 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:00.363 INFO:teuthology.orchestra.run.smithi061.stdout: filestore ondisk finisher threads = 3 2023-01-01T17:39:00.363 INFO:teuthology.orchestra.run.smithi061.stdout: filestore apply finisher threads = 3 2023-01-01T17:39:00.363 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:00.363 INFO:teuthology.orchestra.run.smithi061.stdout: bdev debug aio = true 2023-01-01T17:39:00.363 INFO:teuthology.orchestra.run.smithi061.stdout: osd debug misdirected ops = true 2023-01-01T17:39:00.363 INFO:teuthology.orchestra.run.smithi061.stdout: bluestore block size = 96636764160 2023-01-01T17:39:00.363 INFO:teuthology.orchestra.run.smithi061.stdout: bluestore compression mode = aggressive 2023-01-01T17:39:00.363 INFO:teuthology.orchestra.run.smithi061.stdout: bluestore fsck on mount = True 2023-01-01T17:39:00.364 INFO:teuthology.orchestra.run.smithi061.stdout: debug bluefs = 20 2023-01-01T17:39:00.364 INFO:teuthology.orchestra.run.smithi061.stdout: debug bluestore = 20 2023-01-01T17:39:00.364 INFO:teuthology.orchestra.run.smithi061.stdout: debug ms = 1 2023-01-01T17:39:00.364 INFO:teuthology.orchestra.run.smithi061.stdout: debug osd = 20 2023-01-01T17:39:00.364 INFO:teuthology.orchestra.run.smithi061.stdout: debug rocksdb = 10 2023-01-01T17:39:00.364 INFO:teuthology.orchestra.run.smithi061.stdout: mon osd backfillfull_ratio = 0.85 2023-01-01T17:39:00.364 INFO:teuthology.orchestra.run.smithi061.stdout: mon osd full ratio = 0.9 2023-01-01T17:39:00.364 INFO:teuthology.orchestra.run.smithi061.stdout: mon osd nearfull ratio = 0.8 2023-01-01T17:39:00.365 INFO:teuthology.orchestra.run.smithi061.stdout: osd failsafe full ratio = 0.95 2023-01-01T17:39:00.365 INFO:teuthology.orchestra.run.smithi061.stdout: osd objectstore = bluestore 2023-01-01T17:39:00.368 INFO:teuthology.orchestra.run.smithi061.stdout: osd op complaint time = 180 2023-01-01T17:39:00.368 INFO:teuthology.orchestra.run.smithi061.stdout: osd shutdown pgref assert = True 2023-01-01T17:39:00.369 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:00.369 INFO:teuthology.orchestra.run.smithi061.stdout:[mgr] 2023-01-01T17:39:00.369 INFO:teuthology.orchestra.run.smithi061.stdout: debug ms = 1 2023-01-01T17:39:00.369 INFO:teuthology.orchestra.run.smithi061.stdout: debug mgr = 20 2023-01-01T17:39:00.369 INFO:teuthology.orchestra.run.smithi061.stdout: debug mon = 20 2023-01-01T17:39:00.369 INFO:teuthology.orchestra.run.smithi061.stdout: debug auth = 20 2023-01-01T17:39:00.369 INFO:teuthology.orchestra.run.smithi061.stdout: mon reweight min pgs per osd = 4 2023-01-01T17:39:00.369 INFO:teuthology.orchestra.run.smithi061.stdout: mon reweight min bytes per osd = 10 2023-01-01T17:39:00.369 INFO:teuthology.orchestra.run.smithi061.stdout: mgr/telemetry/nag = false 2023-01-01T17:39:00.369 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:00.369 INFO:teuthology.orchestra.run.smithi061.stdout:[mon] 2023-01-01T17:39:00.369 INFO:teuthology.orchestra.run.smithi061.stdout: debug ms = 1 2023-01-01T17:39:00.370 INFO:teuthology.orchestra.run.smithi061.stdout: debug mon = 20 2023-01-01T17:39:00.370 INFO:teuthology.orchestra.run.smithi061.stdout: debug paxos = 20 2023-01-01T17:39:00.370 INFO:teuthology.orchestra.run.smithi061.stdout: debug auth = 20 2023-01-01T17:39:00.370 INFO:teuthology.orchestra.run.smithi061.stdout: mon data avail warn = 5 2023-01-01T17:39:00.370 INFO:teuthology.orchestra.run.smithi061.stdout: mon mgr mkfs grace = 240 2023-01-01T17:39:00.370 INFO:teuthology.orchestra.run.smithi061.stdout: mon reweight min pgs per osd = 4 2023-01-01T17:39:00.370 INFO:teuthology.orchestra.run.smithi061.stdout: mon osd reporter subtree level = osd 2023-01-01T17:39:00.370 INFO:teuthology.orchestra.run.smithi061.stdout: mon osd prime pg temp = true 2023-01-01T17:39:00.370 INFO:teuthology.orchestra.run.smithi061.stdout: mon reweight min bytes per osd = 10 2023-01-01T17:39:00.370 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:00.370 INFO:teuthology.orchestra.run.smithi061.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-01-01T17:39:00.371 INFO:teuthology.orchestra.run.smithi061.stdout: auth mon ticket ttl = 660 # 11m 2023-01-01T17:39:00.371 INFO:teuthology.orchestra.run.smithi061.stdout: auth service ticket ttl = 240 # 4m 2023-01-01T17:39:00.371 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:00.371 INFO:teuthology.orchestra.run.smithi061.stdout: # don't complain about insecure global_id in the test suite 2023-01-01T17:39:00.371 INFO:teuthology.orchestra.run.smithi061.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-01-01T17:39:00.371 INFO:teuthology.orchestra.run.smithi061.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-01-01T17:39:00.371 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:00.371 INFO:teuthology.orchestra.run.smithi061.stdout: # 1m isn't quite enough 2023-01-01T17:39:00.371 INFO:teuthology.orchestra.run.smithi061.stdout: mon_down_mkfs_grace = 2m 2023-01-01T17:39:00.371 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:00.371 INFO:teuthology.orchestra.run.smithi061.stdout: mon_warn_on_filestore_osds = false 2023-01-01T17:39:00.371 INFO:teuthology.orchestra.run.smithi061.stdout: mon op complaint time = 120 2023-01-01T17:39:00.372 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:00.372 INFO:teuthology.orchestra.run.smithi061.stdout:[client] 2023-01-01T17:39:00.372 INFO:teuthology.orchestra.run.smithi061.stdout: rgw cache enabled = true 2023-01-01T17:39:00.372 INFO:teuthology.orchestra.run.smithi061.stdout: rgw enable ops log = true 2023-01-01T17:39:00.372 INFO:teuthology.orchestra.run.smithi061.stdout: rgw enable usage log = true 2023-01-01T17:39:00.372 INFO:teuthology.orchestra.run.smithi061.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-01-01T17:39:00.372 INFO:teuthology.orchestra.run.smithi061.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-01-01T17:39:00.372 INFO:teuthology.orchestra.run.smithi061.stdout: client mount timeout = 600 2023-01-01T17:39:00.372 INFO:teuthology.orchestra.run.smithi061.stdout: debug client = 20 2023-01-01T17:39:00.372 INFO:teuthology.orchestra.run.smithi061.stdout: debug ms = 1 2023-01-01T17:39:00.372 INFO:teuthology.orchestra.run.smithi061.stdout: rados mon op timeout = 900 2023-01-01T17:39:00.372 INFO:teuthology.orchestra.run.smithi061.stdout: rados osd op timeout = 900 2023-01-01T17:39:00.373 INFO:teuthology.orchestra.run.smithi061.stdout:[mon.a] 2023-01-01T17:39:00.373 INFO:teuthology.orchestra.run.smithi061.stdout:[mon.b] 2023-01-01T17:39:00.373 INFO:teuthology.orchestra.run.smithi061.stdout:[mon.c] 2023-01-01T17:39:00.373 INFO:teuthology.orchestra.run.smithi061.stdout:[mds.a] 2023-01-01T17:39:00.373 INFO:teuthology.orchestra.run.smithi061.stdout:[mds.c] 2023-01-01T17:39:00.373 INFO:teuthology.orchestra.run.smithi061.stdout:[mds.b] 2023-01-01T17:39:00.373 INFO:teuthology.orchestra.run.smithi061.stdout:[mds.d] 2023-01-01T17:39:00.373 INFO:teuthology.orchestra.run.smithi061.stdout:[mds] 2023-01-01T17:39:00.373 INFO:teuthology.orchestra.run.smithi061.stdout: debug mds = 20 2023-01-01T17:39:00.373 INFO:teuthology.orchestra.run.smithi061.stdout: debug mds balancer = 20 2023-01-01T17:39:00.373 INFO:teuthology.orchestra.run.smithi061.stdout: debug ms = 1 2023-01-01T17:39:00.374 INFO:teuthology.orchestra.run.smithi061.stdout: mds bal fragment size max = 10000 2023-01-01T17:39:00.374 INFO:teuthology.orchestra.run.smithi061.stdout: mds bal merge size = 5 2023-01-01T17:39:00.374 INFO:teuthology.orchestra.run.smithi061.stdout: mds bal split bits = 3 2023-01-01T17:39:00.374 INFO:teuthology.orchestra.run.smithi061.stdout: mds bal split size = 100 2023-01-01T17:39:00.374 INFO:teuthology.orchestra.run.smithi061.stdout: mds debug frag = True 2023-01-01T17:39:00.374 INFO:teuthology.orchestra.run.smithi061.stdout: mds debug scatterstat = True 2023-01-01T17:39:00.374 INFO:teuthology.orchestra.run.smithi061.stdout: mds op complaint time = 180 2023-01-01T17:39:00.374 INFO:teuthology.orchestra.run.smithi061.stdout: mds verify scatter = True 2023-01-01T17:39:00.374 INFO:teuthology.orchestra.run.smithi061.stdout: osd op complaint time = 180 2023-01-01T17:39:00.374 INFO:teuthology.orchestra.run.smithi061.stdout: rados mon op timeout = 900 2023-01-01T17:39:00.374 INFO:teuthology.orchestra.run.smithi061.stdout: rados osd op timeout = 900 2023-01-01T17:39:00.375 INFO:teuthology.orchestra.run.smithi149.stdout:[global] 2023-01-01T17:39:00.375 INFO:teuthology.orchestra.run.smithi149.stdout: chdir = "" 2023-01-01T17:39:00.375 INFO:teuthology.orchestra.run.smithi149.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-01-01T17:39:00.375 INFO:teuthology.orchestra.run.smithi149.stdout: auth supported = cephx 2023-01-01T17:39:00.375 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-01T17:39:00.375 INFO:teuthology.orchestra.run.smithi149.stdout: filestore xattr use omap = true 2023-01-01T17:39:00.376 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-01T17:39:00.376 INFO:teuthology.orchestra.run.smithi149.stdout: mon clock drift allowed = 1.000 2023-01-01T17:39:00.376 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-01T17:39:00.376 INFO:teuthology.orchestra.run.smithi149.stdout: osd crush chooseleaf type = 0 2023-01-01T17:39:00.376 INFO:teuthology.orchestra.run.smithi149.stdout: auth debug = true 2023-01-01T17:39:00.376 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-01T17:39:00.376 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on old message = true 2023-01-01T17:39:00.376 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on bug = true 2023-01-01T17:39:00.376 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-01T17:39:00.376 INFO:teuthology.orchestra.run.smithi149.stdout: mon max pg per osd = 10000 # >= luminous 2023-01-01T17:39:00.376 INFO:teuthology.orchestra.run.smithi149.stdout: mon pg warn max object skew = 0 2023-01-01T17:39:00.377 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-01T17:39:00.377 INFO:teuthology.orchestra.run.smithi149.stdout: # disable pg_autoscaler by default for new pools 2023-01-01T17:39:00.377 INFO:teuthology.orchestra.run.smithi149.stdout: osd_pool_default_pg_autoscale_mode = off 2023-01-01T17:39:00.377 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-01T17:39:00.377 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default size = 2 2023-01-01T17:39:00.377 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-01T17:39:00.377 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow primary affinity = true 2023-01-01T17:39:00.377 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow pg remap = true 2023-01-01T17:39:00.377 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on legacy crush tunables = false 2023-01-01T17:39:00.377 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on crush straw calc version zero = false 2023-01-01T17:39:00.377 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on no sortbitwise = false 2023-01-01T17:39:00.378 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on osd down out interval zero = false 2023-01-01T17:39:00.378 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on too few osds = false 2023-01-01T17:39:00.378 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-01-01T17:39:00.378 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_no_redundancy = false 2023-01-01T17:39:00.378 INFO:teuthology.orchestra.run.smithi149.stdout: mon_allow_pool_size_one = true 2023-01-01T17:39:00.378 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-01T17:39:00.378 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-01-01T17:39:00.378 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-01T17:39:00.378 INFO:teuthology.orchestra.run.smithi149.stdout: osd default data pool replay window = 5 2023-01-01T17:39:00.378 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-01T17:39:00.378 INFO:teuthology.orchestra.run.smithi149.stdout: mon allow pool delete = true 2023-01-01T17:39:00.378 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-01T17:39:00.379 INFO:teuthology.orchestra.run.smithi149.stdout: mon cluster log file level = debug 2023-01-01T17:39:00.379 INFO:teuthology.orchestra.run.smithi149.stdout: debug asserts on shutdown = true 2023-01-01T17:39:00.379 INFO:teuthology.orchestra.run.smithi149.stdout: mon health detail to clog = false 2023-01-01T17:39:00.379 INFO:teuthology.orchestra.run.smithi149.stdout: mon host = "172.21.15.61,172.21.15.149,[v2:172.21.15.149:3301,v1:172.21.15.149:6790]" 2023-01-01T17:39:00.379 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on skipped message = False 2023-01-01T17:39:00.379 INFO:teuthology.orchestra.run.smithi149.stdout: fsid = fe0d3d8e-46ee-4ed9-92f8-749741721d01 2023-01-01T17:39:00.379 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-01T17:39:00.379 INFO:teuthology.orchestra.run.smithi149.stdout:[osd] 2023-01-01T17:39:00.379 INFO:teuthology.orchestra.run.smithi149.stdout: osd journal size = 100 2023-01-01T17:39:00.379 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-01T17:39:00.380 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub load threshold = 5.0 2023-01-01T17:39:00.380 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub max interval = 600 2023-01-01T17:39:00.380 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-01T17:39:00.380 INFO:teuthology.orchestra.run.smithi149.stdout: osd recover clone overlap = true 2023-01-01T17:39:00.380 INFO:teuthology.orchestra.run.smithi149.stdout: osd recovery max chunk = 1048576 2023-01-01T17:39:00.380 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-01T17:39:00.381 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug shutdown = true 2023-01-01T17:39:00.381 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug op order = true 2023-01-01T17:39:00.381 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug verify stray on activate = true 2023-01-01T17:39:00.381 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-01T17:39:00.381 INFO:teuthology.orchestra.run.smithi149.stdout: osd open classes on start = true 2023-01-01T17:39:00.381 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug pg log writeout = true 2023-01-01T17:39:00.381 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-01T17:39:00.381 INFO:teuthology.orchestra.run.smithi149.stdout: osd deep scrub update digest min age = 30 2023-01-01T17:39:00.381 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-01T17:39:00.381 INFO:teuthology.orchestra.run.smithi149.stdout: osd map max advance = 10 2023-01-01T17:39:00.381 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-01T17:39:00.382 INFO:teuthology.orchestra.run.smithi149.stdout: journal zero on create = true 2023-01-01T17:39:00.382 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-01T17:39:00.382 INFO:teuthology.orchestra.run.smithi149.stdout: filestore ondisk finisher threads = 3 2023-01-01T17:39:00.382 INFO:teuthology.orchestra.run.smithi149.stdout: filestore apply finisher threads = 3 2023-01-01T17:39:00.382 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-01T17:39:00.382 INFO:teuthology.orchestra.run.smithi149.stdout: bdev debug aio = true 2023-01-01T17:39:00.382 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug misdirected ops = true 2023-01-01T17:39:00.382 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore block size = 96636764160 2023-01-01T17:39:00.382 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore compression mode = aggressive 2023-01-01T17:39:00.382 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore fsck on mount = True 2023-01-01T17:39:00.383 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluefs = 20 2023-01-01T17:39:00.383 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluestore = 20 2023-01-01T17:39:00.383 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-01-01T17:39:00.383 INFO:teuthology.orchestra.run.smithi149.stdout: debug osd = 20 2023-01-01T17:39:00.383 INFO:teuthology.orchestra.run.smithi149.stdout: debug rocksdb = 10 2023-01-01T17:39:00.383 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd backfillfull_ratio = 0.85 2023-01-01T17:39:00.383 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd full ratio = 0.9 2023-01-01T17:39:00.383 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd nearfull ratio = 0.8 2023-01-01T17:39:00.383 INFO:teuthology.orchestra.run.smithi149.stdout: osd failsafe full ratio = 0.95 2023-01-01T17:39:00.384 INFO:teuthology.orchestra.run.smithi149.stdout: osd objectstore = bluestore 2023-01-01T17:39:00.384 INFO:teuthology.orchestra.run.smithi149.stdout: osd op complaint time = 180 2023-01-01T17:39:00.384 INFO:teuthology.orchestra.run.smithi149.stdout: osd shutdown pgref assert = True 2023-01-01T17:39:00.384 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-01T17:39:00.384 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr] 2023-01-01T17:39:00.384 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-01-01T17:39:00.384 INFO:teuthology.orchestra.run.smithi149.stdout: debug mgr = 20 2023-01-01T17:39:00.384 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2023-01-01T17:39:00.384 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2023-01-01T17:39:00.384 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2023-01-01T17:39:00.384 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2023-01-01T17:39:00.384 INFO:teuthology.orchestra.run.smithi149.stdout: mgr/telemetry/nag = false 2023-01-01T17:39:00.385 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-01T17:39:00.385 INFO:teuthology.orchestra.run.smithi149.stdout:[mon] 2023-01-01T17:39:00.385 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-01-01T17:39:00.385 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2023-01-01T17:39:00.385 INFO:teuthology.orchestra.run.smithi149.stdout: debug paxos = 20 2023-01-01T17:39:00.385 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2023-01-01T17:39:00.385 INFO:teuthology.orchestra.run.smithi149.stdout: mon data avail warn = 5 2023-01-01T17:39:00.385 INFO:teuthology.orchestra.run.smithi149.stdout: mon mgr mkfs grace = 240 2023-01-01T17:39:00.385 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2023-01-01T17:39:00.385 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd reporter subtree level = osd 2023-01-01T17:39:00.385 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd prime pg temp = true 2023-01-01T17:39:00.386 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2023-01-01T17:39:00.386 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-01T17:39:00.386 INFO:teuthology.orchestra.run.smithi149.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-01-01T17:39:00.386 INFO:teuthology.orchestra.run.smithi149.stdout: auth mon ticket ttl = 660 # 11m 2023-01-01T17:39:00.386 INFO:teuthology.orchestra.run.smithi149.stdout: auth service ticket ttl = 240 # 4m 2023-01-01T17:39:00.386 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-01T17:39:00.386 INFO:teuthology.orchestra.run.smithi149.stdout: # don't complain about insecure global_id in the test suite 2023-01-01T17:39:00.386 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-01-01T17:39:00.386 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-01-01T17:39:00.386 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-01T17:39:00.386 INFO:teuthology.orchestra.run.smithi149.stdout: # 1m isn't quite enough 2023-01-01T17:39:00.387 INFO:teuthology.orchestra.run.smithi149.stdout: mon_down_mkfs_grace = 2m 2023-01-01T17:39:00.387 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-01T17:39:00.387 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_filestore_osds = false 2023-01-01T17:39:00.387 INFO:teuthology.orchestra.run.smithi149.stdout: mon op complaint time = 120 2023-01-01T17:39:00.387 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-01-01T17:39:00.387 INFO:teuthology.orchestra.run.smithi149.stdout:[client] 2023-01-01T17:39:00.387 INFO:teuthology.orchestra.run.smithi149.stdout: rgw cache enabled = true 2023-01-01T17:39:00.387 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable ops log = true 2023-01-01T17:39:00.387 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable usage log = true 2023-01-01T17:39:00.387 INFO:teuthology.orchestra.run.smithi149.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-01-01T17:39:00.387 INFO:teuthology.orchestra.run.smithi149.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-01-01T17:39:00.387 INFO:teuthology.orchestra.run.smithi149.stdout: client mount timeout = 600 2023-01-01T17:39:00.388 INFO:teuthology.orchestra.run.smithi149.stdout: debug client = 20 2023-01-01T17:39:00.388 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-01-01T17:39:00.388 INFO:teuthology.orchestra.run.smithi149.stdout: rados mon op timeout = 900 2023-01-01T17:39:00.388 INFO:teuthology.orchestra.run.smithi149.stdout: rados osd op timeout = 900 2023-01-01T17:39:00.388 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.a] 2023-01-01T17:39:00.388 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.b] 2023-01-01T17:39:00.388 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.c] 2023-01-01T17:39:00.388 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.a] 2023-01-01T17:39:00.388 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.c] 2023-01-01T17:39:00.388 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.b] 2023-01-01T17:39:00.388 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.d] 2023-01-01T17:39:00.388 INFO:teuthology.orchestra.run.smithi149.stdout:[mds] 2023-01-01T17:39:00.389 INFO:teuthology.orchestra.run.smithi149.stdout: debug mds = 20 2023-01-01T17:39:00.389 INFO:teuthology.orchestra.run.smithi149.stdout: debug mds balancer = 20 2023-01-01T17:39:00.389 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-01-01T17:39:00.389 INFO:teuthology.orchestra.run.smithi149.stdout: mds bal fragment size max = 10000 2023-01-01T17:39:00.389 INFO:teuthology.orchestra.run.smithi149.stdout: mds bal merge size = 5 2023-01-01T17:39:00.389 INFO:teuthology.orchestra.run.smithi149.stdout: mds bal split bits = 3 2023-01-01T17:39:00.389 INFO:teuthology.orchestra.run.smithi149.stdout: mds bal split size = 100 2023-01-01T17:39:00.389 INFO:teuthology.orchestra.run.smithi149.stdout: mds debug frag = True 2023-01-01T17:39:00.389 INFO:teuthology.orchestra.run.smithi149.stdout: mds debug scatterstat = True 2023-01-01T17:39:00.390 INFO:teuthology.orchestra.run.smithi149.stdout: mds op complaint time = 180 2023-01-01T17:39:00.390 INFO:teuthology.orchestra.run.smithi149.stdout: mds verify scatter = True 2023-01-01T17:39:00.390 INFO:teuthology.orchestra.run.smithi149.stdout: osd op complaint time = 180 2023-01-01T17:39:00.390 INFO:teuthology.orchestra.run.smithi149.stdout: rados mon op timeout = 900 2023-01-01T17:39:00.390 INFO:teuthology.orchestra.run.smithi149.stdout: rados osd op timeout = 900 2023-01-01T17:39:00.392 INFO:tasks.ceph:Creating admin key on mon.a... 2023-01-01T17:39:00.392 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-01-01T17:39:00.489 INFO:tasks.ceph:Copying monmap to all nodes... 2023-01-01T17:39:00.489 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-01-01T17:39:00.489 DEBUG:teuthology.orchestra.run.smithi061:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-01-01T17:39:00.506 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-01-01T17:39:00.506 DEBUG:teuthology.orchestra.run.smithi061:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-01-01T17:39:00.566 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi061.front.sepia.ceph.com 2023-01-01T17:39:00.566 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-01-01T17:39:00.566 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd of=/etc/ceph/ceph.keyring 2023-01-01T17:39:00.566 DEBUG:teuthology.orchestra.run.smithi061:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-01-01T17:39:00.644 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-01-01T17:39:00.644 DEBUG:teuthology.orchestra.run.smithi061:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-01-01T17:39:00.701 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi149.front.sepia.ceph.com 2023-01-01T17:39:00.701 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-01T17:39:00.701 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/ceph/ceph.keyring 2023-01-01T17:39:00.701 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-01-01T17:39:00.745 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-01T17:39:00.745 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-01-01T17:39:00.804 INFO:tasks.ceph:Setting up mon nodes... 2023-01-01T17:39:00.804 INFO:tasks.ceph:Setting up mgr nodes... 2023-01-01T17:39:00.804 DEBUG:teuthology.orchestra.run.smithi061:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-01-01T17:39:00.858 INFO:teuthology.orchestra.run.smithi061.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-01-01T17:39:00.861 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-01-01T17:39:01.222 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-01-01T17:39:01.225 INFO:tasks.ceph:Setting up mds nodes... 2023-01-01T17:39:01.225 DEBUG:teuthology.orchestra.run.smithi061:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-01-01T17:39:01.280 INFO:teuthology.orchestra.run.smithi061.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-01-01T17:39:01.283 DEBUG:teuthology.orchestra.run.smithi061:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-01-01T17:39:01.313 DEBUG:teuthology.orchestra.run.smithi061:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-01-01T17:39:01.408 INFO:teuthology.orchestra.run.smithi061.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-01-01T17:39:01.410 DEBUG:teuthology.orchestra.run.smithi061:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-01-01T17:39:01.437 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-01-01T17:39:01.504 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-01-01T17:39:01.506 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-01-01T17:39:01.535 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-01-01T17:39:01.631 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-01-01T17:39:01.633 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-01-01T17:39:01.660 INFO:tasks.ceph_client:Setting up client nodes... 2023-01-01T17:39:01.660 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-01-01T17:39:01.705 INFO:teuthology.orchestra.run.smithi061.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-01-01T17:39:01.718 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-01-01T17:39:01.761 INFO:teuthology.orchestra.run.smithi149.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-01-01T17:39:01.774 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-01-01T17:39:01.774 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi061.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi149.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-01-01T17:39:01.774 DEBUG:teuthology.orchestra.run.smithi061:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-01-01T17:39:01.801 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-01T17:39:01.802 INFO:tasks.ceph:role: osd.0 2023-01-01T17:39:01.802 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi061.front.sepia.ceph.com 2023-01-01T17:39:01.802 DEBUG:teuthology.orchestra.run.smithi061:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-01-01T17:39:01.876 INFO:teuthology.orchestra.run.smithi061.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-01-01T17:39:01.876 INFO:teuthology.orchestra.run.smithi061.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-01T17:39:01.877 INFO:teuthology.orchestra.run.smithi061.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-01T17:39:01.877 INFO:teuthology.orchestra.run.smithi061.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-01T17:39:01.877 INFO:teuthology.orchestra.run.smithi061.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-01T17:39:01.877 INFO:teuthology.orchestra.run.smithi061.stdout: = sunit=0 swidth=0 blks 2023-01-01T17:39:01.877 INFO:teuthology.orchestra.run.smithi061.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-01T17:39:01.877 INFO:teuthology.orchestra.run.smithi061.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-01T17:39:01.877 INFO:teuthology.orchestra.run.smithi061.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-01T17:39:01.877 INFO:teuthology.orchestra.run.smithi061.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-01T17:39:02.317 INFO:teuthology.orchestra.run.smithi061.stdout:Discarding blocks...Done. 2023-01-01T17:39:02.317 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi061.front.sepia.ceph.com -o noatime 2023-01-01T17:39:02.318 DEBUG:teuthology.orchestra.run.smithi061:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-01-01T17:39:02.499 DEBUG:teuthology.orchestra.run.smithi061:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-01-01T17:39:02.538 DEBUG:teuthology.orchestra.run.smithi061:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-01-01T17:39:02.608 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-01T17:39:02.608 INFO:tasks.ceph:role: osd.1 2023-01-01T17:39:02.608 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi061.front.sepia.ceph.com 2023-01-01T17:39:02.608 DEBUG:teuthology.orchestra.run.smithi061:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-01-01T17:39:02.684 INFO:teuthology.orchestra.run.smithi061.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-01-01T17:39:02.684 INFO:teuthology.orchestra.run.smithi061.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-01T17:39:02.684 INFO:teuthology.orchestra.run.smithi061.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-01T17:39:02.684 INFO:teuthology.orchestra.run.smithi061.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-01T17:39:02.684 INFO:teuthology.orchestra.run.smithi061.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-01T17:39:02.684 INFO:teuthology.orchestra.run.smithi061.stdout: = sunit=0 swidth=0 blks 2023-01-01T17:39:02.684 INFO:teuthology.orchestra.run.smithi061.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-01T17:39:02.685 INFO:teuthology.orchestra.run.smithi061.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-01T17:39:02.685 INFO:teuthology.orchestra.run.smithi061.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-01T17:39:02.685 INFO:teuthology.orchestra.run.smithi061.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-01T17:39:03.102 INFO:teuthology.orchestra.run.smithi061.stdout:Discarding blocks...Done. 2023-01-01T17:39:03.104 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi061.front.sepia.ceph.com -o noatime 2023-01-01T17:39:03.105 DEBUG:teuthology.orchestra.run.smithi061:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-01-01T17:39:03.223 DEBUG:teuthology.orchestra.run.smithi061:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-01-01T17:39:03.258 DEBUG:teuthology.orchestra.run.smithi061:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-01-01T17:39:03.329 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-01T17:39:03.329 INFO:tasks.ceph:role: osd.2 2023-01-01T17:39:03.329 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi061.front.sepia.ceph.com 2023-01-01T17:39:03.330 DEBUG:teuthology.orchestra.run.smithi061:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-01-01T17:39:03.406 INFO:teuthology.orchestra.run.smithi061.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-01-01T17:39:03.406 INFO:teuthology.orchestra.run.smithi061.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-01T17:39:03.407 INFO:teuthology.orchestra.run.smithi061.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-01T17:39:03.407 INFO:teuthology.orchestra.run.smithi061.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-01T17:39:03.407 INFO:teuthology.orchestra.run.smithi061.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-01T17:39:03.407 INFO:teuthology.orchestra.run.smithi061.stdout: = sunit=0 swidth=0 blks 2023-01-01T17:39:03.407 INFO:teuthology.orchestra.run.smithi061.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-01T17:39:03.407 INFO:teuthology.orchestra.run.smithi061.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-01T17:39:03.407 INFO:teuthology.orchestra.run.smithi061.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-01T17:39:03.407 INFO:teuthology.orchestra.run.smithi061.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-01T17:39:03.853 INFO:teuthology.orchestra.run.smithi061.stdout:Discarding blocks...Done. 2023-01-01T17:39:03.858 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi061.front.sepia.ceph.com -o noatime 2023-01-01T17:39:03.859 DEBUG:teuthology.orchestra.run.smithi061:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-01-01T17:39:03.998 DEBUG:teuthology.orchestra.run.smithi061:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-01-01T17:39:04.035 DEBUG:teuthology.orchestra.run.smithi061:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-01-01T17:39:04.106 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-01T17:39:04.106 INFO:tasks.ceph:role: osd.3 2023-01-01T17:39:04.107 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi061.front.sepia.ceph.com 2023-01-01T17:39:04.107 DEBUG:teuthology.orchestra.run.smithi061:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-01-01T17:39:04.185 INFO:teuthology.orchestra.run.smithi061.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-01-01T17:39:04.185 INFO:teuthology.orchestra.run.smithi061.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-01T17:39:04.185 INFO:teuthology.orchestra.run.smithi061.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-01T17:39:04.185 INFO:teuthology.orchestra.run.smithi061.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-01T17:39:04.185 INFO:teuthology.orchestra.run.smithi061.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-01T17:39:04.185 INFO:teuthology.orchestra.run.smithi061.stdout: = sunit=0 swidth=0 blks 2023-01-01T17:39:04.185 INFO:teuthology.orchestra.run.smithi061.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-01T17:39:04.185 INFO:teuthology.orchestra.run.smithi061.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-01T17:39:04.185 INFO:teuthology.orchestra.run.smithi061.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-01T17:39:04.185 INFO:teuthology.orchestra.run.smithi061.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-01T17:39:04.640 INFO:teuthology.orchestra.run.smithi061.stdout:Discarding blocks...Done. 2023-01-01T17:39:04.642 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi061.front.sepia.ceph.com -o noatime 2023-01-01T17:39:04.642 DEBUG:teuthology.orchestra.run.smithi061:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-01-01T17:39:04.816 DEBUG:teuthology.orchestra.run.smithi061:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-01-01T17:39:04.856 DEBUG:teuthology.orchestra.run.smithi061:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-01T17:39:04.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:04.973+0000 7fc475e955c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-01-01T17:39:04.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:04.974+0000 7fc475e955c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-01-01T17:39:04.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:04.974+0000 7fc475e955c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-01-01T17:39:04.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:04.974+0000 7fc475e955c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-01-01T17:39:04.975 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:04.974+0000 7fc475e955c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-01-01T17:39:04.976 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:04.974+0000 7fc475e955c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-01-01T17:39:05.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:05.510+0000 7fc475e955c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-01T17:39:06.273 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:06.274+0000 7fc475e955c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-01T17:39:07.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:07.040+0000 7fc475e955c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-01T17:39:07.843 DEBUG:teuthology.orchestra.run.smithi061:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-01-01T17:39:07.875 DEBUG:teuthology.orchestra.run.smithi061:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-01T17:39:07.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:07.968+0000 7f838a6635c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-01-01T17:39:07.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:07.968+0000 7f838a6635c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-01-01T17:39:07.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:07.968+0000 7f838a6635c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-01-01T17:39:07.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:07.968+0000 7f838a6635c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-01-01T17:39:07.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:07.968+0000 7f838a6635c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-01-01T17:39:07.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:07.969+0000 7f838a6635c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-01-01T17:39:08.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:08.507+0000 7f838a6635c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-01T17:39:09.267 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:09.268+0000 7f838a6635c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-01T17:39:10.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:10.032+0000 7f838a6635c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-01T17:39:10.833 DEBUG:teuthology.orchestra.run.smithi061:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-01-01T17:39:10.866 DEBUG:teuthology.orchestra.run.smithi061:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-01T17:39:10.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:10.957+0000 7fb2cc1ba5c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-01-01T17:39:10.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:10.958+0000 7fb2cc1ba5c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-01-01T17:39:10.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:10.958+0000 7fb2cc1ba5c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-01-01T17:39:10.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:10.958+0000 7fb2cc1ba5c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-01-01T17:39:10.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:10.958+0000 7fb2cc1ba5c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-01-01T17:39:10.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:10.958+0000 7fb2cc1ba5c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-01-01T17:39:11.488 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:11.488+0000 7fb2cc1ba5c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-01T17:39:12.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:12.253+0000 7fb2cc1ba5c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-01T17:39:13.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:13.024+0000 7fb2cc1ba5c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-01T17:39:13.823 DEBUG:teuthology.orchestra.run.smithi061:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-01-01T17:39:13.856 DEBUG:teuthology.orchestra.run.smithi061:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-01T17:39:13.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:13.948+0000 7fb7995485c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-01-01T17:39:13.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:13.948+0000 7fb7995485c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-01-01T17:39:13.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:13.948+0000 7fb7995485c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-01-01T17:39:13.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:13.948+0000 7fb7995485c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-01-01T17:39:13.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:13.948+0000 7fb7995485c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-01-01T17:39:13.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:13.949+0000 7fb7995485c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-01-01T17:39:14.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:14.479+0000 7fb7995485c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-01T17:39:15.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:15.247+0000 7fb7995485c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-01T17:39:16.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:16.016+0000 7fb7995485c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-01T17:39:16.831 DEBUG:teuthology.orchestra.run.smithi061:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-01-01T17:39:16.864 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-01-01T17:39:16.897 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-01T17:39:16.897 INFO:tasks.ceph:role: osd.4 2023-01-01T17:39:16.897 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi149.front.sepia.ceph.com 2023-01-01T17:39:16.897 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-01-01T17:39:16.975 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-01-01T17:39:16.975 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-01T17:39:16.975 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-01T17:39:16.975 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-01T17:39:16.975 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-01T17:39:16.975 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2023-01-01T17:39:16.975 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-01T17:39:16.976 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-01T17:39:16.976 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-01T17:39:16.976 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-01T17:39:17.406 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2023-01-01T17:39:17.408 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2023-01-01T17:39:17.409 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-01-01T17:39:17.600 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-01-01T17:39:17.638 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-01-01T17:39:17.710 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-01T17:39:17.710 INFO:tasks.ceph:role: osd.5 2023-01-01T17:39:17.710 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi149.front.sepia.ceph.com 2023-01-01T17:39:17.710 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-01-01T17:39:17.785 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-01-01T17:39:17.785 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-01T17:39:17.785 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-01T17:39:17.785 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-01T17:39:17.786 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-01T17:39:17.786 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2023-01-01T17:39:17.786 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-01T17:39:17.786 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-01T17:39:17.786 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-01T17:39:17.786 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-01T17:39:18.201 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2023-01-01T17:39:18.202 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2023-01-01T17:39:18.202 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-01-01T17:39:18.310 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-01-01T17:39:18.341 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-01-01T17:39:18.409 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-01T17:39:18.409 INFO:tasks.ceph:role: osd.6 2023-01-01T17:39:18.409 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi149.front.sepia.ceph.com 2023-01-01T17:39:18.409 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-01-01T17:39:18.483 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-01-01T17:39:18.483 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-01T17:39:18.483 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-01T17:39:18.484 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-01T17:39:18.484 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-01T17:39:18.484 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2023-01-01T17:39:18.484 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-01T17:39:18.484 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-01T17:39:18.484 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-01T17:39:18.484 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-01T17:39:18.928 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2023-01-01T17:39:18.934 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2023-01-01T17:39:18.934 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-01-01T17:39:19.088 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-01-01T17:39:19.124 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-01-01T17:39:19.192 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-01T17:39:19.193 INFO:tasks.ceph:role: osd.7 2023-01-01T17:39:19.193 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi149.front.sepia.ceph.com 2023-01-01T17:39:19.193 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-01-01T17:39:19.267 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-01-01T17:39:19.267 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-01T17:39:19.267 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-01T17:39:19.267 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-01T17:39:19.267 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-01T17:39:19.267 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2023-01-01T17:39:19.267 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-01T17:39:19.268 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-01T17:39:19.268 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-01T17:39:19.268 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-01T17:39:19.712 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2023-01-01T17:39:19.714 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2023-01-01T17:39:19.714 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-01-01T17:39:19.895 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-01-01T17:39:19.928 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-01T17:39:20.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:20.039+0000 7f22690695c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-01-01T17:39:20.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:20.039+0000 7f22690695c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-01-01T17:39:20.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:20.039+0000 7f22690695c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-01-01T17:39:20.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:20.039+0000 7f22690695c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-01-01T17:39:20.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:20.039+0000 7f22690695c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-01-01T17:39:20.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:20.039+0000 7f22690695c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-01-01T17:39:20.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:20.571+0000 7f22690695c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-01T17:39:21.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:21.339+0000 7f22690695c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-01T17:39:22.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:22.104+0000 7f22690695c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-01T17:39:22.908 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-01-01T17:39:22.938 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-01T17:39:23.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:23.028+0000 7f6d6229d5c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-01-01T17:39:23.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:23.028+0000 7f6d6229d5c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-01-01T17:39:23.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:23.028+0000 7f6d6229d5c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-01-01T17:39:23.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:23.028+0000 7f6d6229d5c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-01-01T17:39:23.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:23.028+0000 7f6d6229d5c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-01-01T17:39:23.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:23.029+0000 7f6d6229d5c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-01-01T17:39:23.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:23.554+0000 7f6d6229d5c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-01T17:39:24.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:24.318+0000 7f6d6229d5c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-01T17:39:25.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:25.084+0000 7f6d6229d5c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-01T17:39:25.888 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-01-01T17:39:25.917 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-01T17:39:26.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:26.006+0000 7f0830a775c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-01-01T17:39:26.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:26.006+0000 7f0830a775c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-01-01T17:39:26.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:26.006+0000 7f0830a775c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-01-01T17:39:26.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:26.006+0000 7f0830a775c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-01-01T17:39:26.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:26.006+0000 7f0830a775c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-01-01T17:39:26.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:26.006+0000 7f0830a775c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-01-01T17:39:26.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:26.535+0000 7f0830a775c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-01T17:39:27.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:27.300+0000 7f0830a775c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-01T17:39:28.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:28.064+0000 7f0830a775c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-01T17:39:28.313 DEBUG:teuthology.orchestra.run.smithi061:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-01-01T17:39:28.317 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-01-01T17:39:28.873 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-01-01T17:39:28.901 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-01T17:39:28.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:28.988+0000 7f2500f9b5c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-01-01T17:39:28.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:28.988+0000 7f2500f9b5c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-01-01T17:39:28.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:28.988+0000 7f2500f9b5c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-01-01T17:39:28.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:28.988+0000 7f2500f9b5c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-01-01T17:39:28.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:28.988+0000 7f2500f9b5c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-01-01T17:39:28.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:28.988+0000 7f2500f9b5c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-01-01T17:39:29.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:29.514+0000 7f2500f9b5c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-01T17:39:30.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:30.279+0000 7f2500f9b5c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-01T17:39:31.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:31.044+0000 7f2500f9b5c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-01T17:39:31.850 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-01-01T17:39:31.881 INFO:tasks.ceph:Reading keys from all nodes... 2023-01-01T17:39:31.881 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-01-01T17:39:31.881 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-01-01T17:39:31.914 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-01-01T17:39:31.914 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-01-01T17:39:31.985 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-01-01T17:39:31.985 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-01-01T17:39:32.055 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-01-01T17:39:32.055 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-01-01T17:39:32.124 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-01-01T17:39:32.124 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-01-01T17:39:32.194 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-01-01T17:39:32.194 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-01-01T17:39:32.262 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-01-01T17:39:32.263 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-01-01T17:39:32.331 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-01T17:39:32.332 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-01-01T17:39:32.363 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-01T17:39:32.363 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-01-01T17:39:32.435 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-01T17:39:32.435 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-01-01T17:39:32.505 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-01T17:39:32.505 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-01-01T17:39:32.575 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-01T17:39:32.575 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-01-01T17:39:32.643 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-01T17:39:32.643 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-01-01T17:39:32.711 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-01T17:39:32.711 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-01-01T17:39:32.779 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-01-01T17:39:32.779 DEBUG:teuthology.orchestra.run.smithi061:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-01-01T17:39:32.800 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-01T17:39:32.800 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-01-01T17:39:32.837 INFO:tasks.ceph:Adding keys to all mons... 2023-01-01T17:39:32.837 DEBUG:teuthology.orchestra.run.smithi061:> sudo tee -a /etc/ceph/ceph.keyring 2023-01-01T17:39:32.842 DEBUG:teuthology.orchestra.run.smithi149:> sudo tee -a /etc/ceph/ceph.keyring 2023-01-01T17:39:32.880 INFO:teuthology.orchestra.run.smithi061.stdout:[mgr.y] 2023-01-01T17:39:32.880 INFO:teuthology.orchestra.run.smithi061.stdout: key = AQA0xbFj4+lAMxAAkAPfWfGhau41e+iVbS1dYQ== 2023-01-01T17:39:32.880 INFO:teuthology.orchestra.run.smithi061.stdout:[mds.a] 2023-01-01T17:39:32.880 INFO:teuthology.orchestra.run.smithi061.stdout: key = AQA1xbFjOd3HEBAAY8/FznEAfLy76B9ZlElQrA== 2023-01-01T17:39:32.880 INFO:teuthology.orchestra.run.smithi061.stdout:[mds.c] 2023-01-01T17:39:32.880 INFO:teuthology.orchestra.run.smithi061.stdout: key = AQA1xbFjektiGBAAmRF0shjocousVSLfBFuJPg== 2023-01-01T17:39:32.880 INFO:teuthology.orchestra.run.smithi061.stdout:[osd.0] 2023-01-01T17:39:32.881 INFO:teuthology.orchestra.run.smithi061.stdout: key = AQA4xbFjNc4ROhAAt46BMbOC0qb5NnPseU/Yow== 2023-01-01T17:39:32.881 INFO:teuthology.orchestra.run.smithi061.stdout:[osd.1] 2023-01-01T17:39:32.881 INFO:teuthology.orchestra.run.smithi061.stdout: key = AQA7xbFjnAHBORAARUt7dviUjSsry1t9cJztow== 2023-01-01T17:39:32.881 INFO:teuthology.orchestra.run.smithi061.stdout:[osd.2] 2023-01-01T17:39:32.881 INFO:teuthology.orchestra.run.smithi061.stdout: key = AQA+xbFjLrorORAAKfEkdz90ag5gDukz0PisGg== 2023-01-01T17:39:32.881 INFO:teuthology.orchestra.run.smithi061.stdout:[osd.3] 2023-01-01T17:39:32.881 INFO:teuthology.orchestra.run.smithi061.stdout: key = AQBBxbFjE4SaOBAAtvfvXNYKSfn/VdIEieGNDA== 2023-01-01T17:39:32.881 INFO:teuthology.orchestra.run.smithi061.stdout:[mgr.x] 2023-01-01T17:39:32.881 INFO:teuthology.orchestra.run.smithi061.stdout: key = AQA1xbFjH29PDRAA8bha/+0utWSTCmlK5KlwCQ== 2023-01-01T17:39:32.881 INFO:teuthology.orchestra.run.smithi061.stdout:[mds.b] 2023-01-01T17:39:32.881 INFO:teuthology.orchestra.run.smithi061.stdout: key = AQA1xbFjqNEZHhAABLw6ociY9L/glxlsdJZUzw== 2023-01-01T17:39:32.882 INFO:teuthology.orchestra.run.smithi061.stdout:[mds.d] 2023-01-01T17:39:32.882 INFO:teuthology.orchestra.run.smithi061.stdout: key = AQA1xbFj6OCtJRAAPqiQbSmSwjnxrzDq6PfwzQ== 2023-01-01T17:39:32.882 INFO:teuthology.orchestra.run.smithi061.stdout:[osd.4] 2023-01-01T17:39:32.882 INFO:teuthology.orchestra.run.smithi061.stdout: key = AQBIxbFjN6tZAhAApuKhiBsjSgoDM0kHFXcANQ== 2023-01-01T17:39:32.882 INFO:teuthology.orchestra.run.smithi061.stdout:[osd.5] 2023-01-01T17:39:32.882 INFO:teuthology.orchestra.run.smithi061.stdout: key = AQBLxbFjaeDGARAAblsZL8XfJrM5rVODR07oyg== 2023-01-01T17:39:32.882 INFO:teuthology.orchestra.run.smithi061.stdout:[osd.6] 2023-01-01T17:39:32.882 INFO:teuthology.orchestra.run.smithi061.stdout: key = AQBOxbFjGNNvABAAfoAqDBEIO+g7qoa9JNgeEQ== 2023-01-01T17:39:32.882 INFO:teuthology.orchestra.run.smithi061.stdout:[osd.7] 2023-01-01T17:39:32.882 INFO:teuthology.orchestra.run.smithi061.stdout: key = AQBQxbFjHBv4OhAA7q0OHS1VB6g6CjwmOETpLQ== 2023-01-01T17:39:32.882 INFO:teuthology.orchestra.run.smithi061.stdout:[client.0] 2023-01-01T17:39:32.883 INFO:teuthology.orchestra.run.smithi061.stdout: key = AQA1xbFjObUeKhAAgbW6sMwPwE7wjtf2XkpTnw== 2023-01-01T17:39:32.883 INFO:teuthology.orchestra.run.smithi061.stdout:[client.1] 2023-01-01T17:39:32.883 INFO:teuthology.orchestra.run.smithi061.stdout: key = AQA1xbFjdU90LRAAlMt2ANMJa007eKRy1JR57g== 2023-01-01T17:39:32.902 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr.y] 2023-01-01T17:39:32.903 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQA0xbFj4+lAMxAAkAPfWfGhau41e+iVbS1dYQ== 2023-01-01T17:39:32.903 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.a] 2023-01-01T17:39:32.903 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQA1xbFjOd3HEBAAY8/FznEAfLy76B9ZlElQrA== 2023-01-01T17:39:32.903 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.c] 2023-01-01T17:39:32.903 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQA1xbFjektiGBAAmRF0shjocousVSLfBFuJPg== 2023-01-01T17:39:32.903 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.0] 2023-01-01T17:39:32.903 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQA4xbFjNc4ROhAAt46BMbOC0qb5NnPseU/Yow== 2023-01-01T17:39:32.903 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.1] 2023-01-01T17:39:32.903 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQA7xbFjnAHBORAARUt7dviUjSsry1t9cJztow== 2023-01-01T17:39:32.903 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.2] 2023-01-01T17:39:32.903 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQA+xbFjLrorORAAKfEkdz90ag5gDukz0PisGg== 2023-01-01T17:39:32.904 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.3] 2023-01-01T17:39:32.904 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBBxbFjE4SaOBAAtvfvXNYKSfn/VdIEieGNDA== 2023-01-01T17:39:32.904 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr.x] 2023-01-01T17:39:32.904 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQA1xbFjH29PDRAA8bha/+0utWSTCmlK5KlwCQ== 2023-01-01T17:39:32.904 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.b] 2023-01-01T17:39:32.904 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQA1xbFjqNEZHhAABLw6ociY9L/glxlsdJZUzw== 2023-01-01T17:39:32.904 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.d] 2023-01-01T17:39:32.904 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQA1xbFj6OCtJRAAPqiQbSmSwjnxrzDq6PfwzQ== 2023-01-01T17:39:32.904 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.4] 2023-01-01T17:39:32.904 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBIxbFjN6tZAhAApuKhiBsjSgoDM0kHFXcANQ== 2023-01-01T17:39:32.904 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.5] 2023-01-01T17:39:32.904 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBLxbFjaeDGARAAblsZL8XfJrM5rVODR07oyg== 2023-01-01T17:39:32.905 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.6] 2023-01-01T17:39:32.905 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBOxbFjGNNvABAAfoAqDBEIO+g7qoa9JNgeEQ== 2023-01-01T17:39:32.905 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.7] 2023-01-01T17:39:32.905 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBQxbFjHBv4OhAA7q0OHS1VB6g6CjwmOETpLQ== 2023-01-01T17:39:32.905 INFO:teuthology.orchestra.run.smithi149.stdout:[client.0] 2023-01-01T17:39:32.905 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQA1xbFjObUeKhAAgbW6sMwPwE7wjtf2XkpTnw== 2023-01-01T17:39:32.905 INFO:teuthology.orchestra.run.smithi149.stdout:[client.1] 2023-01-01T17:39:32.905 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQA1xbFjdU90LRAAlMt2ANMJa007eKRy1JR57g== 2023-01-01T17:39:32.906 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-01T17:39:32.927 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-01T17:39:33.000 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-01-01T17:39:33.002 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-01-01T17:39:33.062 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-01-01T17:39:33.064 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-01-01T17:39:33.120 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-01T17:39:33.126 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-01T17:39:33.180 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-01T17:39:33.182 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-01T17:39:33.236 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-01T17:39:33.239 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-01T17:39:33.291 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-01T17:39:33.294 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-01T17:39:33.347 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-01T17:39:33.350 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-01T17:39:33.403 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-01-01T17:39:33.406 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-01-01T17:39:33.461 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-01-01T17:39:33.463 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-01-01T17:39:33.519 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-01T17:39:33.521 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-01T17:39:33.573 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-01T17:39:33.576 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-01T17:39:33.628 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-01T17:39:33.630 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-01T17:39:33.684 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-01T17:39:33.686 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-01T17:39:33.738 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-01T17:39:33.740 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-01T17:39:33.800 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-01T17:39:33.802 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-01T17:39:33.858 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-01-01T17:39:33.858 DEBUG:teuthology.orchestra.run.smithi061:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-01-01T17:39:33.885 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-01-01T17:39:33.984 DEBUG:teuthology.orchestra.run.smithi061:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-01-01T17:39:34.011 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-01-01T17:39:34.038 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-01-01T17:39:34.137 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-01-01T17:39:34.163 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-01-01T17:39:34.230 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-01-01T17:39:34.327 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-01-01T17:39:34.353 DEBUG:teuthology.orchestra.run.smithi061:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-01-01T17:39:34.355 DEBUG:teuthology.orchestra.run.smithi149:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-01-01T17:39:34.410 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-01-01T17:39:34.410 INFO:tasks.ceph.mon.a:Restarting daemon 2023-01-01T17:39:34.410 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-01-01T17:39:34.412 INFO:tasks.ceph.mon.a:Started 2023-01-01T17:39:34.412 INFO:tasks.ceph.mon.b:Restarting daemon 2023-01-01T17:39:34.412 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-01-01T17:39:34.453 INFO:tasks.ceph.mon.b:Started 2023-01-01T17:39:34.453 INFO:tasks.ceph.mon.c:Restarting daemon 2023-01-01T17:39:34.453 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-01-01T17:39:34.455 INFO:tasks.ceph.mon.c:Started 2023-01-01T17:39:34.455 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-01-01T17:39:34.456 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-01-01T17:39:34.456 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-01-01T17:39:34.458 INFO:tasks.ceph.mgr.y:Started 2023-01-01T17:39:34.458 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-01-01T17:39:34.458 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-01-01T17:39:34.462 INFO:tasks.ceph.mgr.x:Started 2023-01-01T17:39:34.462 INFO:tasks.ceph:Setting crush tunables to default 2023-01-01T17:39:34.462 DEBUG:teuthology.orchestra.run.smithi061:> sudo ceph --cluster ceph osd crush tunables default 2023-01-01T17:39:34.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.587+0000 7f57a07de700 1 Processor -- start 2023-01-01T17:39:34.588 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.587+0000 7f57a07de700 1 -- start start 2023-01-01T17:39:34.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.588+0000 7f57a07de700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f57980c7260 0x7f57980c3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:34.589 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.588+0000 7f57a07de700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57980c5cf0 0x7f57980c38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:34.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.588+0000 7f57a07de700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f579806dae0 con 0x7f57980c6e90 2023-01-01T17:39:34.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.588+0000 7f57a07de700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57980ba5b0 con 0x7f57980c7260 2023-01-01T17:39:34.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.588+0000 7f57a07de700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579806e550 con 0x7f57980c5cf0 2023-01-01T17:39:34.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.588+0000 7f579dd79700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f57980c7260 0x7f57980c3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:34.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.588+0000 7f579dd79700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f57980c7260 0x7f57980c3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:45328/0 (socket says 172.21.15.61:45328) 2023-01-01T17:39:34.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.588+0000 7f579dd79700 1 -- 172.21.15.61:0/4040515068 learned_addr learned my addr 172.21.15.61:0/4040515068 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:34.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.588+0000 7f579ed7b700 1 --2- 172.21.15.61:0/4040515068 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57980c5cf0 0x7f57980c38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:34.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.588+0000 7f579dd79700 1 -- 172.21.15.61:0/4040515068 >> v2:172.21.15.61:3300/0 conn(0x7f57980c7260 msgr2=0x7f57980c3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-01-01T17:39:34.590 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.588+0000 7f579dd79700 1 -- 172.21.15.61:0/4040515068 >> v2:172.21.15.61:3300/0 conn(0x7f57980c7260 msgr2=0x7f57980c3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:39:34.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.588+0000 7f579dd79700 1 --2- 172.21.15.61:0/4040515068 >> v2:172.21.15.61:3300/0 conn(0x7f57980c7260 0x7f57980c3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:39:34.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.588+0000 7f579ed7b700 1 -- 172.21.15.61:0/4040515068 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57980c5cf0 msgr2=0x7f57980c38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-01-01T17:39:34.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.588+0000 7f579ed7b700 1 -- 172.21.15.61:0/4040515068 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57980c5cf0 msgr2=0x7f57980c38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:39:34.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.588+0000 7f579ed7b700 1 --2- 172.21.15.61:0/4040515068 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57980c5cf0 0x7f57980c38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:39:34.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.588+0000 7f579dd79700 1 --2- 172.21.15.61:0/4040515068 >> v2:172.21.15.61:3300/0 conn(0x7f57980c7260 0x7f57980c3370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:39:34.591 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.588+0000 7f579ed7b700 1 --2- 172.21.15.61:0/4040515068 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57980c5cf0 0x7f57980c38b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:39:34.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.771+0000 7f579d578700 1 -- 172.21.15.61:0/4040515068 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 266954236 0 0) 0x7f579806dae0 con 0x7f57980c6e90 2023-01-01T17:39:34.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.771+0000 7f579d578700 1 -- 172.21.15.61:0/4040515068 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57840035b0 con 0x7f57980c6e90 2023-01-01T17:39:34.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.771+0000 7f579d578700 1 -- 172.21.15.61:0/4040515068 <== mon.1 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1850435315 0 0) 0x7f57840035b0 con 0x7f57980c6e90 2023-01-01T17:39:34.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.771+0000 7f579d578700 1 -- 172.21.15.61:0/4040515068 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57980c5cf0 msgr2=0x7f57980c38b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:39:34.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.771+0000 7f579d578700 1 --2- 172.21.15.61:0/4040515068 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57980c5cf0 0x7f57980c38b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:34.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.772+0000 7f579d578700 1 -- 172.21.15.61:0/4040515068 >> v2:172.21.15.61:3300/0 conn(0x7f57980c7260 msgr2=0x7f57980c3370 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:39:34.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.772+0000 7f579d578700 1 --2- 172.21.15.61:0/4040515068 >> v2:172.21.15.61:3300/0 conn(0x7f57980c7260 0x7f57980c3370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:34.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.772+0000 7f579d578700 1 -- 172.21.15.61:0/4040515068 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579806e830 con 0x7f57980c6e90 2023-01-01T17:39:34.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.772+0000 7f579d578700 1 -- 172.21.15.61:0/4040515068 <== mon.1 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586489653 0 0) 0x7f57900019f0 con 0x7f57980c6e90 2023-01-01T17:39:34.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.772+0000 7f579d578700 1 -- 172.21.15.61:0/4040515068 >> v1:172.21.15.149:6789/0 conn(0x7f57980c6e90 legacy=0x7f57980c55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:34.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.772+0000 7f579d578700 1 --2- 172.21.15.61:0/4040515068 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5784003a00 0x7f5784003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:34.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.772+0000 7f579d578700 1 --2- 172.21.15.61:0/4040515068 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57980c5cf0 0x7f5784004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:34.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.772+0000 7f579d578700 1 --2- 172.21.15.61:0/4040515068 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5784004d90 0x7f5784005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:34.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.772+0000 7f579d578700 1 -- 172.21.15.61:0/4040515068 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57980ba5b0 con 0x7f5784004d90 2023-01-01T17:39:34.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.772+0000 7f579d578700 1 -- 172.21.15.61:0/4040515068 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579806e550 con 0x7f5784003a00 2023-01-01T17:39:34.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.772+0000 7f579d578700 1 -- 172.21.15.61:0/4040515068 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578400bb40 con 0x7f57980c5cf0 2023-01-01T17:39:34.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.772+0000 7f579ed7b700 1 --2- 172.21.15.61:0/4040515068 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5784004d90 0x7f5784005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:34.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.772+0000 7f579e57a700 1 --2- 172.21.15.61:0/4040515068 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5784003a00 0x7f5784003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:34.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.772+0000 7f579dd79700 1 --2- 172.21.15.61:0/4040515068 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57980c5cf0 0x7f5784004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:34.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.772+0000 7f579ed7b700 1 -- 172.21.15.61:0/4040515068 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57980c5cf0 msgr2=0x7f5784004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:34.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.772+0000 7f579ed7b700 1 --2- 172.21.15.61:0/4040515068 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57980c5cf0 0x7f5784004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:34.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.772+0000 7f579ed7b700 1 -- 172.21.15.61:0/4040515068 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5784003a00 msgr2=0x7f5784003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:34.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.772+0000 7f579ed7b700 1 --2- 172.21.15.61:0/4040515068 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5784003a00 0x7f5784003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:34.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.772+0000 7f579ed7b700 1 -- 172.21.15.61:0/4040515068 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57840035b0 con 0x7f5784004d90 2023-01-01T17:39:34.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.772+0000 7f579dd79700 1 --2- 172.21.15.61:0/4040515068 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f57980c5cf0 0x7f5784004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-01-01T17:39:34.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.772+0000 7f579ed7b700 1 --2- 172.21.15.61:0/4040515068 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5784004d90 0x7f5784005200 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5794009840 tx=0x7f5784005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63342082d9b5db39 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:34.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.773+0000 7f579d578700 1 -- 172.21.15.61:0/4040515068 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579400c070 con 0x7f5784004d90 2023-01-01T17:39:34.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.773+0000 7f579d578700 1 -- 172.21.15.61:0/4040515068 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5794004230 con 0x7f5784004d90 2023-01-01T17:39:34.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.773+0000 7f579d578700 1 -- 172.21.15.61:0/4040515068 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57940036a0 con 0x7f5784004d90 2023-01-01T17:39:34.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.773+0000 7f57a07de700 1 -- 172.21.15.61:0/4040515068 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5784004d90 msgr2=0x7f5784005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:34.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.773+0000 7f57a07de700 1 --2- 172.21.15.61:0/4040515068 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5784004d90 0x7f5784005200 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5794009840 tx=0x7f5784005880 comp rx=0 tx=0).stop 2023-01-01T17:39:34.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.773+0000 7f579ed7b700 1 -- 172.21.15.61:0/4040515068 reap_dead start 2023-01-01T17:39:34.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.773+0000 7f57a07de700 1 -- 172.21.15.61:0/4040515068 shutdown_connections 2023-01-01T17:39:34.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.773+0000 7f57a07de700 1 -- 172.21.15.61:0/4040515068 >> 172.21.15.61:0/4040515068 conn(0x7f5798070ad0 msgr2=0x7f5798070ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:34.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.774+0000 7f57a07de700 1 -- 172.21.15.61:0/4040515068 shutdown_connections 2023-01-01T17:39:34.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.774+0000 7f57a07de700 1 -- 172.21.15.61:0/4040515068 wait complete. 2023-01-01T17:39:34.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.775+0000 7f57a07de700 1 Processor -- start 2023-01-01T17:39:34.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.775+0000 7f57a07de700 1 -- start start 2023-01-01T17:39:34.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.776+0000 7f57a07de700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5784004d90 0x7f57981dc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:34.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.776+0000 7f57a07de700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f579806df70 0x7f57981e72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:34.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.776+0000 7f57a07de700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f57980aa5a0 0x7f57980bb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:34.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.776+0000 7f57a07de700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57981e77e0 con 0x7f57980aa5a0 2023-01-01T17:39:34.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.776+0000 7f57a07de700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57980ab090 con 0x7f5784004d90 2023-01-01T17:39:34.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.776+0000 7f57a07de700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57980bd750 con 0x7f579806df70 2023-01-01T17:39:34.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.777+0000 7f579e57a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5784004d90 0x7f57981dc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:34.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.777+0000 7f579dd79700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f579806df70 0x7f57981e72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:34.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.777+0000 7f579ed7b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f57980aa5a0 0x7f57980bb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:34.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.777+0000 7f579e57a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5784004d90 0x7f57981dc760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.61:41194/0 (socket says 172.21.15.61:41194) 2023-01-01T17:39:34.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.777+0000 7f579e57a700 1 -- 172.21.15.61:0/4246088577 learned_addr learned my addr 172.21.15.61:0/4246088577 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:34.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.777+0000 7f579ed7b700 1 -- 172.21.15.61:0/4246088577 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f579806df70 msgr2=0x7f57981e72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:34.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.777+0000 7f579ed7b700 1 --2- 172.21.15.61:0/4246088577 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f579806df70 0x7f57981e72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:34.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.777+0000 7f579ed7b700 1 -- 172.21.15.61:0/4246088577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5784004d90 msgr2=0x7f57981dc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:34.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.777+0000 7f579ed7b700 1 --2- 172.21.15.61:0/4246088577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5784004d90 0x7f57981dc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:34.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.777+0000 7f579ed7b700 1 -- 172.21.15.61:0/4246088577 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579806d770 con 0x7f57980aa5a0 2023-01-01T17:39:34.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.777+0000 7f579ed7b700 1 --2- 172.21.15.61:0/4246088577 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f57980aa5a0 0x7f57980bb7a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5794017000 tx=0x7f57940047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:34.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.777+0000 7f578effd700 1 -- 172.21.15.61:0/4246088577 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5794003be0 con 0x7f57980aa5a0 2023-01-01T17:39:34.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.777+0000 7f57a07de700 1 -- 172.21.15.61:0/4246088577 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f579806eb10 con 0x7f57980aa5a0 2023-01-01T17:39:34.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.777+0000 7f578effd700 1 -- 172.21.15.61:0/4246088577 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5794003d80 con 0x7f57980aa5a0 2023-01-01T17:39:34.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.777+0000 7f578effd700 1 -- 172.21.15.61:0/4246088577 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5794027680 con 0x7f57980aa5a0 2023-01-01T17:39:34.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.777+0000 7f57a07de700 1 -- 172.21.15.61:0/4246088577 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f579806d400 con 0x7f57980aa5a0 2023-01-01T17:39:34.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.778+0000 7f578effd700 1 -- 172.21.15.61:0/4246088577 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f5794019020 con 0x7f57980aa5a0 2023-01-01T17:39:34.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.778+0000 7f578effd700 1 -- 172.21.15.61:0/4246088577 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f579401e940 con 0x7f57980aa5a0 2023-01-01T17:39:34.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.778+0000 7f57a07de700 1 -- 172.21.15.61:0/4246088577 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57981dc480 con 0x7f57980aa5a0 2023-01-01T17:39:34.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.781+0000 7f578effd700 1 -- 172.21.15.61:0/4246088577 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71767 (secure 0 0 0) 0x7f57981dc480 con 0x7f57980aa5a0 2023-01-01T17:39:34.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.858+0000 7f57a07de700 1 -- 172.21.15.61:0/4246088577 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f57980668a0 con 0x7f57980aa5a0 2023-01-01T17:39:34.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.865+0000 7f578effd700 1 -- 172.21.15.61:0/4246088577 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f578800f040 con 0x7f57980aa5a0 2023-01-01T17:39:34.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.866+0000 7f57a07de700 1 -- 172.21.15.61:0/4246088577 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f57980aa5a0 msgr2=0x7f57980bb7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:34.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.866+0000 7f57a07de700 1 --2- 172.21.15.61:0/4246088577 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f57980aa5a0 0x7f57980bb7a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5794017000 tx=0x7f57940047c0 comp rx=0 tx=0).stop 2023-01-01T17:39:34.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.866+0000 7f57a07de700 1 -- 172.21.15.61:0/4246088577 shutdown_connections 2023-01-01T17:39:34.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.866+0000 7f57a07de700 1 --2- 172.21.15.61:0/4246088577 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f57980aa5a0 0x7f57980bb7a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:34.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.866+0000 7f57a07de700 1 --2- 172.21.15.61:0/4246088577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5784004d90 0x7f57981dc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:34.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.866+0000 7f57a07de700 1 --2- 172.21.15.61:0/4246088577 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f579806df70 0x7f57981e72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:34.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.866+0000 7f57a07de700 1 -- 172.21.15.61:0/4246088577 >> 172.21.15.61:0/4246088577 conn(0x7f5798070ad0 msgr2=0x7f57980abb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:34.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.866+0000 7f57a07de700 1 -- 172.21.15.61:0/4246088577 shutdown_connections 2023-01-01T17:39:34.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:34.866+0000 7f57a07de700 1 -- 172.21.15.61:0/4246088577 wait complete. 2023-01-01T17:39:34.868 INFO:teuthology.orchestra.run.smithi061.stderr:adjusted tunables profile to default 2023-01-01T17:39:34.878 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-01-01T17:39:34.878 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-01-01T17:39:34.879 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-01-01T17:39:34.892 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-01-01T17:39:34.891+0000 7fcece137200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-01-01T17:39:34.905 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-01-01T17:39:34.905 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-01-01T17:39:34.960 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-01-01T17:39:34.959+0000 7fcece137200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-01-01T17:39:34.972 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-01-01T17:39:34.973 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-01-01T17:39:35.039 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-01-01T17:39:35.039+0000 7fcece137200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-01-01T17:39:35.040 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-01-01T17:39:35.040 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-01-01T17:39:35.109 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-01T17:39:35.110 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-01-01T17:39:35.124 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-01-01T17:39:35.124+0000 7fcece137200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-01-01T17:39:35.137 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-01T17:39:35.137 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-01-01T17:39:35.203 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-01T17:39:35.208 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-01-01T17:39:35.254 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-01T17:39:35.254+0000 7f0b100eb200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-01-01T17:39:35.270 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-01T17:39:35.270 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-01-01T17:39:35.271 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-01-01T17:39:35.269+0000 7fcece137200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-01-01T17:39:35.321 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-01T17:39:35.320+0000 7f0b100eb200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-01-01T17:39:35.336 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 5ba13bcd-4407-4cfd-8487-80917501e525 0 2023-01-01T17:39:35.398 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-01T17:39:35.398+0000 7f0b100eb200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-01-01T17:39:35.481 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-01T17:39:35.481+0000 7f0b100eb200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-01-01T17:39:35.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.498+0000 7f1ceb156700 1 Processor -- start 2023-01-01T17:39:35.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.498+0000 7f1ceb156700 1 -- start start 2023-01-01T17:39:35.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.499+0000 7f1ceb156700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ce414e190 0x7f1ce40c3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:35.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.499+0000 7f1ceb156700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1ce40a83c0 0x7f1ce40c0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:35.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.499+0000 7f1ceb156700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1ce40c1390 0x7f1ce40c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:35.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.499+0000 7f1ceb156700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce406acc0 con 0x7f1ce40c1390 2023-01-01T17:39:35.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.499+0000 7f1ceb156700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce40bfdb0 con 0x7f1ce40a83c0 2023-01-01T17:39:35.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.499+0000 7f1ceb156700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce40c0090 con 0x7f1ce414e190 2023-01-01T17:39:35.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.499+0000 7f1ce8ef2700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ce414e190 0x7f1ce40c3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:35.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.499+0000 7f1ce3fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1ce40a83c0 0x7f1ce40c0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:35.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.499+0000 7f1ce8ef2700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ce414e190 0x7f1ce40c3210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:39932/0 (socket says 172.21.15.149:39932) 2023-01-01T17:39:35.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.499+0000 7f1ce8ef2700 1 -- 172.21.15.149:0/2746359244 learned_addr learned my addr 172.21.15.149:0/2746359244 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-01-01T17:39:35.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.499+0000 7f1ce96f3700 1 --2- 172.21.15.149:0/2746359244 >> v2:172.21.15.61:3300/0 conn(0x7f1ce40c1390 0x7f1ce40c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:35.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.499+0000 7f1ce8ef2700 1 -- 172.21.15.149:0/2746359244 >> v2:172.21.15.149:3300/0 conn(0x7f1ce40a83c0 msgr2=0x7f1ce40c0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:35.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.499+0000 7f1ce8ef2700 1 --2- 172.21.15.149:0/2746359244 >> v2:172.21.15.149:3300/0 conn(0x7f1ce40a83c0 0x7f1ce40c0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:35.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.499+0000 7f1ce8ef2700 1 -- 172.21.15.149:0/2746359244 >> v2:172.21.15.61:3300/0 conn(0x7f1ce40c1390 msgr2=0x7f1ce40c5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:35.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.499+0000 7f1ce8ef2700 1 --2- 172.21.15.149:0/2746359244 >> v2:172.21.15.61:3300/0 conn(0x7f1ce40c1390 0x7f1ce40c5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:35.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.499+0000 7f1ce8ef2700 1 -- 172.21.15.149:0/2746359244 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce40c0370 con 0x7f1ce414e190 2023-01-01T17:39:35.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.499+0000 7f1ce96f3700 1 --2- 172.21.15.149:0/2746359244 >> v2:172.21.15.61:3300/0 conn(0x7f1ce40c1390 0x7f1ce40c5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-01T17:39:35.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.499+0000 7f1ce3fff700 1 --2- 172.21.15.149:0/2746359244 >> v2:172.21.15.149:3300/0 conn(0x7f1ce40a83c0 0x7f1ce40c0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-01-01T17:39:35.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.499+0000 7f1ce8ef2700 1 --2- 172.21.15.149:0/2746359244 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ce414e190 0x7f1ce40c3210 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1ce406ee50 tx=0x7f1cd8009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea76e4e31d821541 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:35.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.499+0000 7f1ce37fe700 1 -- 172.21.15.149:0/2746359244 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8011830 con 0x7f1ce414e190 2023-01-01T17:39:35.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.500+0000 7f1ce37fe700 1 -- 172.21.15.149:0/2746359244 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd8011990 con 0x7f1ce414e190 2023-01-01T17:39:35.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.500+0000 7f1ce37fe700 1 -- 172.21.15.149:0/2746359244 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8011d20 con 0x7f1ce414e190 2023-01-01T17:39:35.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.500+0000 7f1ceb156700 1 -- 172.21.15.149:0/2746359244 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ce414e190 msgr2=0x7f1ce40c3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:35.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.500+0000 7f1ceb156700 1 --2- 172.21.15.149:0/2746359244 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ce414e190 0x7f1ce40c3210 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1ce406ee50 tx=0x7f1cd8009bd0 comp rx=0 tx=0).stop 2023-01-01T17:39:35.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.500+0000 7f1ceb156700 1 -- 172.21.15.149:0/2746359244 shutdown_connections 2023-01-01T17:39:35.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.500+0000 7f1ceb156700 1 --2- 172.21.15.149:0/2746359244 >> v2:172.21.15.61:3300/0 conn(0x7f1ce40c1390 0x7f1ce40c5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:35.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.500+0000 7f1ceb156700 1 --2- 172.21.15.149:0/2746359244 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ce414e190 0x7f1ce40c3210 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:35.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.500+0000 7f1ceb156700 1 --2- 172.21.15.149:0/2746359244 >> v2:172.21.15.149:3300/0 conn(0x7f1ce40a83c0 0x7f1ce40c0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:35.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.500+0000 7f1ceb156700 1 -- 172.21.15.149:0/2746359244 >> 172.21.15.149:0/2746359244 conn(0x7f1ce40c2a40 msgr2=0x7f1ce40c5310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:35.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.500+0000 7f1ceb156700 1 -- 172.21.15.149:0/2746359244 shutdown_connections 2023-01-01T17:39:35.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.500+0000 7f1ceb156700 1 -- 172.21.15.149:0/2746359244 wait complete. 2023-01-01T17:39:35.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.501+0000 7f1ceb156700 1 Processor -- start 2023-01-01T17:39:35.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.501+0000 7f1ceb156700 1 -- start start 2023-01-01T17:39:35.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.502+0000 7f1ceb156700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ce40c1390 0x7f1ce41432a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:35.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.502+0000 7f1ceb156700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ce414e190 0x7f1ce41478b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:35.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.502+0000 7f1ceb156700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ce40bf590 0x7f1ce413bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:35.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.502+0000 7f1ceb156700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce4144eb0 con 0x7f1ce414e190 2023-01-01T17:39:35.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.502+0000 7f1ceb156700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce41437e0 con 0x7f1ce40c1390 2023-01-01T17:39:35.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.502+0000 7f1ceb156700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce41459c0 con 0x7f1ce40bf590 2023-01-01T17:39:35.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.502+0000 7f1ce8ef2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ce40c1390 0x7f1ce41432a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:35.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.502+0000 7f1ce96f3700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ce40bf590 0x7f1ce413bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:35.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.502+0000 7f1ce8ef2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ce40c1390 0x7f1ce41432a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:33606/0 (socket says 172.21.15.149:33606) 2023-01-01T17:39:35.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.502+0000 7f1ce8ef2700 1 -- 172.21.15.149:0/245391531 learned_addr learned my addr 172.21.15.149:0/245391531 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-01-01T17:39:35.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.503+0000 7f1ce3fff700 1 --2- 172.21.15.149:0/245391531 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ce414e190 0x7f1ce41478b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:35.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.503+0000 7f1ce8ef2700 1 -- 172.21.15.149:0/245391531 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ce40bf590 msgr2=0x7f1ce413bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:35.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.503+0000 7f1ce8ef2700 1 --2- 172.21.15.149:0/245391531 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ce40bf590 0x7f1ce413bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:35.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.503+0000 7f1ce8ef2700 1 -- 172.21.15.149:0/245391531 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ce414e190 msgr2=0x7f1ce41478b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:35.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.503+0000 7f1ce8ef2700 1 --2- 172.21.15.149:0/245391531 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ce414e190 0x7f1ce41478b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:35.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.503+0000 7f1ce8ef2700 1 -- 172.21.15.149:0/245391531 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd00094a0 con 0x7f1ce40c1390 2023-01-01T17:39:35.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.503+0000 7f1ce96f3700 1 --2- 172.21.15.149:0/245391531 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ce40bf590 0x7f1ce413bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-01-01T17:39:35.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.503+0000 7f1ce3fff700 1 --2- 172.21.15.149:0/245391531 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ce414e190 0x7f1ce41478b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-01-01T17:39:35.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.503+0000 7f1ce8ef2700 1 --2- 172.21.15.149:0/245391531 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ce40c1390 0x7f1ce41432a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8009c10 tx=0x7f1cd8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:35.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.503+0000 7f1ce17fa700 1 -- 172.21.15.149:0/245391531 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8004510 con 0x7f1ce40c1390 2023-01-01T17:39:35.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.503+0000 7f1ce17fa700 1 -- 172.21.15.149:0/245391531 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd801e070 con 0x7f1ce40c1390 2023-01-01T17:39:35.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.503+0000 7f1ceb156700 1 -- 172.21.15.149:0/245391531 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cd8009550 con 0x7f1ce40c1390 2023-01-01T17:39:35.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.503+0000 7f1ce17fa700 1 -- 172.21.15.149:0/245391531 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd80038e0 con 0x7f1ce40c1390 2023-01-01T17:39:35.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.503+0000 7f1ceb156700 1 -- 172.21.15.149:0/245391531 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce40c0930 con 0x7f1ce40c1390 2023-01-01T17:39:35.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.503+0000 7f1ce17fa700 1 -- 172.21.15.149:0/245391531 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f1cd800f050 con 0x7f1ce40c1390 2023-01-01T17:39:35.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.503+0000 7f1ce17fa700 1 -- 172.21.15.149:0/245391531 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1cd8020070 con 0x7f1ce40c1390 2023-01-01T17:39:35.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.504+0000 7f1ceb156700 1 -- 172.21.15.149:0/245391531 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce40c0650 con 0x7f1ce40c1390 2023-01-01T17:39:35.509 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.506+0000 7f1ce17fa700 1 -- 172.21.15.149:0/245391531 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71767 (secure 0 0 0) 0x7f1cd8015020 con 0x7f1ce40c1390 2023-01-01T17:39:35.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.589+0000 7f1ceb156700 1 -- 172.21.15.149:0/245391531 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5ba13bcd-4407-4cfd-8487-80917501e525", "id": 0} v 0) v1 -- 0x7f1ce40c1830 con 0x7f1ce40c1390 2023-01-01T17:39:35.590 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-01-01T17:39:35.589+0000 7fcece137200 -1 mgr[py] Module not found: 'prometheus' 2023-01-01T17:39:35.590 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-01-01T17:39:35.589+0000 7fcece137200 -1 mgr[py] Traceback (most recent call last): 2023-01-01T17:39:35.590 INFO:tasks.ceph.mgr.y.smithi061.stderr: File "/usr/share/ceph/mgr/prometheus/__init__.py", line 2, in 2023-01-01T17:39:35.590 INFO:tasks.ceph.mgr.y.smithi061.stderr: from .module import Module, StandbyModule 2023-01-01T17:39:35.590 INFO:tasks.ceph.mgr.y.smithi061.stderr: File "/usr/share/ceph/mgr/prometheus/module.py", line 3, in 2023-01-01T17:39:35.591 INFO:tasks.ceph.mgr.y.smithi061.stderr: from packaging.version import Version 2023-01-01T17:39:35.591 INFO:tasks.ceph.mgr.y.smithi061.stderr:ModuleNotFoundError: No module named 'packaging' 2023-01-01T17:39:35.591 INFO:tasks.ceph.mgr.y.smithi061.stderr: 2023-01-01T17:39:35.591 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-01-01T17:39:35.590+0000 7fcece137200 -1 mgr[py] Class not found in module 'prometheus' 2023-01-01T17:39:35.591 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-01-01T17:39:35.590+0000 7fcece137200 -1 mgr[py] Error loading module 'prometheus': (2) No such file or directory 2023-01-01T17:39:35.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.595+0000 7f1ce17fa700 1 -- 172.21.15.149:0/245391531 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5ba13bcd-4407-4cfd-8487-80917501e525", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1cd8003a40 con 0x7f1ce40c1390 2023-01-01T17:39:35.595 INFO:teuthology.orchestra.run.smithi149.stdout:0 2023-01-01T17:39:35.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.596+0000 7f1ceb156700 1 -- 172.21.15.149:0/245391531 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ce40c1390 msgr2=0x7f1ce41432a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:35.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.596+0000 7f1ceb156700 1 --2- 172.21.15.149:0/245391531 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ce40c1390 0x7f1ce41432a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8009c10 tx=0x7f1cd8004750 comp rx=0 tx=0).stop 2023-01-01T17:39:35.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.596+0000 7f1ceb156700 1 -- 172.21.15.149:0/245391531 shutdown_connections 2023-01-01T17:39:35.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.596+0000 7f1ceb156700 1 --2- 172.21.15.149:0/245391531 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1ce40bf590 0x7f1ce413bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:35.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.596+0000 7f1ceb156700 1 --2- 172.21.15.149:0/245391531 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ce40c1390 0x7f1ce41432a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:35.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.596+0000 7f1ceb156700 1 --2- 172.21.15.149:0/245391531 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1ce414e190 0x7f1ce41478b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:35.597 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.596+0000 7f1ceb156700 1 -- 172.21.15.149:0/245391531 >> 172.21.15.149:0/245391531 conn(0x7f1ce40c2a40 msgr2=0x7f1ce40c41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:35.597 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.596+0000 7f1ceb156700 1 -- 172.21.15.149:0/245391531 shutdown_connections 2023-01-01T17:39:35.597 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.596+0000 7f1ceb156700 1 -- 172.21.15.149:0/245391531 wait complete. 2023-01-01T17:39:35.609 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 7dca9f34-ea22-4894-b238-5606b16b9c74 1 2023-01-01T17:39:35.628 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-01T17:39:35.628+0000 7f0b100eb200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-01-01T17:39:35.667 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-01-01T17:39:35.666+0000 7fcece137200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-01-01T17:39:35.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.749+0000 7f97a7480700 1 Processor -- start 2023-01-01T17:39:35.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.749+0000 7f97a7480700 1 -- start start 2023-01-01T17:39:35.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.750+0000 7f97a7480700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f97a00c6e90 0x7f97a00c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:35.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.750+0000 7f97a7480700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f97a006df70 0x7f97a00c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:35.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.750+0000 7f97a7480700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a006dae0 con 0x7f97a00c7260 2023-01-01T17:39:35.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.750+0000 7f97a7480700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97a00ba5b0 con 0x7f97a006df70 2023-01-01T17:39:35.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.750+0000 7f97a7480700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97a006e550 con 0x7f97a00c6e90 2023-01-01T17:39:35.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.750+0000 7f97a521c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f97a00c6e90 0x7f97a00c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:35.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.750+0000 7f97a4a1b700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f97a00c7260 0x7f97a01544b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:56172/0 (socket says 172.21.15.149:56172) 2023-01-01T17:39:35.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.750+0000 7f97a4a1b700 1 -- 172.21.15.149:0/3167275695 learned_addr learned my addr 172.21.15.149:0/3167275695 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-01-01T17:39:35.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.750+0000 7f97a5a1d700 1 --2- 172.21.15.149:0/3167275695 >> v2:172.21.15.61:3300/0 conn(0x7f97a006df70 0x7f97a00c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:35.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.750+0000 7f97a521c700 1 -- 172.21.15.149:0/3167275695 >> v2:172.21.15.61:3300/0 conn(0x7f97a006df70 msgr2=0x7f97a00c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:35.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.750+0000 7f97a521c700 1 --2- 172.21.15.149:0/3167275695 >> v2:172.21.15.61:3300/0 conn(0x7f97a006df70 0x7f97a00c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:35.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.750+0000 7f97a521c700 1 -- 172.21.15.149:0/3167275695 >> v1:172.21.15.149:6789/0 conn(0x7f97a00c7260 legacy=0x7f97a01544b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:35.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.750+0000 7f9797fff700 1 -- 172.21.15.149:0/3167275695 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2238262254 0 0) 0x7f97a006dae0 con 0x7f97a00c7260 2023-01-01T17:39:35.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.750+0000 7f97a521c700 1 -- 172.21.15.149:0/3167275695 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a006e830 con 0x7f97a00c6e90 2023-01-01T17:39:35.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.750+0000 7f97a521c700 1 --2- 172.21.15.149:0/3167275695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97a00c6e90 0x7f97a00c55e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f97a0071600 tx=0x7f979c009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e57ad606310aad42 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:35.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.750+0000 7f9797fff700 1 -- 172.21.15.149:0/3167275695 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c011830 con 0x7f97a00c6e90 2023-01-01T17:39:35.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.750+0000 7f9797fff700 1 -- 172.21.15.149:0/3167275695 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979c011990 con 0x7f97a00c6e90 2023-01-01T17:39:35.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.750+0000 7f9797fff700 1 -- 172.21.15.149:0/3167275695 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c011d20 con 0x7f97a00c6e90 2023-01-01T17:39:35.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.751+0000 7f97a7480700 1 -- 172.21.15.149:0/3167275695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97a00c6e90 msgr2=0x7f97a00c55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:35.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.751+0000 7f97a7480700 1 --2- 172.21.15.149:0/3167275695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97a00c6e90 0x7f97a00c55e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f97a0071600 tx=0x7f979c009b20 comp rx=0 tx=0).stop 2023-01-01T17:39:35.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.751+0000 7f97a7480700 1 -- 172.21.15.149:0/3167275695 shutdown_connections 2023-01-01T17:39:35.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.751+0000 7f97a7480700 1 --2- 172.21.15.149:0/3167275695 >> v2:172.21.15.61:3300/0 conn(0x7f97a006df70 0x7f97a00c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:35.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.751+0000 7f97a7480700 1 --2- 172.21.15.149:0/3167275695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97a00c6e90 0x7f97a00c55e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:35.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.751+0000 7f97a7480700 1 -- 172.21.15.149:0/3167275695 >> 172.21.15.149:0/3167275695 conn(0x7f97a0070ad0 msgr2=0x7f97a0070ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:35.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.751+0000 7f97a7480700 1 -- 172.21.15.149:0/3167275695 shutdown_connections 2023-01-01T17:39:35.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.751+0000 7f97a7480700 1 -- 172.21.15.149:0/3167275695 wait complete. 2023-01-01T17:39:35.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.753+0000 7f97a7480700 1 Processor -- start 2023-01-01T17:39:35.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.753+0000 7f97a7480700 1 -- start start 2023-01-01T17:39:35.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.753+0000 7f97a7480700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f97a006df70 0x7f97a01e73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:35.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.753+0000 7f97a7480700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f97a00c6e90 0x7f97a00c08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:35.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.753+0000 7f97a7480700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97a00c7260 0x7f97a014f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:35.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.753+0000 7f97a7480700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a00ad060 con 0x7f97a006df70 2023-01-01T17:39:35.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.753+0000 7f97a7480700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a00ae730 con 0x7f97a00c7260 2023-01-01T17:39:35.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.753+0000 7f97a7480700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a01e7900 con 0x7f97a00c6e90 2023-01-01T17:39:35.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.754+0000 7f97a5a1d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97a00c7260 0x7f97a014f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:35.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.754+0000 7f97a4a1b700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f97a00c6e90 0x7f97a00c08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:35.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.754+0000 7f97a5a1d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97a00c7260 0x7f97a014f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:33622/0 (socket says 172.21.15.149:33622) 2023-01-01T17:39:35.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.754+0000 7f97a5a1d700 1 -- 172.21.15.149:0/2101423350 learned_addr learned my addr 172.21.15.149:0/2101423350 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-01-01T17:39:35.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.754+0000 7f97a521c700 1 --2- 172.21.15.149:0/2101423350 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f97a006df70 0x7f97a01e73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:35.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.754+0000 7f97a5a1d700 1 -- 172.21.15.149:0/2101423350 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f97a00c6e90 msgr2=0x7f97a00c08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:35.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.754+0000 7f97a5a1d700 1 --2- 172.21.15.149:0/2101423350 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f97a00c6e90 0x7f97a00c08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:35.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.754+0000 7f97a5a1d700 1 -- 172.21.15.149:0/2101423350 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f97a006df70 msgr2=0x7f97a01e73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:35.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.754+0000 7f97a5a1d700 1 --2- 172.21.15.149:0/2101423350 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f97a006df70 0x7f97a01e73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:35.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.754+0000 7f97a5a1d700 1 -- 172.21.15.149:0/2101423350 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f979c0094a0 con 0x7f97a00c7260 2023-01-01T17:39:35.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.754+0000 7f97a4a1b700 1 --2- 172.21.15.149:0/2101423350 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f97a00c6e90 0x7f97a00c08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-01-01T17:39:35.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.754+0000 7f97a521c700 1 --2- 172.21.15.149:0/2101423350 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f97a006df70 0x7f97a01e73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-01-01T17:39:35.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.754+0000 7f97a5a1d700 1 --2- 172.21.15.149:0/2101423350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97a00c7260 0x7f97a014f690 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f979800efc0 tx=0x7f979800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:35.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.754+0000 7f9795ffb700 1 -- 172.21.15.149:0/2101423350 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979800cc90 con 0x7f97a00c7260 2023-01-01T17:39:35.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.754+0000 7f9795ffb700 1 -- 172.21.15.149:0/2101423350 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979800f040 con 0x7f97a00c7260 2023-01-01T17:39:35.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.754+0000 7f97a7480700 1 -- 172.21.15.149:0/2101423350 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97a006d770 con 0x7f97a00c7260 2023-01-01T17:39:35.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.754+0000 7f9795ffb700 1 -- 172.21.15.149:0/2101423350 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97980146c0 con 0x7f97a00c7260 2023-01-01T17:39:35.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.754+0000 7f97a7480700 1 -- 172.21.15.149:0/2101423350 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a006eb10 con 0x7f97a00c7260 2023-01-01T17:39:35.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.755+0000 7f9795ffb700 1 -- 172.21.15.149:0/2101423350 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f9798014820 con 0x7f97a00c7260 2023-01-01T17:39:35.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.755+0000 7f9795ffb700 1 -- 172.21.15.149:0/2101423350 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f979801db10 con 0x7f97a00c7260 2023-01-01T17:39:35.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.755+0000 7f97a7480700 1 -- 172.21.15.149:0/2101423350 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97a006d400 con 0x7f97a00c7260 2023-01-01T17:39:35.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.757+0000 7f9795ffb700 1 -- 172.21.15.149:0/2101423350 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71767 (secure 0 0 0) 0x7f979803b870 con 0x7f97a00c7260 2023-01-01T17:39:35.793 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-01-01T17:39:35.792+0000 7fcece137200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-01-01T17:39:35.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.840+0000 7f97a7480700 1 -- 172.21.15.149:0/2101423350 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7dca9f34-ea22-4894-b238-5606b16b9c74", "id": 1} v 0) v1 -- 0x7f97a00668a0 con 0x7f97a00c7260 2023-01-01T17:39:35.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.848+0000 7f9795ffb700 1 -- 172.21.15.149:0/2101423350 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7dca9f34-ea22-4894-b238-5606b16b9c74", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f979802a070 con 0x7f97a00c7260 2023-01-01T17:39:35.848 INFO:teuthology.orchestra.run.smithi149.stdout:1 2023-01-01T17:39:35.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.849+0000 7f97a7480700 1 -- 172.21.15.149:0/2101423350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97a00c7260 msgr2=0x7f97a014f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:35.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.849+0000 7f97a7480700 1 --2- 172.21.15.149:0/2101423350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97a00c7260 0x7f97a014f690 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f979800efc0 tx=0x7f979800c3a0 comp rx=0 tx=0).stop 2023-01-01T17:39:35.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.849+0000 7f97a7480700 1 -- 172.21.15.149:0/2101423350 shutdown_connections 2023-01-01T17:39:35.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.849+0000 7f97a7480700 1 --2- 172.21.15.149:0/2101423350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97a00c7260 0x7f97a014f690 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:35.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.849+0000 7f97a7480700 1 --2- 172.21.15.149:0/2101423350 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f97a006df70 0x7f97a01e73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:35.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.849+0000 7f97a7480700 1 --2- 172.21.15.149:0/2101423350 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f97a00c6e90 0x7f97a00c08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:35.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.849+0000 7f97a7480700 1 -- 172.21.15.149:0/2101423350 >> 172.21.15.149:0/2101423350 conn(0x7f97a0070ad0 msgr2=0x7f97a00a8840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:35.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.849+0000 7f97a7480700 1 -- 172.21.15.149:0/2101423350 shutdown_connections 2023-01-01T17:39:35.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.849+0000 7f97a7480700 1 -- 172.21.15.149:0/2101423350 wait complete. 2023-01-01T17:39:35.861 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 7b43ea06-a7b6-49f4-a390-18ad14dfe4fe 2 2023-01-01T17:39:35.875 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-01-01T17:39:35.875+0000 7fcece137200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-01-01T17:39:35.970 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-01T17:39:35.970+0000 7f0b100eb200 -1 mgr[py] Module not found: 'prometheus' 2023-01-01T17:39:35.971 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-01T17:39:35.970+0000 7f0b100eb200 -1 mgr[py] Traceback (most recent call last): 2023-01-01T17:39:35.971 INFO:tasks.ceph.mgr.x.smithi149.stderr: File "/usr/share/ceph/mgr/prometheus/__init__.py", line 2, in 2023-01-01T17:39:35.971 INFO:tasks.ceph.mgr.x.smithi149.stderr: from .module import Module, StandbyModule 2023-01-01T17:39:35.971 INFO:tasks.ceph.mgr.x.smithi149.stderr: File "/usr/share/ceph/mgr/prometheus/module.py", line 3, in 2023-01-01T17:39:35.971 INFO:tasks.ceph.mgr.x.smithi149.stderr: from packaging.version import Version 2023-01-01T17:39:35.971 INFO:tasks.ceph.mgr.x.smithi149.stderr:ModuleNotFoundError: No module named 'packaging' 2023-01-01T17:39:35.971 INFO:tasks.ceph.mgr.x.smithi149.stderr: 2023-01-01T17:39:35.971 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-01T17:39:35.970+0000 7f0b100eb200 -1 mgr[py] Class not found in module 'prometheus' 2023-01-01T17:39:35.971 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-01T17:39:35.970+0000 7f0b100eb200 -1 mgr[py] Error loading module 'prometheus': (2) No such file or directory 2023-01-01T17:39:35.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.980+0000 7ff5121e9700 1 Processor -- start 2023-01-01T17:39:35.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.981+0000 7ff5121e9700 1 -- start start 2023-01-01T17:39:35.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.981+0000 7ff5121e9700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff50c071750 0x7ff50c14f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:35.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.981+0000 7ff5121e9700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff50c0c4e30 con 0x7ff50c0c64f0 2023-01-01T17:39:35.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.981+0000 7ff5121e9700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff50c1562c0 con 0x7ff50c0c68c0 2023-01-01T17:39:35.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.981+0000 7ff5121e9700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c06de00 con 0x7ff50c071750 2023-01-01T17:39:35.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.981+0000 7ff50bfff700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff50c071750 0x7ff50c14f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:35.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.981+0000 7ff50affd700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7ff50c0c68c0 0x7ff50c1567c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:56184/0 (socket says 172.21.15.149:56184) 2023-01-01T17:39:35.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.981+0000 7ff50affd700 1 -- 172.21.15.149:0/4199605964 learned_addr learned my addr 172.21.15.149:0/4199605964 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-01-01T17:39:35.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.982+0000 7ff50a7fc700 1 -- 172.21.15.149:0/4199605964 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1383732079 0 0) 0x7ff50c1562c0 con 0x7ff50c0c68c0 2023-01-01T17:39:35.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.982+0000 7ff50a7fc700 1 -- 172.21.15.149:0/4199605964 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4f40035b0 con 0x7ff50c0c68c0 2023-01-01T17:39:35.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.982+0000 7ff50bfff700 1 -- 172.21.15.149:0/4199605964 >> v1:172.21.15.149:6789/0 conn(0x7ff50c0c68c0 legacy=0x7ff50c1567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:35.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.982+0000 7ff50bfff700 1 -- 172.21.15.149:0/4199605964 >> v1:172.21.15.61:6789/0 conn(0x7ff50c0c64f0 legacy=0x7ff50c0c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:35.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.982+0000 7ff50bfff700 1 -- 172.21.15.149:0/4199605964 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50c0c5080 con 0x7ff50c071750 2023-01-01T17:39:35.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.982+0000 7ff50bfff700 1 --2- 172.21.15.149:0/4199605964 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff50c071750 0x7ff50c14f9d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff504009dc0 tx=0x7ff50400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa0c648b9f0c8718 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:35.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.982+0000 7ff50a7fc700 1 -- 172.21.15.149:0/4199605964 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50400e070 con 0x7ff50c071750 2023-01-01T17:39:35.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.982+0000 7ff50a7fc700 1 -- 172.21.15.149:0/4199605964 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50400bb20 con 0x7ff50c071750 2023-01-01T17:39:35.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.982+0000 7ff50a7fc700 1 -- 172.21.15.149:0/4199605964 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff504012430 con 0x7ff50c071750 2023-01-01T17:39:35.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.983+0000 7ff5121e9700 1 -- 172.21.15.149:0/4199605964 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff50c071750 msgr2=0x7ff50c14f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:35.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.983+0000 7ff5121e9700 1 --2- 172.21.15.149:0/4199605964 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff50c071750 0x7ff50c14f9d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff504009dc0 tx=0x7ff50400b330 comp rx=0 tx=0).stop 2023-01-01T17:39:35.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.983+0000 7ff5121e9700 1 -- 172.21.15.149:0/4199605964 shutdown_connections 2023-01-01T17:39:35.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.983+0000 7ff5121e9700 1 --2- 172.21.15.149:0/4199605964 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff50c071750 0x7ff50c14f9d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:35.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.983+0000 7ff5121e9700 1 -- 172.21.15.149:0/4199605964 >> 172.21.15.149:0/4199605964 conn(0x7ff50c0a8420 msgr2=0x7ff50c0c5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:35.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.983+0000 7ff5121e9700 1 -- 172.21.15.149:0/4199605964 shutdown_connections 2023-01-01T17:39:35.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.983+0000 7ff5121e9700 1 -- 172.21.15.149:0/4199605964 wait complete. 2023-01-01T17:39:35.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.984+0000 7ff5121e9700 1 Processor -- start 2023-01-01T17:39:35.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.984+0000 7ff5121e9700 1 -- start start 2023-01-01T17:39:35.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.985+0000 7ff5121e9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff50c071750 0x7ff50c155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:35.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.985+0000 7ff5121e9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff50c0c64f0 0x7ff50c06ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:35.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.985+0000 7ff5121e9700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff50c14dc40 0x7ff50c1eba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:35.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.985+0000 7ff5121e9700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c06d810 con 0x7ff50c0c64f0 2023-01-01T17:39:35.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.985+0000 7ff5121e9700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c06bab0 con 0x7ff50c071750 2023-01-01T17:39:35.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.985+0000 7ff5121e9700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c149230 con 0x7ff50c14dc40 2023-01-01T17:39:35.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.985+0000 7ff50b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff50c071750 0x7ff50c155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:35.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.985+0000 7ff50bfff700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff50c14dc40 0x7ff50c1eba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:35.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.985+0000 7ff50b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff50c071750 0x7ff50c155c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:33630/0 (socket says 172.21.15.149:33630) 2023-01-01T17:39:35.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.985+0000 7ff50bfff700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff50c14dc40 0x7ff50c1eba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:39966/0 (socket says 172.21.15.149:39966) 2023-01-01T17:39:35.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.985+0000 7ff50b7fe700 1 -- 172.21.15.149:0/3264445868 learned_addr learned my addr 172.21.15.149:0/3264445868 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-01-01T17:39:35.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.985+0000 7ff50affd700 1 --2- 172.21.15.149:0/3264445868 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff50c0c64f0 0x7ff50c06ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:35.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.985+0000 7ff50bfff700 1 -- 172.21.15.149:0/3264445868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff50c071750 msgr2=0x7ff50c155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:35.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.985+0000 7ff50bfff700 1 --2- 172.21.15.149:0/3264445868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff50c071750 0x7ff50c155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:35.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.985+0000 7ff50bfff700 1 -- 172.21.15.149:0/3264445868 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff50c0c64f0 msgr2=0x7ff50c06ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:35.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.985+0000 7ff50bfff700 1 --2- 172.21.15.149:0/3264445868 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff50c0c64f0 0x7ff50c06ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:35.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.985+0000 7ff50bfff700 1 -- 172.21.15.149:0/3264445868 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff504009a70 con 0x7ff50c14dc40 2023-01-01T17:39:35.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.985+0000 7ff50b7fe700 1 --2- 172.21.15.149:0/3264445868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff50c071750 0x7ff50c155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-01-01T17:39:35.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.985+0000 7ff50bfff700 1 --2- 172.21.15.149:0/3264445868 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff50c14dc40 0x7ff50c1eba90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff504016000 tx=0x7ff504004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:35.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.986+0000 7ff4f3fff700 1 -- 172.21.15.149:0/3264445868 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff504012430 con 0x7ff50c14dc40 2023-01-01T17:39:35.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.986+0000 7ff4f3fff700 1 -- 172.21.15.149:0/3264445868 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff504020070 con 0x7ff50c14dc40 2023-01-01T17:39:35.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.986+0000 7ff5121e9700 1 -- 172.21.15.149:0/3264445868 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff50c152cd0 con 0x7ff50c14dc40 2023-01-01T17:39:35.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.986+0000 7ff4f3fff700 1 -- 172.21.15.149:0/3264445868 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff504004280 con 0x7ff50c14dc40 2023-01-01T17:39:35.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.986+0000 7ff5121e9700 1 -- 172.21.15.149:0/3264445868 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff50c06e1b0 con 0x7ff50c14dc40 2023-01-01T17:39:35.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.986+0000 7ff4f3fff700 1 -- 172.21.15.149:0/3264445868 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7ff5040046d0 con 0x7ff50c14dc40 2023-01-01T17:39:35.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.986+0000 7ff4f3fff700 1 -- 172.21.15.149:0/3264445868 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7ff504022070 con 0x7ff50c14dc40 2023-01-01T17:39:35.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.987+0000 7ff5121e9700 1 -- 172.21.15.149:0/3264445868 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff50c152e60 con 0x7ff50c14dc40 2023-01-01T17:39:35.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:35.989+0000 7ff4f3fff700 1 -- 172.21.15.149:0/3264445868 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71767 (secure 0 0 0) 0x7ff50c152e60 con 0x7ff50c14dc40 2023-01-01T17:39:36.048 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-01T17:39:36.047+0000 7f0b100eb200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-01-01T17:39:36.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.073+0000 7ff5121e9700 1 -- 172.21.15.149:0/3264445868 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7b43ea06-a7b6-49f4-a390-18ad14dfe4fe", "id": 2} v 0) v1 -- 0x7ff50c06d980 con 0x7ff50c14dc40 2023-01-01T17:39:36.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.078+0000 7ff4f3fff700 1 -- 172.21.15.149:0/3264445868 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7b43ea06-a7b6-49f4-a390-18ad14dfe4fe", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff50402c060 con 0x7ff50c14dc40 2023-01-01T17:39:36.079 INFO:teuthology.orchestra.run.smithi149.stdout:2 2023-01-01T17:39:36.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.079+0000 7ff5121e9700 1 -- 172.21.15.149:0/3264445868 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff50c14dc40 msgr2=0x7ff50c1eba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:36.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.079+0000 7ff5121e9700 1 --2- 172.21.15.149:0/3264445868 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff50c14dc40 0x7ff50c1eba90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff504016000 tx=0x7ff504004ad0 comp rx=0 tx=0).stop 2023-01-01T17:39:36.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.079+0000 7ff5121e9700 1 -- 172.21.15.149:0/3264445868 shutdown_connections 2023-01-01T17:39:36.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.079+0000 7ff5121e9700 1 --2- 172.21.15.149:0/3264445868 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff50c14dc40 0x7ff50c1eba90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:36.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.079+0000 7ff5121e9700 1 --2- 172.21.15.149:0/3264445868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff50c071750 0x7ff50c155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:36.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.079+0000 7ff5121e9700 1 --2- 172.21.15.149:0/3264445868 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff50c0c64f0 0x7ff50c06ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:36.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.080+0000 7ff5121e9700 1 -- 172.21.15.149:0/3264445868 >> 172.21.15.149:0/3264445868 conn(0x7ff50c0a8420 msgr2=0x7ff50c069360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:36.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.080+0000 7ff5121e9700 1 -- 172.21.15.149:0/3264445868 shutdown_connections 2023-01-01T17:39:36.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.080+0000 7ff5121e9700 1 -- 172.21.15.149:0/3264445868 wait complete. 2023-01-01T17:39:36.093 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 117c41d8-d40c-4cc0-b0e1-70bca058fa72 3 2023-01-01T17:39:36.179 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-01T17:39:36.179+0000 7f0b100eb200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-01-01T17:39:36.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.214+0000 7f58f7b09700 1 Processor -- start 2023-01-01T17:39:36.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.215+0000 7f58f7b09700 1 -- start start 2023-01-01T17:39:36.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.215+0000 7f58f7b09700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f58f00c6e90 0x7f58f00c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:36.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.215+0000 7f58f7b09700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58f00c7260 0x7f58f00c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:36.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.216+0000 7f58f7b09700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58f006dae0 con 0x7f58f006df70 2023-01-01T17:39:36.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.216+0000 7f58f7b09700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58f00ba5b0 con 0x7f58f00c6e90 2023-01-01T17:39:36.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.216+0000 7f58f7b09700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f006e550 con 0x7f58f00c7260 2023-01-01T17:39:36.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.216+0000 7f58f50a4700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58f00c7260 0x7f58f00c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:36.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.216+0000 7f58f50a4700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58f00c7260 0x7f58f00c5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:39970/0 (socket says 172.21.15.149:39970) 2023-01-01T17:39:36.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.216+0000 7f58f50a4700 1 -- 172.21.15.149:0/2923104747 learned_addr learned my addr 172.21.15.149:0/2923104747 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-01-01T17:39:36.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.216+0000 7f58f58a5700 1 --2- 172.21.15.149:0/2923104747 >> v2:172.21.15.61:3300/0 conn(0x7f58f00c6e90 0x7f58f00c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:36.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.216+0000 7f58f50a4700 1 -- 172.21.15.149:0/2923104747 >> v2:172.21.15.61:3300/0 conn(0x7f58f00c6e90 msgr2=0x7f58f00c55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:36.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.216+0000 7f58f50a4700 1 --2- 172.21.15.149:0/2923104747 >> v2:172.21.15.61:3300/0 conn(0x7f58f00c6e90 0x7f58f00c55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:36.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.216+0000 7f58f50a4700 1 -- 172.21.15.149:0/2923104747 >> v1:172.21.15.61:6789/0 conn(0x7f58f006df70 legacy=0x7f58f01544b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:36.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.216+0000 7f58f50a4700 1 -- 172.21.15.149:0/2923104747 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f006e830 con 0x7f58f00c7260 2023-01-01T17:39:36.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.216+0000 7f58f50a4700 1 --2- 172.21.15.149:0/2923104747 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58f00c7260 0x7f58f00c5b20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f58e00098f0 tx=0x7f58e0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb6cf815f076cc65 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:36.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.216+0000 7f58f48a3700 1 -- 172.21.15.149:0/2923104747 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e0011830 con 0x7f58f00c7260 2023-01-01T17:39:36.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.216+0000 7f58f48a3700 1 -- 172.21.15.149:0/2923104747 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e0011990 con 0x7f58f00c7260 2023-01-01T17:39:36.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.216+0000 7f58f48a3700 1 -- 172.21.15.149:0/2923104747 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e0011d20 con 0x7f58f00c7260 2023-01-01T17:39:36.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.217+0000 7f58f7b09700 1 -- 172.21.15.149:0/2923104747 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58f00c7260 msgr2=0x7f58f00c5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:36.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.217+0000 7f58f7b09700 1 --2- 172.21.15.149:0/2923104747 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58f00c7260 0x7f58f00c5b20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f58e00098f0 tx=0x7f58e0009c00 comp rx=0 tx=0).stop 2023-01-01T17:39:36.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.217+0000 7f58f7b09700 1 -- 172.21.15.149:0/2923104747 shutdown_connections 2023-01-01T17:39:36.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.217+0000 7f58f7b09700 1 --2- 172.21.15.149:0/2923104747 >> v2:172.21.15.61:3300/0 conn(0x7f58f00c6e90 0x7f58f00c55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:36.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.217+0000 7f58f7b09700 1 --2- 172.21.15.149:0/2923104747 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58f00c7260 0x7f58f00c5b20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:36.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.217+0000 7f58f7b09700 1 -- 172.21.15.149:0/2923104747 >> 172.21.15.149:0/2923104747 conn(0x7f58f0070ad0 msgr2=0x7f58f0070ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:36.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.217+0000 7f58f7b09700 1 -- 172.21.15.149:0/2923104747 shutdown_connections 2023-01-01T17:39:36.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.217+0000 7f58f7b09700 1 -- 172.21.15.149:0/2923104747 wait complete. 2023-01-01T17:39:36.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.219+0000 7f58f7b09700 1 Processor -- start 2023-01-01T17:39:36.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.219+0000 7f58f7b09700 1 -- start start 2023-01-01T17:39:36.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.220+0000 7f58f7b09700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58f006df70 0x7f58f01ea7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:36.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.220+0000 7f58f7b09700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58f00c6e90 0x7f58f00bb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:36.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.220+0000 7f58f7b09700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f58f00c7260 0x7f58f00bffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:36.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.220+0000 7f58f7b09700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f00bb8a0 con 0x7f58f00c7260 2023-01-01T17:39:36.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.220+0000 7f58f7b09700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f00ac310 con 0x7f58f006df70 2023-01-01T17:39:36.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.220+0000 7f58f58a5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58f006df70 0x7f58f01ea7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:36.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.220+0000 7f58f7b09700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f014cb30 con 0x7f58f00c6e90 2023-01-01T17:39:36.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.220+0000 7f58f58a5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58f006df70 0x7f58f01ea7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:33642/0 (socket says 172.21.15.149:33642) 2023-01-01T17:39:36.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.220+0000 7f58f58a5700 1 -- 172.21.15.149:0/3002000619 learned_addr learned my addr 172.21.15.149:0/3002000619 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-01-01T17:39:36.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.220+0000 7f58f50a4700 1 --2- 172.21.15.149:0/3002000619 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58f00c6e90 0x7f58f00bb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:36.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.220+0000 7f58f60a6700 1 --2- 172.21.15.149:0/3002000619 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f58f00c7260 0x7f58f00bffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:36.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.220+0000 7f58f50a4700 1 -- 172.21.15.149:0/3002000619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58f006df70 msgr2=0x7f58f01ea7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:36.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.220+0000 7f58f50a4700 1 --2- 172.21.15.149:0/3002000619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58f006df70 0x7f58f01ea7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:36.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.220+0000 7f58f50a4700 1 -- 172.21.15.149:0/3002000619 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f58f00c7260 msgr2=0x7f58f00bffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:36.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.220+0000 7f58f50a4700 1 --2- 172.21.15.149:0/3002000619 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f58f00c7260 0x7f58f00bffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:36.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.220+0000 7f58f50a4700 1 -- 172.21.15.149:0/3002000619 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e0009550 con 0x7f58f00c6e90 2023-01-01T17:39:36.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.220+0000 7f58f58a5700 1 --2- 172.21.15.149:0/3002000619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58f006df70 0x7f58f01ea7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-01-01T17:39:36.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.220+0000 7f58f50a4700 1 --2- 172.21.15.149:0/3002000619 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58f00c6e90 0x7f58f00bb110 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f58e0016000 tx=0x7f58e0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:36.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.220+0000 7f58e67fc700 1 -- 172.21.15.149:0/3002000619 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e0004510 con 0x7f58f00c6e90 2023-01-01T17:39:36.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.220+0000 7f58e67fc700 1 -- 172.21.15.149:0/3002000619 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e001e070 con 0x7f58f00c6e90 2023-01-01T17:39:36.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.220+0000 7f58f7b09700 1 -- 172.21.15.149:0/3002000619 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58f006d770 con 0x7f58f00c6e90 2023-01-01T17:39:36.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.220+0000 7f58e67fc700 1 -- 172.21.15.149:0/3002000619 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e00038c0 con 0x7f58f00c6e90 2023-01-01T17:39:36.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.220+0000 7f58f7b09700 1 -- 172.21.15.149:0/3002000619 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f006eb10 con 0x7f58f00c6e90 2023-01-01T17:39:36.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.221+0000 7f58e67fc700 1 -- 172.21.15.149:0/3002000619 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f58e000f050 con 0x7f58f00c6e90 2023-01-01T17:39:36.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.221+0000 7f58e67fc700 1 -- 172.21.15.149:0/3002000619 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f58e002da70 con 0x7f58f00c6e90 2023-01-01T17:39:36.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.221+0000 7f58f7b09700 1 -- 172.21.15.149:0/3002000619 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58f006d400 con 0x7f58f00c6e90 2023-01-01T17:39:36.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.223+0000 7f58e67fc700 1 -- 172.21.15.149:0/3002000619 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71767 (secure 0 0 0) 0x7f58e0020070 con 0x7f58f00c6e90 2023-01-01T17:39:36.262 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-01T17:39:36.262+0000 7f0b100eb200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-01-01T17:39:36.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.307+0000 7f58f7b09700 1 -- 172.21.15.149:0/3002000619 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd new", "uuid": "117c41d8-d40c-4cc0-b0e1-70bca058fa72", "id": 3} v 0) v1 -- 0x7f58f00668a0 con 0x7f58f00c6e90 2023-01-01T17:39:36.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.312+0000 7f58e67fc700 1 -- 172.21.15.149:0/3002000619 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "117c41d8-d40c-4cc0-b0e1-70bca058fa72", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f58e0015020 con 0x7f58f00c6e90 2023-01-01T17:39:36.313 INFO:teuthology.orchestra.run.smithi149.stdout:3 2023-01-01T17:39:36.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.313+0000 7f58f7b09700 1 -- 172.21.15.149:0/3002000619 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58f00c6e90 msgr2=0x7f58f00bb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:36.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.313+0000 7f58f7b09700 1 --2- 172.21.15.149:0/3002000619 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58f00c6e90 0x7f58f00bb110 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f58e0016000 tx=0x7f58e0004750 comp rx=0 tx=0).stop 2023-01-01T17:39:36.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.313+0000 7f58f7b09700 1 -- 172.21.15.149:0/3002000619 shutdown_connections 2023-01-01T17:39:36.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.313+0000 7f58f7b09700 1 --2- 172.21.15.149:0/3002000619 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f58f00c7260 0x7f58f00bffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:36.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.313+0000 7f58f7b09700 1 --2- 172.21.15.149:0/3002000619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58f006df70 0x7f58f01ea7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:36.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.313+0000 7f58f7b09700 1 --2- 172.21.15.149:0/3002000619 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f58f00c6e90 0x7f58f00bb110 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:36.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.313+0000 7f58f7b09700 1 -- 172.21.15.149:0/3002000619 >> 172.21.15.149:0/3002000619 conn(0x7f58f0070ad0 msgr2=0x7f58f01549c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:36.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.314+0000 7f58f7b09700 1 -- 172.21.15.149:0/3002000619 shutdown_connections 2023-01-01T17:39:36.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.314+0000 7f58f7b09700 1 -- 172.21.15.149:0/3002000619 wait complete. 2023-01-01T17:39:36.318 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-01-01T17:39:36.317+0000 7fcece137200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-01-01T17:39:36.326 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 4073e0e8-c5dd-463f-aa1c-c9515ef09976 4 2023-01-01T17:39:36.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.449+0000 7fae1ebc0700 1 Processor -- start 2023-01-01T17:39:36.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.449+0000 7fae1ebc0700 1 -- start start 2023-01-01T17:39:36.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.450+0000 7fae1ebc0700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fae180c5a20 0x7fae18150410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:36.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.450+0000 7fae1ebc0700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae1806f1a0 0x7fae1806f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:36.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.450+0000 7fae1ebc0700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae180c6270 con 0x7fae180c5df0 2023-01-01T17:39:36.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.450+0000 7fae1ebc0700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae1814fff0 con 0x7fae180c5a20 2023-01-01T17:39:36.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.450+0000 7fae1ebc0700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae1806fbd0 con 0x7fae1806f1a0 2023-01-01T17:39:36.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.450+0000 7fae1d15d700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae1806f1a0 0x7fae1806f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:36.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.450+0000 7fae17fff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fae180c5df0 0x7fae18150d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:56208/0 (socket says 172.21.15.149:56208) 2023-01-01T17:39:36.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.450+0000 7fae17fff700 1 -- 172.21.15.149:0/3174565649 learned_addr learned my addr 172.21.15.149:0/3174565649 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-01-01T17:39:36.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.451+0000 7fae1c95c700 1 --2- 172.21.15.149:0/3174565649 >> v2:172.21.15.61:3300/0 conn(0x7fae180c5a20 0x7fae18150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:36.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.451+0000 7fae177fe700 1 -- 172.21.15.149:0/3174565649 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4250756317 0 0) 0x7fae180c6270 con 0x7fae180c5df0 2023-01-01T17:39:36.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.451+0000 7fae177fe700 1 -- 172.21.15.149:0/3174565649 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae080035b0 con 0x7fae180c5df0 2023-01-01T17:39:36.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.451+0000 7fae1d15d700 1 -- 172.21.15.149:0/3174565649 >> v2:172.21.15.61:3300/0 conn(0x7fae180c5a20 msgr2=0x7fae18150410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:36.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.451+0000 7fae1d15d700 1 --2- 172.21.15.149:0/3174565649 >> v2:172.21.15.61:3300/0 conn(0x7fae180c5a20 0x7fae18150410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:36.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.451+0000 7fae1d15d700 1 -- 172.21.15.149:0/3174565649 >> v1:172.21.15.149:6789/0 conn(0x7fae180c5df0 legacy=0x7fae18150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:36.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.451+0000 7fae1d15d700 1 -- 172.21.15.149:0/3174565649 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae1814f930 con 0x7fae1806f1a0 2023-01-01T17:39:36.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.451+0000 7fae1d15d700 1 --2- 172.21.15.149:0/3174565649 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae1806f1a0 0x7fae1806f5a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fae10009d90 tx=0x7fae1000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f4c4fe9b8f449cf server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:36.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.451+0000 7fae177fe700 1 -- 172.21.15.149:0/3174565649 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1000e070 con 0x7fae1806f1a0 2023-01-01T17:39:36.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.451+0000 7fae177fe700 1 -- 172.21.15.149:0/3174565649 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1000bb20 con 0x7fae1806f1a0 2023-01-01T17:39:36.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.451+0000 7fae177fe700 1 -- 172.21.15.149:0/3174565649 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae10012430 con 0x7fae1806f1a0 2023-01-01T17:39:36.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.452+0000 7fae1ebc0700 1 -- 172.21.15.149:0/3174565649 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae1806f1a0 msgr2=0x7fae1806f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:36.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.452+0000 7fae1ebc0700 1 --2- 172.21.15.149:0/3174565649 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae1806f1a0 0x7fae1806f5a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fae10009d90 tx=0x7fae1000b330 comp rx=0 tx=0).stop 2023-01-01T17:39:36.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.452+0000 7fae1ebc0700 1 -- 172.21.15.149:0/3174565649 shutdown_connections 2023-01-01T17:39:36.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.452+0000 7fae1ebc0700 1 --2- 172.21.15.149:0/3174565649 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae1806f1a0 0x7fae1806f5a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:36.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.452+0000 7fae1ebc0700 1 --2- 172.21.15.149:0/3174565649 >> v2:172.21.15.61:3300/0 conn(0x7fae180c5a20 0x7fae18150410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:36.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.452+0000 7fae1ebc0700 1 -- 172.21.15.149:0/3174565649 >> 172.21.15.149:0/3174565649 conn(0x7fae180c2a40 msgr2=0x7fae180c5310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:36.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.452+0000 7fae1ebc0700 1 -- 172.21.15.149:0/3174565649 shutdown_connections 2023-01-01T17:39:36.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.452+0000 7fae1ebc0700 1 -- 172.21.15.149:0/3174565649 wait complete. 2023-01-01T17:39:36.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.453+0000 7fae1ebc0700 1 Processor -- start 2023-01-01T17:39:36.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.454+0000 7fae1ebc0700 1 -- start start 2023-01-01T17:39:36.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.455+0000 7fae1ebc0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae1806f1a0 0x7fae180aa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:36.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.455+0000 7fae1ebc0700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae180c5a20 0x7fae180aaee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:36.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.455+0000 7fae1ebc0700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fae180c5df0 0x7fae18141fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:36.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.455+0000 7fae1ebc0700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae180a91f0 con 0x7fae180c5df0 2023-01-01T17:39:36.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.455+0000 7fae1ebc0700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae180aa010 con 0x7fae1806f1a0 2023-01-01T17:39:36.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.455+0000 7fae1ebc0700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae18142b40 con 0x7fae180c5a20 2023-01-01T17:39:36.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.455+0000 7fae1c95c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae1806f1a0 0x7fae180aa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:36.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.455+0000 7fae17fff700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae180c5a20 0x7fae180aaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:36.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.455+0000 7fae1c95c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae1806f1a0 0x7fae180aa9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:33654/0 (socket says 172.21.15.149:33654) 2023-01-01T17:39:36.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.455+0000 7fae1c95c700 1 -- 172.21.15.149:0/3812027852 learned_addr learned my addr 172.21.15.149:0/3812027852 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-01-01T17:39:36.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.455+0000 7fae1d15d700 1 --2- 172.21.15.149:0/3812027852 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fae180c5df0 0x7fae18141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:36.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.455+0000 7fae1c95c700 1 -- 172.21.15.149:0/3812027852 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae180c5a20 msgr2=0x7fae180aaee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:36.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.455+0000 7fae1c95c700 1 --2- 172.21.15.149:0/3812027852 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae180c5a20 0x7fae180aaee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:36.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.455+0000 7fae1c95c700 1 -- 172.21.15.149:0/3812027852 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fae180c5df0 msgr2=0x7fae18141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:36.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.455+0000 7fae1c95c700 1 --2- 172.21.15.149:0/3812027852 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fae180c5df0 0x7fae18141fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:36.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.455+0000 7fae1c95c700 1 -- 172.21.15.149:0/3812027852 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae10009a70 con 0x7fae1806f1a0 2023-01-01T17:39:36.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.455+0000 7fae17fff700 1 --2- 172.21.15.149:0/3812027852 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae180c5a20 0x7fae180aaee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-01-01T17:39:36.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.455+0000 7fae1c95c700 1 --2- 172.21.15.149:0/3812027852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae1806f1a0 0x7fae180aa9a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fae0c00e9b0 tx=0x7fae0c00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:36.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.455+0000 7fae157fa700 1 -- 172.21.15.149:0/3812027852 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c009710 con 0x7fae1806f1a0 2023-01-01T17:39:36.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.455+0000 7fae157fa700 1 -- 172.21.15.149:0/3812027852 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0c00ee50 con 0x7fae1806f1a0 2023-01-01T17:39:36.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.455+0000 7fae157fa700 1 -- 172.21.15.149:0/3812027852 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c00ca50 con 0x7fae1806f1a0 2023-01-01T17:39:36.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.456+0000 7fae1ebc0700 1 -- 172.21.15.149:0/3812027852 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae18151420 con 0x7fae1806f1a0 2023-01-01T17:39:36.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.456+0000 7fae1ebc0700 1 -- 172.21.15.149:0/3812027852 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae1814fc10 con 0x7fae1806f1a0 2023-01-01T17:39:36.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.456+0000 7fae157fa700 1 -- 172.21.15.149:0/3812027852 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fae0c019030 con 0x7fae1806f1a0 2023-01-01T17:39:36.464 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.456+0000 7fae157fa700 1 -- 172.21.15.149:0/3812027852 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fae0c0066c0 con 0x7fae1806f1a0 2023-01-01T17:39:36.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.457+0000 7fae1ebc0700 1 -- 172.21.15.149:0/3812027852 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae18149b90 con 0x7fae1806f1a0 2023-01-01T17:39:36.465 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.459+0000 7fae157fa700 1 -- 172.21.15.149:0/3812027852 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71767 (secure 0 0 0) 0x7fae0c021060 con 0x7fae1806f1a0 2023-01-01T17:39:36.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.542+0000 7fae1ebc0700 1 -- 172.21.15.149:0/3812027852 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4073e0e8-c5dd-463f-aa1c-c9515ef09976", "id": 4} v 0) v1 -- 0x7fae180668a0 con 0x7fae1806f1a0 2023-01-01T17:39:36.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.546+0000 7fae157fa700 1 -- 172.21.15.149:0/3812027852 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4073e0e8-c5dd-463f-aa1c-c9515ef09976", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fae0c017070 con 0x7fae1806f1a0 2023-01-01T17:39:36.547 INFO:teuthology.orchestra.run.smithi149.stdout:4 2023-01-01T17:39:36.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.547+0000 7fae1ebc0700 1 -- 172.21.15.149:0/3812027852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae1806f1a0 msgr2=0x7fae180aa9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:36.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.547+0000 7fae1ebc0700 1 --2- 172.21.15.149:0/3812027852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae1806f1a0 0x7fae180aa9a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fae0c00e9b0 tx=0x7fae0c00ecc0 comp rx=0 tx=0).stop 2023-01-01T17:39:36.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.547+0000 7fae1ebc0700 1 -- 172.21.15.149:0/3812027852 shutdown_connections 2023-01-01T17:39:36.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.547+0000 7fae1ebc0700 1 --2- 172.21.15.149:0/3812027852 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fae180c5df0 0x7fae18141fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:36.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.547+0000 7fae1ebc0700 1 --2- 172.21.15.149:0/3812027852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae1806f1a0 0x7fae180aa9a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:36.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.547+0000 7fae1ebc0700 1 --2- 172.21.15.149:0/3812027852 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae180c5a20 0x7fae180aaee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:36.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.547+0000 7fae1ebc0700 1 -- 172.21.15.149:0/3812027852 >> 172.21.15.149:0/3812027852 conn(0x7fae180c2a40 msgr2=0x7fae18150c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:36.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.548+0000 7fae1ebc0700 1 -- 172.21.15.149:0/3812027852 shutdown_connections 2023-01-01T17:39:36.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.548+0000 7fae1ebc0700 1 -- 172.21.15.149:0/3812027852 wait complete. 2023-01-01T17:39:36.560 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 88aa0c0f-e3c1-4dd3-af8c-61f4bc28504e 5 2023-01-01T17:39:36.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.679+0000 7f34ccffc700 1 Processor -- start 2023-01-01T17:39:36.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.679+0000 7f34ccffc700 1 -- start start 2023-01-01T17:39:36.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.680+0000 7f34ccffc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f34c80bc680 0x7f34c80c1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:36.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.680+0000 7f34ccffc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f34c806df20 0x7f34c80c6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:36.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.680+0000 7f34ccffc700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34c80bca50 con 0x7f34c80c67c0 2023-01-01T17:39:36.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.680+0000 7f34ccffc700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34c8070a60 con 0x7f34c806df20 2023-01-01T17:39:36.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.680+0000 7f34ccffc700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34c80701b0 con 0x7f34c80bc680 2023-01-01T17:39:36.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.680+0000 7f34c659c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f34c80bc680 0x7f34c80c1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:36.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.680+0000 7f34c6d9d700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f34c80c67c0 0x7f34c8153350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:56222/0 (socket says 172.21.15.149:56222) 2023-01-01T17:39:36.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.680+0000 7f34c659c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f34c80bc680 0x7f34c80c1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:33660/0 (socket says 172.21.15.149:33660) 2023-01-01T17:39:36.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.680+0000 7f34c6d9d700 1 -- 172.21.15.149:0/1006862907 learned_addr learned my addr 172.21.15.149:0/1006862907 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-01-01T17:39:36.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.680+0000 7f34c5d9b700 1 --2- 172.21.15.149:0/1006862907 >> v2:172.21.15.61:3300/0 conn(0x7f34c806df20 0x7f34c80c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:36.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.681+0000 7f34c659c700 1 -- 172.21.15.149:0/1006862907 >> v2:172.21.15.61:3300/0 conn(0x7f34c806df20 msgr2=0x7f34c80c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:36.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.681+0000 7f34c659c700 1 --2- 172.21.15.149:0/1006862907 >> v2:172.21.15.61:3300/0 conn(0x7f34c806df20 0x7f34c80c6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:36.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.681+0000 7f34c659c700 1 -- 172.21.15.149:0/1006862907 >> v1:172.21.15.149:6789/0 conn(0x7f34c80c67c0 legacy=0x7f34c8153350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:36.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.681+0000 7f34c559a700 1 -- 172.21.15.149:0/1006862907 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4194889024 0 0) 0x7f34c80bca50 con 0x7f34c80c67c0 2023-01-01T17:39:36.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.681+0000 7f34c659c700 1 -- 172.21.15.149:0/1006862907 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c80c2360 con 0x7f34c80bc680 2023-01-01T17:39:36.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.681+0000 7f34c659c700 1 --2- 172.21.15.149:0/1006862907 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34c80bc680 0x7f34c80c1180 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f34c80c52a0 tx=0x7f34bc009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f917d6f233e60b3e server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:36.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.681+0000 7f34c559a700 1 -- 172.21.15.149:0/1006862907 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34bc011830 con 0x7f34c80bc680 2023-01-01T17:39:36.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.681+0000 7f34c559a700 1 -- 172.21.15.149:0/1006862907 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34bc011990 con 0x7f34c80bc680 2023-01-01T17:39:36.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.681+0000 7f34c559a700 1 -- 172.21.15.149:0/1006862907 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34bc011d20 con 0x7f34c80bc680 2023-01-01T17:39:36.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.682+0000 7f34ccffc700 1 -- 172.21.15.149:0/1006862907 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34c80bc680 msgr2=0x7f34c80c1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:36.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.682+0000 7f34ccffc700 1 --2- 172.21.15.149:0/1006862907 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34c80bc680 0x7f34c80c1180 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f34c80c52a0 tx=0x7f34bc009b20 comp rx=0 tx=0).stop 2023-01-01T17:39:36.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.682+0000 7f34ccffc700 1 -- 172.21.15.149:0/1006862907 shutdown_connections 2023-01-01T17:39:36.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.682+0000 7f34ccffc700 1 --2- 172.21.15.149:0/1006862907 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34c80bc680 0x7f34c80c1180 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:36.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.682+0000 7f34ccffc700 1 --2- 172.21.15.149:0/1006862907 >> v2:172.21.15.61:3300/0 conn(0x7f34c806df20 0x7f34c80c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:36.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.682+0000 7f34ccffc700 1 -- 172.21.15.149:0/1006862907 >> 172.21.15.149:0/1006862907 conn(0x7f34c80a8420 msgr2=0x7f34c80c5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:36.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.682+0000 7f34ccffc700 1 -- 172.21.15.149:0/1006862907 shutdown_connections 2023-01-01T17:39:36.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.682+0000 7f34ccffc700 1 -- 172.21.15.149:0/1006862907 wait complete. 2023-01-01T17:39:36.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.683+0000 7f34ccffc700 1 Processor -- start 2023-01-01T17:39:36.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.683+0000 7f34ccffc700 1 -- start start 2023-01-01T17:39:36.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.684+0000 7f34ccffc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f34c806df20 0x7f34c806cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:36.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.684+0000 7f34ccffc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34c80bc680 0x7f34c80a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:36.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.684+0000 7f34ccffc700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34c80c67c0 0x7f34c80aa470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:36.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.684+0000 7f34ccffc700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c80a6e60 con 0x7f34c806df20 2023-01-01T17:39:36.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.684+0000 7f34ccffc700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c80a4db0 con 0x7f34c80bc680 2023-01-01T17:39:36.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.684+0000 7f34ccffc700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c80a5090 con 0x7f34c80c67c0 2023-01-01T17:39:36.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.684+0000 7f34c5d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34c80bc680 0x7f34c80a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:36.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.684+0000 7f34c6d9d700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34c80c67c0 0x7f34c80aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:36.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.684+0000 7f34c5d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34c80bc680 0x7f34c80a9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:33668/0 (socket says 172.21.15.149:33668) 2023-01-01T17:39:36.688 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.684+0000 7f34c5d9b700 1 -- 172.21.15.149:0/819892529 learned_addr learned my addr 172.21.15.149:0/819892529 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-01-01T17:39:36.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.684+0000 7f34c659c700 1 --2- 172.21.15.149:0/819892529 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f34c806df20 0x7f34c806cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:36.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.684+0000 7f34c5d9b700 1 -- 172.21.15.149:0/819892529 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34c80c67c0 msgr2=0x7f34c80aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:36.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.684+0000 7f34c5d9b700 1 --2- 172.21.15.149:0/819892529 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34c80c67c0 0x7f34c80aa470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:36.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.684+0000 7f34c5d9b700 1 -- 172.21.15.149:0/819892529 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f34c806df20 msgr2=0x7f34c806cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:36.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.684+0000 7f34c5d9b700 1 --2- 172.21.15.149:0/819892529 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f34c806df20 0x7f34c806cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:36.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.684+0000 7f34c5d9b700 1 -- 172.21.15.149:0/819892529 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34bc0094a0 con 0x7f34c80bc680 2023-01-01T17:39:36.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.684+0000 7f34c659c700 1 --2- 172.21.15.149:0/819892529 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f34c806df20 0x7f34c806cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-01-01T17:39:36.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.684+0000 7f34c5d9b700 1 --2- 172.21.15.149:0/819892529 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34c80bc680 0x7f34c80a9f30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f34b800e9b0 tx=0x7f34b800ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:36.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.684+0000 7f34b6ffd700 1 -- 172.21.15.149:0/819892529 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b8009710 con 0x7f34c80bc680 2023-01-01T17:39:36.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.684+0000 7f34b6ffd700 1 -- 172.21.15.149:0/819892529 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b800ee50 con 0x7f34c80bc680 2023-01-01T17:39:36.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.685+0000 7f34b6ffd700 1 -- 172.21.15.149:0/819892529 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b800ca50 con 0x7f34c80bc680 2023-01-01T17:39:36.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.685+0000 7f34ccffc700 1 -- 172.21.15.149:0/819892529 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34c8070800 con 0x7f34c80bc680 2023-01-01T17:39:36.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.685+0000 7f34ccffc700 1 -- 172.21.15.149:0/819892529 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34c8070520 con 0x7f34c80bc680 2023-01-01T17:39:36.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.685+0000 7f34b6ffd700 1 -- 172.21.15.149:0/819892529 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f34b8019030 con 0x7f34c80bc680 2023-01-01T17:39:36.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.685+0000 7f34b6ffd700 1 -- 172.21.15.149:0/819892529 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f34b8006730 con 0x7f34c80bc680 2023-01-01T17:39:36.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.685+0000 7f34ccffc700 1 -- 172.21.15.149:0/819892529 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34c806fb60 con 0x7f34c80bc680 2023-01-01T17:39:36.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.689+0000 7f34b6ffd700 1 -- 172.21.15.149:0/819892529 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71767 (secure 0 0 0) 0x7f34b8021060 con 0x7f34c80bc680 2023-01-01T17:39:36.758 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-01T17:39:36.758+0000 7f0b100eb200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-01-01T17:39:36.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.773+0000 7f34ccffc700 1 -- 172.21.15.149:0/819892529 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "88aa0c0f-e3c1-4dd3-af8c-61f4bc28504e", "id": 5} v 0) v1 -- 0x7f34c80a5250 con 0x7f34c80bc680 2023-01-01T17:39:36.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.782+0000 7f34b6ffd700 1 -- 172.21.15.149:0/819892529 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "88aa0c0f-e3c1-4dd3-af8c-61f4bc28504e", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f34b8029020 con 0x7f34c80bc680 2023-01-01T17:39:36.786 INFO:teuthology.orchestra.run.smithi149.stdout:5 2023-01-01T17:39:36.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.783+0000 7f34ccffc700 1 -- 172.21.15.149:0/819892529 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34c80bc680 msgr2=0x7f34c80a9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:36.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.783+0000 7f34ccffc700 1 --2- 172.21.15.149:0/819892529 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34c80bc680 0x7f34c80a9f30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f34b800e9b0 tx=0x7f34b800ecc0 comp rx=0 tx=0).stop 2023-01-01T17:39:36.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.783+0000 7f34ccffc700 1 -- 172.21.15.149:0/819892529 shutdown_connections 2023-01-01T17:39:36.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.783+0000 7f34ccffc700 1 --2- 172.21.15.149:0/819892529 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f34c80c67c0 0x7f34c80aa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:36.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.783+0000 7f34ccffc700 1 --2- 172.21.15.149:0/819892529 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f34c806df20 0x7f34c806cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:36.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.783+0000 7f34ccffc700 1 --2- 172.21.15.149:0/819892529 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34c80bc680 0x7f34c80a9f30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:36.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.783+0000 7f34ccffc700 1 -- 172.21.15.149:0/819892529 >> 172.21.15.149:0/819892529 conn(0x7f34c80a8420 msgr2=0x7f34c8069360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:36.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.783+0000 7f34ccffc700 1 -- 172.21.15.149:0/819892529 shutdown_connections 2023-01-01T17:39:36.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.783+0000 7f34ccffc700 1 -- 172.21.15.149:0/819892529 wait complete. 2023-01-01T17:39:36.796 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 8b13fc0c-5f00-41c7-8923-c4570da77afd 6 2023-01-01T17:39:36.906 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-01-01T17:39:36.906+0000 7fcece137200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-01-01T17:39:36.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.920+0000 7fcacd67e700 1 Processor -- start 2023-01-01T17:39:36.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.920+0000 7fcacd67e700 1 -- start start 2023-01-01T17:39:36.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.921+0000 7fcacd67e700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcac806fb60 0x7fcac806ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:36.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.921+0000 7fcacd67e700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcac814d490 con 0x7fcac8070fa0 2023-01-01T17:39:36.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.921+0000 7fcacd67e700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcac814fd50 con 0x7fcac806deb0 2023-01-01T17:39:36.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.921+0000 7fcacd67e700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac8150030 con 0x7fcac806fb60 2023-01-01T17:39:36.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.921+0000 7fcac6ffd700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcac806fb60 0x7fcac806ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:36.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.921+0000 7fcac6ffd700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcac806fb60 0x7fcac806ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:40004/0 (socket says 172.21.15.149:40004) 2023-01-01T17:39:36.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.921+0000 7fcac6ffd700 1 -- 172.21.15.149:0/2583643789 learned_addr learned my addr 172.21.15.149:0/2583643789 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-01-01T17:39:36.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.921+0000 7fcac77fe700 1 --1- 172.21.15.149:0/2583643789 >> v1:172.21.15.149:6789/0 conn(0x7fcac806deb0 0x7fcac80c4430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:56236/0 (socket says 172.21.15.149:56236) 2023-01-01T17:39:36.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.922+0000 7fcac6ffd700 1 -- 172.21.15.149:0/2583643789 >> v1:172.21.15.149:6789/0 conn(0x7fcac806deb0 legacy=0x7fcac80c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:36.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.922+0000 7fcac5ffb700 1 -- 172.21.15.149:0/2583643789 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3138472599 0 0) 0x7fcac814fd50 con 0x7fcac806deb0 2023-01-01T17:39:36.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.922+0000 7fcac6ffd700 1 -- 172.21.15.149:0/2583643789 >> v1:172.21.15.61:6789/0 conn(0x7fcac8070fa0 legacy=0x7fcac80c3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:36.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.922+0000 7fcac6ffd700 1 -- 172.21.15.149:0/2583643789 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac8150310 con 0x7fcac806fb60 2023-01-01T17:39:36.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.922+0000 7fcac6ffd700 1 --2- 172.21.15.149:0/2583643789 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcac806fb60 0x7fcac806ff30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcab800bbc0 tx=0x7fcab800bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=499da555f32e1ef8 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:36.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.922+0000 7fcac5ffb700 1 -- 172.21.15.149:0/2583643789 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab800dd90 con 0x7fcac806fb60 2023-01-01T17:39:36.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.922+0000 7fcac5ffb700 1 -- 172.21.15.149:0/2583643789 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab8010470 con 0x7fcac806fb60 2023-01-01T17:39:36.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.922+0000 7fcac5ffb700 1 -- 172.21.15.149:0/2583643789 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab8010800 con 0x7fcac806fb60 2023-01-01T17:39:36.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.922+0000 7fcacd67e700 1 -- 172.21.15.149:0/2583643789 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcac806fb60 msgr2=0x7fcac806ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:36.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.922+0000 7fcacd67e700 1 --2- 172.21.15.149:0/2583643789 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcac806fb60 0x7fcac806ff30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcab800bbc0 tx=0x7fcab800bed0 comp rx=0 tx=0).stop 2023-01-01T17:39:36.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.923+0000 7fcacd67e700 1 -- 172.21.15.149:0/2583643789 shutdown_connections 2023-01-01T17:39:36.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.923+0000 7fcacd67e700 1 --2- 172.21.15.149:0/2583643789 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcac806fb60 0x7fcac806ff30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:36.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.923+0000 7fcacd67e700 1 -- 172.21.15.149:0/2583643789 >> 172.21.15.149:0/2583643789 conn(0x7fcac80a7670 msgr2=0x7fcac80a7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:36.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.923+0000 7fcacd67e700 1 -- 172.21.15.149:0/2583643789 shutdown_connections 2023-01-01T17:39:36.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.923+0000 7fcacd67e700 1 -- 172.21.15.149:0/2583643789 wait complete. 2023-01-01T17:39:36.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.924+0000 7fcacd67e700 1 Processor -- start 2023-01-01T17:39:36.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.924+0000 7fcacd67e700 1 -- start start 2023-01-01T17:39:36.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.925+0000 7fcacd67e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcac806deb0 0x7fcac814e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:36.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.925+0000 7fcacd67e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcac806fb60 0x7fcac81e59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:36.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.925+0000 7fcacd67e700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcac8070fa0 0x7fcac81e5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:36.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.925+0000 7fcacd67e700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac814c990 con 0x7fcac806deb0 2023-01-01T17:39:36.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.925+0000 7fcacd67e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac80a9750 con 0x7fcac806fb60 2023-01-01T17:39:36.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.925+0000 7fcacd67e700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac814c6b0 con 0x7fcac8070fa0 2023-01-01T17:39:36.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.925+0000 7fcac67fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcac806fb60 0x7fcac81e59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:36.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.925+0000 7fcac77fe700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcac8070fa0 0x7fcac81e5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:36.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.925+0000 7fcac67fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcac806fb60 0x7fcac81e59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:33680/0 (socket says 172.21.15.149:33680) 2023-01-01T17:39:36.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.925+0000 7fcac67fc700 1 -- 172.21.15.149:0/768209627 learned_addr learned my addr 172.21.15.149:0/768209627 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-01-01T17:39:36.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.925+0000 7fcac6ffd700 1 --2- 172.21.15.149:0/768209627 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcac806deb0 0x7fcac814e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:36.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.925+0000 7fcac67fc700 1 -- 172.21.15.149:0/768209627 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcac8070fa0 msgr2=0x7fcac81e5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:36.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.925+0000 7fcac67fc700 1 --2- 172.21.15.149:0/768209627 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcac8070fa0 0x7fcac81e5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:36.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.925+0000 7fcac67fc700 1 -- 172.21.15.149:0/768209627 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcac806deb0 msgr2=0x7fcac814e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:36.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.925+0000 7fcac67fc700 1 --2- 172.21.15.149:0/768209627 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcac806deb0 0x7fcac814e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:36.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.925+0000 7fcac67fc700 1 -- 172.21.15.149:0/768209627 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab800b7f0 con 0x7fcac806fb60 2023-01-01T17:39:36.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.925+0000 7fcac77fe700 1 --2- 172.21.15.149:0/768209627 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcac8070fa0 0x7fcac81e5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-01-01T17:39:36.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.925+0000 7fcac6ffd700 1 --2- 172.21.15.149:0/768209627 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcac806deb0 0x7fcac814e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-01-01T17:39:36.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.925+0000 7fcac67fc700 1 --2- 172.21.15.149:0/768209627 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcac806fb60 0x7fcac81e59d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcabc00c450 tx=0x7fcabc00c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:36.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.925+0000 7fcaaf7fe700 1 -- 172.21.15.149:0/768209627 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc0052d0 con 0x7fcac806fb60 2023-01-01T17:39:36.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.925+0000 7fcaaf7fe700 1 -- 172.21.15.149:0/768209627 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcabc005430 con 0x7fcac806fb60 2023-01-01T17:39:36.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.925+0000 7fcacd67e700 1 -- 172.21.15.149:0/768209627 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac81508d0 con 0x7fcac806fb60 2023-01-01T17:39:36.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.925+0000 7fcaaf7fe700 1 -- 172.21.15.149:0/768209627 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc0038c0 con 0x7fcac806fb60 2023-01-01T17:39:36.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.925+0000 7fcacd67e700 1 -- 172.21.15.149:0/768209627 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac81505f0 con 0x7fcac806fb60 2023-01-01T17:39:36.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.926+0000 7fcaaf7fe700 1 -- 172.21.15.149:0/768209627 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fcabc019030 con 0x7fcac806fb60 2023-01-01T17:39:36.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.926+0000 7fcaaf7fe700 1 -- 172.21.15.149:0/768209627 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fcabc011d10 con 0x7fcac806fb60 2023-01-01T17:39:36.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.926+0000 7fcacd67e700 1 -- 172.21.15.149:0/768209627 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac80668a0 con 0x7fcac806fb60 2023-01-01T17:39:36.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:36.930+0000 7fcaaf7fe700 1 -- 172.21.15.149:0/768209627 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71767 (secure 0 0 0) 0x7fcabc017070 con 0x7fcac806fb60 2023-01-01T17:39:37.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.013+0000 7fcacd67e700 1 -- 172.21.15.149:0/768209627 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8b13fc0c-5f00-41c7-8923-c4570da77afd", "id": 6} v 0) v1 -- 0x7fcac80c5760 con 0x7fcac806fb60 2023-01-01T17:39:37.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.021+0000 7fcaaf7fe700 1 -- 172.21.15.149:0/768209627 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8b13fc0c-5f00-41c7-8923-c4570da77afd", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcabc003a20 con 0x7fcac806fb60 2023-01-01T17:39:37.022 INFO:teuthology.orchestra.run.smithi149.stdout:6 2023-01-01T17:39:37.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.023+0000 7fcacd67e700 1 -- 172.21.15.149:0/768209627 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcac806fb60 msgr2=0x7fcac81e59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:37.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.023+0000 7fcacd67e700 1 --2- 172.21.15.149:0/768209627 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcac806fb60 0x7fcac81e59d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcabc00c450 tx=0x7fcabc00c760 comp rx=0 tx=0).stop 2023-01-01T17:39:37.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.023+0000 7fcacd67e700 1 -- 172.21.15.149:0/768209627 shutdown_connections 2023-01-01T17:39:37.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.023+0000 7fcacd67e700 1 --2- 172.21.15.149:0/768209627 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcac8070fa0 0x7fcac81e5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:37.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.023+0000 7fcacd67e700 1 --2- 172.21.15.149:0/768209627 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcac806deb0 0x7fcac814e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:37.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.023+0000 7fcacd67e700 1 --2- 172.21.15.149:0/768209627 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcac806fb60 0x7fcac81e59d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:37.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.023+0000 7fcacd67e700 1 -- 172.21.15.149:0/768209627 >> 172.21.15.149:0/768209627 conn(0x7fcac80a7670 msgr2=0x7fcac80a4e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:37.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.023+0000 7fcacd67e700 1 -- 172.21.15.149:0/768209627 shutdown_connections 2023-01-01T17:39:37.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.023+0000 7fcacd67e700 1 -- 172.21.15.149:0/768209627 wait complete. 2023-01-01T17:39:37.038 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd new 5390c6e5-39e7-4aa6-b73c-642458b2acf7 7 2023-01-01T17:39:37.065 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-01-01T17:39:37.064+0000 7fcece137200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-01-01T17:39:37.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.176+0000 7f968003c700 1 Processor -- start 2023-01-01T17:39:37.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.177+0000 7f968003c700 1 -- start start 2023-01-01T17:39:37.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.178+0000 7f968003c700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96780c5470 0x7f96780c0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:37.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.178+0000 7f968003c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f96780bf4c0 0x7f96780c14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:37.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.178+0000 7f968003c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f96780c1a20 0x7f9678159530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:37.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.178+0000 7f968003c700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96781590e0 con 0x7f96780c1a20 2023-01-01T17:39:37.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.178+0000 7f968003c700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96780c1180 con 0x7f96780bf4c0 2023-01-01T17:39:37.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.178+0000 7f968003c700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f967806c1d0 con 0x7f96780c5470 2023-01-01T17:39:37.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.178+0000 7f967ddd8700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96780c5470 0x7f96780c0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:37.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.178+0000 7f967e5d9700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f96780c1a20 0x7f9678159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:37.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.178+0000 7f967ddd8700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96780c5470 0x7f96780c0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.149:40016/0 (socket says 172.21.15.149:40016) 2023-01-01T17:39:37.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.178+0000 7f967ddd8700 1 -- 172.21.15.149:0/1491142355 learned_addr learned my addr 172.21.15.149:0/1491142355 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-01-01T17:39:37.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.178+0000 7f967d5d7700 1 --2- 172.21.15.149:0/1491142355 >> v2:172.21.15.149:3300/0 conn(0x7f96780bf4c0 0x7f96780c14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:37.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.178+0000 7f967ddd8700 1 -- 172.21.15.149:0/1491142355 >> v2:172.21.15.149:3300/0 conn(0x7f96780bf4c0 msgr2=0x7f96780c14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:37.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.178+0000 7f967ddd8700 1 --2- 172.21.15.149:0/1491142355 >> v2:172.21.15.149:3300/0 conn(0x7f96780bf4c0 0x7f96780c14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:37.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.178+0000 7f967ddd8700 1 -- 172.21.15.149:0/1491142355 >> v2:172.21.15.61:3300/0 conn(0x7f96780c1a20 msgr2=0x7f9678159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:37.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.178+0000 7f967ddd8700 1 --2- 172.21.15.149:0/1491142355 >> v2:172.21.15.61:3300/0 conn(0x7f96780c1a20 0x7f9678159530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:37.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.178+0000 7f967ddd8700 1 -- 172.21.15.149:0/1491142355 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f967806c4b0 con 0x7f96780c5470 2023-01-01T17:39:37.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.178+0000 7f967e5d9700 1 --2- 172.21.15.149:0/1491142355 >> v2:172.21.15.61:3300/0 conn(0x7f96780c1a20 0x7f9678159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-01-01T17:39:37.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.179+0000 7f967ddd8700 1 --2- 172.21.15.149:0/1491142355 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96780c5470 0x7f96780c0b80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f96780c5bd0 tx=0x7f967000b480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6c99c9c416ec78c server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:37.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.179+0000 7f967cdd6700 1 -- 172.21.15.149:0/1491142355 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967000e070 con 0x7f96780c5470 2023-01-01T17:39:37.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.179+0000 7f967cdd6700 1 -- 172.21.15.149:0/1491142355 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96700090d0 con 0x7f96780c5470 2023-01-01T17:39:37.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.179+0000 7f967cdd6700 1 -- 172.21.15.149:0/1491142355 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967000bd60 con 0x7f96780c5470 2023-01-01T17:39:37.182 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.180+0000 7f968003c700 1 -- 172.21.15.149:0/1491142355 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96780c5470 msgr2=0x7f96780c0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:37.182 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.180+0000 7f968003c700 1 --2- 172.21.15.149:0/1491142355 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96780c5470 0x7f96780c0b80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f96780c5bd0 tx=0x7f967000b480 comp rx=0 tx=0).stop 2023-01-01T17:39:37.182 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.180+0000 7f968003c700 1 -- 172.21.15.149:0/1491142355 shutdown_connections 2023-01-01T17:39:37.182 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.180+0000 7f968003c700 1 --2- 172.21.15.149:0/1491142355 >> v2:172.21.15.61:3300/0 conn(0x7f96780c1a20 0x7f9678159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:37.182 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.180+0000 7f968003c700 1 --2- 172.21.15.149:0/1491142355 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96780c5470 0x7f96780c0b80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:37.182 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.180+0000 7f968003c700 1 --2- 172.21.15.149:0/1491142355 >> v2:172.21.15.149:3300/0 conn(0x7f96780bf4c0 0x7f96780c14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:37.182 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.180+0000 7f968003c700 1 -- 172.21.15.149:0/1491142355 >> 172.21.15.149:0/1491142355 conn(0x7f9678069360 msgr2=0x7f9678069730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:37.182 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.180+0000 7f968003c700 1 -- 172.21.15.149:0/1491142355 shutdown_connections 2023-01-01T17:39:37.182 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.180+0000 7f968003c700 1 -- 172.21.15.149:0/1491142355 wait complete. 2023-01-01T17:39:37.183 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.182+0000 7f968003c700 1 Processor -- start 2023-01-01T17:39:37.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.182+0000 7f968003c700 1 -- start start 2023-01-01T17:39:37.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.183+0000 7f968003c700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96780bf4c0 0x7f9678070760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:37.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.183+0000 7f968003c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96780c1a20 0x7f967815a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:37.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.183+0000 7f968003c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f967815a870 0x7f967814f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:37.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.183+0000 7f968003c700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96780a8150 con 0x7f967815a870 2023-01-01T17:39:37.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.183+0000 7f968003c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9678071050 con 0x7f96780c1a20 2023-01-01T17:39:37.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.183+0000 7f968003c700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9678070d70 con 0x7f96780bf4c0 2023-01-01T17:39:37.187 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.183+0000 7f967e5d9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f967815a870 0x7f967814f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:37.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.183+0000 7f967e5d9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f967815a870 0x7f967814f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.149:53736/0 (socket says 172.21.15.149:53736) 2023-01-01T17:39:37.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.183+0000 7f967e5d9700 1 -- 172.21.15.149:0/21391316 learned_addr learned my addr 172.21.15.149:0/21391316 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-01-01T17:39:37.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.183+0000 7f967ddd8700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96780bf4c0 0x7f9678070760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:37.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.183+0000 7f967d5d7700 1 --2- 172.21.15.149:0/21391316 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96780c1a20 0x7f967815a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:37.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.184+0000 7f967e5d9700 1 -- 172.21.15.149:0/21391316 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96780bf4c0 msgr2=0x7f9678070760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:37.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.184+0000 7f967e5d9700 1 --2- 172.21.15.149:0/21391316 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96780bf4c0 0x7f9678070760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:37.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.184+0000 7f967e5d9700 1 -- 172.21.15.149:0/21391316 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96780c1a20 msgr2=0x7f967815a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:37.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.184+0000 7f967e5d9700 1 --2- 172.21.15.149:0/21391316 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96780c1a20 0x7f967815a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:37.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.184+0000 7f967e5d9700 1 -- 172.21.15.149:0/21391316 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96740094a0 con 0x7f967815a870 2023-01-01T17:39:37.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.184+0000 7f967d5d7700 1 --2- 172.21.15.149:0/21391316 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96780c1a20 0x7f967815a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-01-01T17:39:37.188 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.184+0000 7f967ddd8700 1 --2- 172.21.15.149:0/21391316 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96780bf4c0 0x7f9678070760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-01-01T17:39:37.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.184+0000 7f967e5d9700 1 --2- 172.21.15.149:0/21391316 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f967815a870 0x7f967814f2c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f967400e960 tx=0x7f967400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:37.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.184+0000 7f966e7fc700 1 -- 172.21.15.149:0/21391316 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9674009700 con 0x7f967815a870 2023-01-01T17:39:37.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.184+0000 7f966e7fc700 1 -- 172.21.15.149:0/21391316 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9674004020 con 0x7f967815a870 2023-01-01T17:39:37.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.184+0000 7f968003c700 1 -- 172.21.15.149:0/21391316 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9670009b30 con 0x7f967815a870 2023-01-01T17:39:37.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.184+0000 7f966e7fc700 1 -- 172.21.15.149:0/21391316 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96740043b0 con 0x7f967815a870 2023-01-01T17:39:37.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.184+0000 7f968003c700 1 -- 172.21.15.149:0/21391316 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96780c5840 con 0x7f967815a870 2023-01-01T17:39:37.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.185+0000 7f966e7fc700 1 -- 172.21.15.149:0/21391316 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f9674005d10 con 0x7f967815a870 2023-01-01T17:39:37.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.185+0000 7f966e7fc700 1 -- 172.21.15.149:0/21391316 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f9674004530 con 0x7f967815a870 2023-01-01T17:39:37.190 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.186+0000 7f968003c700 1 -- 172.21.15.149:0/21391316 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f967806c790 con 0x7f967815a870 2023-01-01T17:39:37.190 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.188+0000 7f966e7fc700 1 -- 172.21.15.149:0/21391316 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71767 (secure 0 0 0) 0x7f9674020060 con 0x7f967815a870 2023-01-01T17:39:37.291 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.291+0000 7f968003c700 1 -- 172.21.15.149:0/21391316 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5390c6e5-39e7-4aa6-b73c-642458b2acf7", "id": 7} v 0) v1 -- 0x7f96780b7b90 con 0x7f967815a870 2023-01-01T17:39:37.294 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.294+0000 7f966e7fc700 1 -- 172.21.15.149:0/21391316 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5390c6e5-39e7-4aa6-b73c-642458b2acf7", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9674028020 con 0x7f967815a870 2023-01-01T17:39:37.294 INFO:teuthology.orchestra.run.smithi149.stdout:7 2023-01-01T17:39:37.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.294+0000 7f968003c700 1 -- 172.21.15.149:0/21391316 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f967815a870 msgr2=0x7f967814f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:37.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.295+0000 7f968003c700 1 --2- 172.21.15.149:0/21391316 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f967815a870 0x7f967814f2c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f967400e960 tx=0x7f967400ec70 comp rx=0 tx=0).stop 2023-01-01T17:39:37.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.295+0000 7f968003c700 1 -- 172.21.15.149:0/21391316 shutdown_connections 2023-01-01T17:39:37.295 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.295+0000 7f968003c700 1 --2- 172.21.15.149:0/21391316 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f967815a870 0x7f967814f2c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:37.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.295+0000 7f968003c700 1 --2- 172.21.15.149:0/21391316 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f96780bf4c0 0x7f9678070760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:37.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.295+0000 7f968003c700 1 --2- 172.21.15.149:0/21391316 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96780c1a20 0x7f967815a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:37.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.295+0000 7f968003c700 1 -- 172.21.15.149:0/21391316 >> 172.21.15.149:0/21391316 conn(0x7f9678069360 msgr2=0x7f96780a4920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:37.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.295+0000 7f968003c700 1 -- 172.21.15.149:0/21391316 shutdown_connections 2023-01-01T17:39:37.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-01-01T17:39:37.295+0000 7f968003c700 1 -- 172.21.15.149:0/21391316 wait complete. 2023-01-01T17:39:37.307 INFO:tasks.ceph.osd.0:Restarting daemon 2023-01-01T17:39:37.308 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-01-01T17:39:37.310 INFO:tasks.ceph.osd.0:Started 2023-01-01T17:39:37.310 INFO:tasks.ceph.osd.1:Restarting daemon 2023-01-01T17:39:37.310 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-01-01T17:39:37.312 INFO:tasks.ceph.osd.1:Started 2023-01-01T17:39:37.312 INFO:tasks.ceph.osd.2:Restarting daemon 2023-01-01T17:39:37.312 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-01-01T17:39:37.314 INFO:tasks.ceph.osd.2:Started 2023-01-01T17:39:37.314 INFO:tasks.ceph.osd.3:Restarting daemon 2023-01-01T17:39:37.314 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-01-01T17:39:37.316 INFO:tasks.ceph.osd.3:Started 2023-01-01T17:39:37.316 INFO:tasks.ceph.osd.4:Restarting daemon 2023-01-01T17:39:37.316 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-01-01T17:39:37.318 INFO:tasks.ceph.osd.4:Started 2023-01-01T17:39:37.318 INFO:tasks.ceph.osd.5:Restarting daemon 2023-01-01T17:39:37.319 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-01-01T17:39:37.321 INFO:tasks.ceph.osd.5:Started 2023-01-01T17:39:37.321 INFO:tasks.ceph.osd.6:Restarting daemon 2023-01-01T17:39:37.321 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-01-01T17:39:37.324 INFO:tasks.ceph.osd.6:Started 2023-01-01T17:39:37.324 INFO:tasks.ceph.osd.7:Restarting daemon 2023-01-01T17:39:37.324 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-01-01T17:39:37.327 INFO:tasks.ceph.osd.7:Started 2023-01-01T17:39:37.328 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-01T17:39:37.368 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-01T17:39:37.367+0000 7f0b100eb200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-01-01T17:39:37.490 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.489+0000 7f279998d700 1 Processor -- start 2023-01-01T17:39:37.490 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.490+0000 7f279998d700 1 -- start start 2023-01-01T17:39:37.492 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.490+0000 7f279998d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f27940c3b80 0x7f279414ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:37.492 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.490+0000 7f279998d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f27941517e0 0x7f279414e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:37.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.490+0000 7f279998d700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2794151350 con 0x7f27940c37b0 2023-01-01T17:39:37.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.490+0000 7f279998d700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2794150b30 con 0x7f27941517e0 2023-01-01T17:39:37.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.490+0000 7f279998d700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f279406f6c0 con 0x7f27940c3b80 2023-01-01T17:39:37.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.490+0000 7f27937fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f27941517e0 0x7f279414e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:37.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.490+0000 7f27937fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f27941517e0 0x7f279414e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:45390/0 (socket says 172.21.15.61:45390) 2023-01-01T17:39:37.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.490+0000 7f27937fe700 1 -- 172.21.15.61:0/1436627922 learned_addr learned my addr 172.21.15.61:0/1436627922 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:37.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.491+0000 7f27927fc700 1 --2- 172.21.15.61:0/1436627922 >> v2:172.21.15.149:3300/0 conn(0x7f27940c3b80 0x7f279414ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:37.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.491+0000 7f27937fe700 1 -- 172.21.15.61:0/1436627922 >> v2:172.21.15.149:3300/0 conn(0x7f27940c3b80 msgr2=0x7f279414ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:37.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.491+0000 7f27937fe700 1 --2- 172.21.15.61:0/1436627922 >> v2:172.21.15.149:3300/0 conn(0x7f27940c3b80 0x7f279414ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:37.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.491+0000 7f27937fe700 1 -- 172.21.15.61:0/1436627922 >> v1:172.21.15.149:6789/0 conn(0x7f27940c37b0 legacy=0x7f27940c1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:37.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.491+0000 7f27937fe700 1 -- 172.21.15.61:0/1436627922 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2794150d40 con 0x7f27941517e0 2023-01-01T17:39:37.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.491+0000 7f27937fe700 1 --2- 172.21.15.61:0/1436627922 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f27941517e0 0x7f279414e410 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2794070340 tx=0x7f278c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b0a3a92ccefedf2 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:37.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.491+0000 7f2791ffb700 1 -- 172.21.15.61:0/1436627922 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c00e070 con 0x7f27941517e0 2023-01-01T17:39:37.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.491+0000 7f2791ffb700 1 -- 172.21.15.61:0/1436627922 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278c00b910 con 0x7f27941517e0 2023-01-01T17:39:37.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.491+0000 7f2791ffb700 1 -- 172.21.15.61:0/1436627922 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c00bcc0 con 0x7f27941517e0 2023-01-01T17:39:37.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.492+0000 7f279998d700 1 -- 172.21.15.61:0/1436627922 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f27941517e0 msgr2=0x7f279414e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:37.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.492+0000 7f279998d700 1 --2- 172.21.15.61:0/1436627922 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f27941517e0 0x7f279414e410 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2794070340 tx=0x7f278c00b330 comp rx=0 tx=0).stop 2023-01-01T17:39:37.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.492+0000 7f279998d700 1 -- 172.21.15.61:0/1436627922 shutdown_connections 2023-01-01T17:39:37.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.492+0000 7f279998d700 1 --2- 172.21.15.61:0/1436627922 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f27941517e0 0x7f279414e410 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:37.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.492+0000 7f279998d700 1 --2- 172.21.15.61:0/1436627922 >> v2:172.21.15.149:3300/0 conn(0x7f27940c3b80 0x7f279414ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:37.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.492+0000 7f279998d700 1 -- 172.21.15.61:0/1436627922 >> 172.21.15.61:0/1436627922 conn(0x7f27940a8900 msgr2=0x7f27940a8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:37.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.492+0000 7f279998d700 1 -- 172.21.15.61:0/1436627922 shutdown_connections 2023-01-01T17:39:37.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.492+0000 7f279998d700 1 -- 172.21.15.61:0/1436627922 wait complete. 2023-01-01T17:39:37.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.493+0000 7f279998d700 1 Processor -- start 2023-01-01T17:39:37.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.493+0000 7f279998d700 1 -- start start 2023-01-01T17:39:37.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.494+0000 7f279998d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f27940c37b0 0x7f27941e3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:37.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.494+0000 7f279998d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27940c3b80 0x7f27941e9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:37.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.494+0000 7f279998d700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f27941517e0 0x7f27940a2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:37.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.494+0000 7f279998d700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279414d600 con 0x7f27940c37b0 2023-01-01T17:39:37.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.494+0000 7f279998d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27941e94a0 con 0x7f27940c3b80 2023-01-01T17:39:37.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.494+0000 7f279998d700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27941e9780 con 0x7f27941517e0 2023-01-01T17:39:37.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.494+0000 7f2792ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f27940c37b0 0x7f27941e3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:37.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.494+0000 7f2792ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f27940c37b0 0x7f27941e3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:45392/0 (socket says 172.21.15.61:45392) 2023-01-01T17:39:37.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.494+0000 7f2792ffd700 1 -- 172.21.15.61:0/2360437698 learned_addr learned my addr 172.21.15.61:0/2360437698 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:37.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.494+0000 7f27927fc700 1 --2- 172.21.15.61:0/2360437698 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27940c3b80 0x7f27941e9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:37.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.494+0000 7f27937fe700 1 --2- 172.21.15.61:0/2360437698 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f27941517e0 0x7f27940a2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:37.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.494+0000 7f2792ffd700 1 -- 172.21.15.61:0/2360437698 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f27941517e0 msgr2=0x7f27940a2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:37.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.494+0000 7f2792ffd700 1 --2- 172.21.15.61:0/2360437698 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f27941517e0 0x7f27940a2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:37.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.494+0000 7f2792ffd700 1 -- 172.21.15.61:0/2360437698 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27940c3b80 msgr2=0x7f27941e9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:37.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.494+0000 7f2792ffd700 1 --2- 172.21.15.61:0/2360437698 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27940c3b80 0x7f27941e9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:37.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.494+0000 7f2792ffd700 1 -- 172.21.15.61:0/2360437698 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278c009b30 con 0x7f27940c37b0 2023-01-01T17:39:37.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.494+0000 7f2792ffd700 1 --2- 172.21.15.61:0/2360437698 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f27940c37b0 0x7f27941e3760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f278400c450 tx=0x7f278400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:37.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.494+0000 7f278bfff700 1 -- 172.21.15.61:0/2360437698 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27840052d0 con 0x7f27940c37b0 2023-01-01T17:39:37.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.495+0000 7f278bfff700 1 -- 172.21.15.61:0/2360437698 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2784005430 con 0x7f27940c37b0 2023-01-01T17:39:37.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.495+0000 7f279998d700 1 -- 172.21.15.61:0/2360437698 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2794150fe0 con 0x7f27940c37b0 2023-01-01T17:39:37.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.495+0000 7f278bfff700 1 -- 172.21.15.61:0/2360437698 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27840038c0 con 0x7f27940c37b0 2023-01-01T17:39:37.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.495+0000 7f279998d700 1 -- 172.21.15.61:0/2360437698 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f279406f3e0 con 0x7f27940c37b0 2023-01-01T17:39:37.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.495+0000 7f278bfff700 1 -- 172.21.15.61:0/2360437698 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f2784019030 con 0x7f27940c37b0 2023-01-01T17:39:37.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.495+0000 7f278bfff700 1 -- 172.21.15.61:0/2360437698 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f278401b3b0 con 0x7f27940c37b0 2023-01-01T17:39:37.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.495+0000 7f279998d700 1 -- 172.21.15.61:0/2360437698 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f279406f070 con 0x7f27940c37b0 2023-01-01T17:39:37.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.499+0000 7f278bfff700 1 -- 172.21.15.61:0/2360437698 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71767 (secure 0 0 0) 0x7f2784017070 con 0x7f27940c37b0 2023-01-01T17:39:37.542 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-01T17:39:37.542+0000 7f0b100eb200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-01-01T17:39:37.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.569+0000 7f279998d700 1 -- 172.21.15.61:0/2360437698 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27940668a0 con 0x7f27940c37b0 2023-01-01T17:39:37.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.570+0000 7f278bfff700 1 -- 172.21.15.61:0/2360437698 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7035 (secure 0 0 0) 0x7f2784003a20 con 0x7f27940c37b0 2023-01-01T17:39:37.570 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:37.570 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":10,"fsid":"fe0d3d8e-46ee-4ed9-92f8-749741721d01","created":"2023-01-01T17:39:34.752404+0000","modified":"2023-01-01T17:39:37.293057+0000","last_up_change":"0.000000","last_in_change":"2023-01-01T17:39:37.293057+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[],"osds":[{"osd":0,"uuid":"5ba13bcd-4407-4cfd-8487-80917501e525","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7dca9f34-ea22-4894-b238-5606b16b9c74","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7b43ea06-a7b6-49f4-a390-18ad14dfe4fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"117c41d8-d40c-4cc0-b0e1-70bca058fa72","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4073e0e8-c5dd-463f-aa1c-c9515ef09976","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"88aa0c0f-e3c1-4dd3-af8c-61f4bc28504e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8b13fc0c-5f00-41c7-8923-c4570da77afd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5390c6e5-39e7-4aa6-b73c-642458b2acf7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-01T17:39:37.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.571+0000 7f279998d700 1 -- 172.21.15.61:0/2360437698 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f27940c37b0 msgr2=0x7f27941e3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:37.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.571+0000 7f279998d700 1 --2- 172.21.15.61:0/2360437698 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f27940c37b0 0x7f27941e3760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f278400c450 tx=0x7f278400c760 comp rx=0 tx=0).stop 2023-01-01T17:39:37.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.571+0000 7f279998d700 1 -- 172.21.15.61:0/2360437698 shutdown_connections 2023-01-01T17:39:37.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.571+0000 7f279998d700 1 --2- 172.21.15.61:0/2360437698 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f27941517e0 0x7f27940a2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:37.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.571+0000 7f279998d700 1 --2- 172.21.15.61:0/2360437698 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f27940c37b0 0x7f27941e3760 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:37.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.571+0000 7f279998d700 1 --2- 172.21.15.61:0/2360437698 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f27940c3b80 0x7f27941e9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:37.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.571+0000 7f279998d700 1 -- 172.21.15.61:0/2360437698 >> 172.21.15.61:0/2360437698 conn(0x7f27940a8900 msgr2=0x7f27940bd360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:37.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.571+0000 7f279998d700 1 -- 172.21.15.61:0/2360437698 shutdown_connections 2023-01-01T17:39:37.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:37.571+0000 7f279998d700 1 -- 172.21.15.61:0/2360437698 wait complete. 2023-01-01T17:39:37.583 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-01-01T17:39:37.584 INFO:tasks.ceph:Waiting for OSDs to come up 2023-01-01T17:39:37.690 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-01-01T17:39:37.690+0000 7fcece137200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-01-01T17:39:37.883 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-01-01T17:39:37.882+0000 7fcece137200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-01-01T17:39:37.923 INFO:tasks.ceph.osd.6.smithi149.stderr:2023-01-01T17:39:37.923+0000 7f477b45c5c0 -1 Falling back to public interface 2023-01-01T17:39:37.924 INFO:tasks.ceph.osd.5.smithi149.stderr:2023-01-01T17:39:37.924+0000 7f7c2f6d05c0 -1 Falling back to public interface 2023-01-01T17:39:37.941 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:39:37.940+0000 7f9d774235c0 -1 Falling back to public interface 2023-01-01T17:39:37.948 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:39:37.947+0000 7f6dbd2b75c0 -1 Falling back to public interface 2023-01-01T17:39:37.949 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:39:37.948+0000 7f44bdf9d5c0 -1 Falling back to public interface 2023-01-01T17:39:37.950 INFO:tasks.ceph.osd.4.smithi149.stderr:2023-01-01T17:39:37.950+0000 7fe7c0fc95c0 -1 Falling back to public interface 2023-01-01T17:39:37.952 INFO:tasks.ceph.osd.7.smithi149.stderr:2023-01-01T17:39:37.950+0000 7f3ad62655c0 -1 Falling back to public interface 2023-01-01T17:39:37.956 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:39:37.956+0000 7f2570e575c0 -1 Falling back to public interface 2023-01-01T17:39:38.031 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-01-01T17:39:38.030+0000 7fcece137200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-01-01T17:39:38.110 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-01T17:39:38.109+0000 7f0b100eb200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-01-01T17:39:38.195 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-01-01T17:39:38.194+0000 7fcece137200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-01-01T17:39:38.303 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-01T17:39:38.303+0000 7f0b100eb200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-01-01T17:39:38.332 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-01-01T17:39:38.332+0000 7fcece137200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-01-01T17:39:38.390 DEBUG:teuthology.orchestra.run.smithi061:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-01-01T17:39:38.438 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-01T17:39:38.438+0000 7f0b100eb200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-01-01T17:39:38.508 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.507+0000 7fbdf2342700 1 Processor -- start 2023-01-01T17:39:38.508 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.507+0000 7fbdf2342700 1 -- start start 2023-01-01T17:39:38.510 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.508+0000 7fbdf2342700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fbdec153b00 0x7fbdec1505a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:38.510 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.508+0000 7fbdf2342700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdec154300 con 0x7fbdec0715a0 2023-01-01T17:39:38.510 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.508+0000 7fbdf2342700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdec0c07c0 con 0x7fbdec153730 2023-01-01T17:39:38.510 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.508+0000 7fbdf2342700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdec0c0b60 con 0x7fbdec153b00 2023-01-01T17:39:38.510 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.508+0000 7fbdf08df700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fbdec153b00 0x7fbdec1505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:38.510 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.508+0000 7fbdeb7fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fbdec0715a0 0x7fbdec14fe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39250/0 (socket says 172.21.15.61:39250) 2023-01-01T17:39:38.510 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.508+0000 7fbdeb7fe700 1 -- 172.21.15.61:0/3122370251 learned_addr learned my addr 172.21.15.61:0/3122370251 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:39:38.511 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.508+0000 7fbdeaffd700 1 -- 172.21.15.61:0/3122370251 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 743222980 0 0) 0x7fbdec154300 con 0x7fbdec0715a0 2023-01-01T17:39:38.511 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.508+0000 7fbdeaffd700 1 -- 172.21.15.61:0/3122370251 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdd40035b0 con 0x7fbdec0715a0 2023-01-01T17:39:38.511 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.509+0000 7fbdf08df700 1 -- 172.21.15.61:0/3122370251 >> v1:172.21.15.149:6789/0 conn(0x7fbdec153730 legacy=0x7fbdec0c6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:38.511 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.509+0000 7fbdf08df700 1 -- 172.21.15.61:0/3122370251 >> v1:172.21.15.61:6789/0 conn(0x7fbdec0715a0 legacy=0x7fbdec14fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:38.511 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.509+0000 7fbdf08df700 1 -- 172.21.15.61:0/3122370251 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdec154020 con 0x7fbdec153b00 2023-01-01T17:39:38.511 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.509+0000 7fbdf08df700 1 --2- 172.21.15.61:0/3122370251 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbdec153b00 0x7fbdec1505a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbde4009d90 tx=0x7fbde400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1cc6f586215f12f server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:38.511 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.509+0000 7fbdeaffd700 1 -- 172.21.15.61:0/3122370251 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde400e070 con 0x7fbdec153b00 2023-01-01T17:39:38.511 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.509+0000 7fbdeaffd700 1 -- 172.21.15.61:0/3122370251 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde400bb20 con 0x7fbdec153b00 2023-01-01T17:39:38.511 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.509+0000 7fbdeaffd700 1 -- 172.21.15.61:0/3122370251 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde4012430 con 0x7fbdec153b00 2023-01-01T17:39:38.511 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.510+0000 7fbdf2342700 1 -- 172.21.15.61:0/3122370251 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbdec153b00 msgr2=0x7fbdec1505a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:38.511 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.510+0000 7fbdf2342700 1 --2- 172.21.15.61:0/3122370251 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbdec153b00 0x7fbdec1505a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbde4009d90 tx=0x7fbde400b330 comp rx=0 tx=0).stop 2023-01-01T17:39:38.512 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.510+0000 7fbdf2342700 1 -- 172.21.15.61:0/3122370251 shutdown_connections 2023-01-01T17:39:38.512 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.510+0000 7fbdf2342700 1 --2- 172.21.15.61:0/3122370251 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbdec153b00 0x7fbdec1505a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:38.512 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.510+0000 7fbdf2342700 1 -- 172.21.15.61:0/3122370251 >> 172.21.15.61:0/3122370251 conn(0x7fbdec0a84d0 msgr2=0x7fbdec0c5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:38.512 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.510+0000 7fbdf2342700 1 -- 172.21.15.61:0/3122370251 shutdown_connections 2023-01-01T17:39:38.512 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.510+0000 7fbdf2342700 1 -- 172.21.15.61:0/3122370251 wait complete. 2023-01-01T17:39:38.515 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.511+0000 7fbdf2342700 1 Processor -- start 2023-01-01T17:39:38.515 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.511+0000 7fbdf2342700 1 -- start start 2023-01-01T17:39:38.515 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.512+0000 7fbdf2342700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbdec0715a0 0x7fbdec069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:38.515 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.512+0000 7fbdf2342700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdec153730 0x7fbdec1ebae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:38.515 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.512+0000 7fbdf2342700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdec153b00 0x7fbdec0bd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:38.515 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.512+0000 7fbdf2342700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdec1e84f0 con 0x7fbdec0715a0 2023-01-01T17:39:38.515 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.512+0000 7fbdf2342700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdec1e8a50 con 0x7fbdec153b00 2023-01-01T17:39:38.515 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.512+0000 7fbdf2342700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdec1ec020 con 0x7fbdec153730 2023-01-01T17:39:38.515 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.512+0000 7fbdebfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbdec0715a0 0x7fbdec069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:38.516 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.512+0000 7fbdebfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbdec0715a0 0x7fbdec069350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:45404/0 (socket says 172.21.15.61:45404) 2023-01-01T17:39:38.516 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.512+0000 7fbdebfff700 1 -- 172.21.15.61:0/827017126 learned_addr learned my addr 172.21.15.61:0/827017126 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:38.516 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.512+0000 7fbdeb7fe700 1 --2- 172.21.15.61:0/827017126 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdec153730 0x7fbdec1ebae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:38.516 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.512+0000 7fbdf08df700 1 --2- 172.21.15.61:0/827017126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdec153b00 0x7fbdec0bd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:38.516 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.512+0000 7fbdebfff700 1 -- 172.21.15.61:0/827017126 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdec153730 msgr2=0x7fbdec1ebae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:38.516 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.512+0000 7fbdebfff700 1 --2- 172.21.15.61:0/827017126 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdec153730 0x7fbdec1ebae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:38.516 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.512+0000 7fbdebfff700 1 -- 172.21.15.61:0/827017126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdec153b00 msgr2=0x7fbdec0bd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:38.516 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.512+0000 7fbdebfff700 1 --2- 172.21.15.61:0/827017126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdec153b00 0x7fbdec0bd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:38.516 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.512+0000 7fbdebfff700 1 -- 172.21.15.61:0/827017126 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde4009a70 con 0x7fbdec0715a0 2023-01-01T17:39:38.516 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.512+0000 7fbdebfff700 1 --2- 172.21.15.61:0/827017126 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbdec0715a0 0x7fbdec069350 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbddc00c510 tx=0x7fbddc00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:38.516 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.513+0000 7fbde8ff9700 1 -- 172.21.15.61:0/827017126 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbddc0052d0 con 0x7fbdec0715a0 2023-01-01T17:39:38.516 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.513+0000 7fbde8ff9700 1 -- 172.21.15.61:0/827017126 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbddc005430 con 0x7fbdec0715a0 2023-01-01T17:39:38.517 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.513+0000 7fbde8ff9700 1 -- 172.21.15.61:0/827017126 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbddc0038c0 con 0x7fbdec0715a0 2023-01-01T17:39:38.517 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.513+0000 7fbdf2342700 1 -- 172.21.15.61:0/827017126 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdec0c6b30 con 0x7fbdec0715a0 2023-01-01T17:39:38.517 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.513+0000 7fbdf2342700 1 -- 172.21.15.61:0/827017126 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdec150ae0 con 0x7fbdec0715a0 2023-01-01T17:39:38.517 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.513+0000 7fbde8ff9700 1 -- 172.21.15.61:0/827017126 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fbddc019030 con 0x7fbdec0715a0 2023-01-01T17:39:38.517 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.513+0000 7fbde8ff9700 1 -- 172.21.15.61:0/827017126 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fbddc01b3b0 con 0x7fbdec0715a0 2023-01-01T17:39:38.517 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.514+0000 7fbdf2342700 1 -- 172.21.15.61:0/827017126 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdec0a5490 con 0x7fbdec0715a0 2023-01-01T17:39:38.517 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.516+0000 7fbde8ff9700 1 -- 172.21.15.61:0/827017126 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71767 (secure 0 0 0) 0x7fbddc017070 con 0x7fbdec0715a0 2023-01-01T17:39:38.587 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.586+0000 7fbdf2342700 1 -- 172.21.15.61:0/827017126 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbdec04d760 con 0x7fbdec0715a0 2023-01-01T17:39:38.587 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.587+0000 7fbde8ff9700 1 -- 172.21.15.61:0/827017126 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7035 (secure 0 0 0) 0x7fbddc003a20 con 0x7fbdec0715a0 2023-01-01T17:39:38.588 INFO:teuthology.misc.health.smithi061.stdout: 2023-01-01T17:39:38.588 INFO:teuthology.misc.health.smithi061.stdout:{"epoch":10,"fsid":"fe0d3d8e-46ee-4ed9-92f8-749741721d01","created":"2023-01-01T17:39:34.752404+0000","modified":"2023-01-01T17:39:37.293057+0000","last_up_change":"0.000000","last_in_change":"2023-01-01T17:39:37.293057+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[],"osds":[{"osd":0,"uuid":"5ba13bcd-4407-4cfd-8487-80917501e525","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7dca9f34-ea22-4894-b238-5606b16b9c74","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7b43ea06-a7b6-49f4-a390-18ad14dfe4fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"117c41d8-d40c-4cc0-b0e1-70bca058fa72","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4073e0e8-c5dd-463f-aa1c-c9515ef09976","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"88aa0c0f-e3c1-4dd3-af8c-61f4bc28504e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8b13fc0c-5f00-41c7-8923-c4570da77afd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5390c6e5-39e7-4aa6-b73c-642458b2acf7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-01T17:39:38.589 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.588+0000 7fbdf2342700 1 -- 172.21.15.61:0/827017126 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbdec0715a0 msgr2=0x7fbdec069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:38.589 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.588+0000 7fbdf2342700 1 --2- 172.21.15.61:0/827017126 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbdec0715a0 0x7fbdec069350 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbddc00c510 tx=0x7fbddc00c820 comp rx=0 tx=0).stop 2023-01-01T17:39:38.589 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.588+0000 7fbdf2342700 1 -- 172.21.15.61:0/827017126 shutdown_connections 2023-01-01T17:39:38.589 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.588+0000 7fbdf2342700 1 --2- 172.21.15.61:0/827017126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbdec153b00 0x7fbdec0bd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:38.589 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.588+0000 7fbdf2342700 1 --2- 172.21.15.61:0/827017126 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbdec0715a0 0x7fbdec069350 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:38.589 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.588+0000 7fbdf2342700 1 --2- 172.21.15.61:0/827017126 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbdec153730 0x7fbdec1ebae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:38.590 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.588+0000 7fbdf2342700 1 -- 172.21.15.61:0/827017126 >> 172.21.15.61:0/827017126 conn(0x7fbdec0a84d0 msgr2=0x7fbdec06fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:38.590 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.588+0000 7fbdf2342700 1 -- 172.21.15.61:0/827017126 shutdown_connections 2023-01-01T17:39:38.590 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:38.588+0000 7fbdf2342700 1 -- 172.21.15.61:0/827017126 wait complete. 2023-01-01T17:39:38.598 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-01T17:39:38.598+0000 7f0b100eb200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-01-01T17:39:38.600 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-01-01T17:39:38.699 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-01-01T17:39:38.698+0000 7fcece137200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-01-01T17:39:38.727 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-01T17:39:38.726+0000 7f0b100eb200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-01-01T17:39:38.856 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-01-01T17:39:38.855+0000 7fcece137200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-01-01T17:39:38.976 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-01-01T17:39:38.976+0000 7fcece137200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-01-01T17:39:39.088 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-01T17:39:39.088+0000 7f0b100eb200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-01-01T17:39:39.127 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-01-01T17:39:39.127+0000 7fcece137200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-01-01T17:39:39.229 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-01-01T17:39:39.229+0000 7fcece137200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-01-01T17:39:39.239 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-01T17:39:39.239+0000 7f0b100eb200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-01-01T17:39:39.355 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-01T17:39:39.354+0000 7f0b100eb200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-01-01T17:39:39.499 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-01T17:39:39.498+0000 7f0b100eb200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-01-01T17:39:39.597 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-01T17:39:39.596+0000 7f0b100eb200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-01-01T17:39:39.597 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-01-01T17:39:39.597+0000 7fcece137200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-01-01T17:39:39.963 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-01T17:39:39.962+0000 7f0b100eb200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-01-01T17:39:40.202 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-01-01T17:39:40.202+0000 7fcece137200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-01-01T17:39:40.203 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-01-01T17:39:40.202+0000 7fcece137200 -1 log_channel(cluster) log [ERR] : Failed to load ceph-mgr modules: prometheus 2023-01-01T17:39:40.552 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-01T17:39:40.552+0000 7f0b100eb200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-01-01T17:39:40.552 INFO:tasks.ceph.mgr.x.smithi149.stderr:2023-01-01T17:39:40.552+0000 7f0b100eb200 -1 log_channel(cluster) log [ERR] : Failed to load ceph-mgr modules: prometheus 2023-01-01T17:39:41.227 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-01-01T17:39:41.226+0000 7fce87a31700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-01-01T17:39:41.227 INFO:tasks.ceph.mgr.y.smithi061.stderr:2023-01-01T17:39:41.227+0000 7fce87a31700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-01-01T17:39:41.457 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:39:41.457+0000 7f44bdf9d5c0 -1 osd.1 0 log_to_monitors true 2023-01-01T17:39:41.467 INFO:tasks.ceph.osd.5.smithi149.stderr:2023-01-01T17:39:41.467+0000 7f7c2f6d05c0 -1 osd.5 0 log_to_monitors true 2023-01-01T17:39:41.487 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:39:41.486+0000 7f6dbd2b75c0 -1 osd.2 0 log_to_monitors true 2023-01-01T17:39:41.488 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:39:41.488+0000 7f9d774235c0 -1 osd.3 0 log_to_monitors true 2023-01-01T17:39:41.503 INFO:tasks.ceph.osd.6.smithi149.stderr:2023-01-01T17:39:41.503+0000 7f477b45c5c0 -1 osd.6 0 log_to_monitors true 2023-01-01T17:39:41.507 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:39:41.507+0000 7f2570e575c0 -1 osd.0 0 log_to_monitors true 2023-01-01T17:39:41.516 INFO:tasks.ceph.osd.7.smithi149.stderr:2023-01-01T17:39:41.516+0000 7f3ad62655c0 -1 osd.7 0 log_to_monitors true 2023-01-01T17:39:41.525 INFO:tasks.ceph.osd.4.smithi149.stderr:2023-01-01T17:39:41.525+0000 7fe7c0fc95c0 -1 osd.4 0 log_to_monitors true 2023-01-01T17:39:44.145 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:39:44.144+0000 7f256520f700 -1 osd.0 0 waiting for initial osdmap 2023-01-01T17:39:44.162 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:39:44.162+0000 7f255cde9700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-01T17:39:44.183 INFO:tasks.ceph.osd.5.smithi149.stderr:2023-01-01T17:39:44.183+0000 7f7c23a88700 -1 osd.5 0 waiting for initial osdmap 2023-01-01T17:39:44.183 INFO:tasks.ceph.osd.4.smithi149.stderr:2023-01-01T17:39:44.183+0000 7fe7b5381700 -1 osd.4 0 waiting for initial osdmap 2023-01-01T17:39:44.184 INFO:tasks.ceph.osd.6.smithi149.stderr:2023-01-01T17:39:44.184+0000 7f476f814700 -1 osd.6 0 waiting for initial osdmap 2023-01-01T17:39:44.186 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:39:44.183+0000 7f6db166f700 -1 osd.2 0 waiting for initial osdmap 2023-01-01T17:39:44.188 INFO:tasks.ceph.osd.7.smithi149.stderr:2023-01-01T17:39:44.188+0000 7f3aca61d700 -1 osd.7 0 waiting for initial osdmap 2023-01-01T17:39:44.194 INFO:tasks.ceph.osd.5.smithi149.stderr:2023-01-01T17:39:44.194+0000 7f7c1b662700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-01T17:39:44.199 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:39:44.199+0000 7f6da9249700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-01T17:39:44.202 INFO:tasks.ceph.osd.6.smithi149.stderr:2023-01-01T17:39:44.202+0000 7f47673ee700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-01T17:39:44.203 INFO:tasks.ceph.osd.4.smithi149.stderr:2023-01-01T17:39:44.203+0000 7fe7acf5b700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-01T17:39:44.209 INFO:tasks.ceph.osd.7.smithi149.stderr:2023-01-01T17:39:44.209+0000 7f3ac21f7700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-01T17:39:44.372 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:39:44.372+0000 7f9d6b7db700 -1 osd.3 0 waiting for initial osdmap 2023-01-01T17:39:44.381 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:39:44.381+0000 7f44b2355700 -1 osd.1 0 waiting for initial osdmap 2023-01-01T17:39:44.386 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:39:44.386+0000 7f9d633b5700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-01T17:39:44.398 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:39:44.398+0000 7f44a9f2f700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-01T17:39:45.405 DEBUG:teuthology.orchestra.run.smithi061:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-01-01T17:39:45.535 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.535+0000 7f3d38b23700 1 Processor -- start 2023-01-01T17:39:45.535 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.535+0000 7f3d38b23700 1 -- start start 2023-01-01T17:39:45.537 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.536+0000 7f3d38b23700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3d340c1000 0x7f3d34154c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:45.538 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.536+0000 7f3d38b23700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d340702b0 0x7f3d340c52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:45.538 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.536+0000 7f3d38b23700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3d340c5830 0x7f3d34151360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:45.538 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.536+0000 7f3d38b23700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d340c4240 con 0x7f3d340c5830 2023-01-01T17:39:45.538 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.536+0000 7f3d38b23700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d3406f780 con 0x7f3d340c1000 2023-01-01T17:39:45.538 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.536+0000 7f3d38b23700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3414e780 con 0x7f3d340702b0 2023-01-01T17:39:45.538 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.536+0000 7f3d32d9d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3d340c5830 0x7f3d34151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:45.538 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.536+0000 7f3d32d9d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3d340c5830 0x7f3d34151360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:45622/0 (socket says 172.21.15.61:45622) 2023-01-01T17:39:45.538 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.536+0000 7f3d32d9d700 1 -- 172.21.15.61:0/3539965131 learned_addr learned my addr 172.21.15.61:0/3539965131 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:45.538 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.536+0000 7f3d3259c700 1 --2- 172.21.15.61:0/3539965131 >> v2:172.21.15.149:3300/0 conn(0x7f3d340c1000 0x7f3d34154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:45.538 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.536+0000 7f3d32d9d700 1 -- 172.21.15.61:0/3539965131 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d340702b0 msgr2=0x7f3d340c52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:45.539 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.536+0000 7f3d32d9d700 1 --2- 172.21.15.61:0/3539965131 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d340702b0 0x7f3d340c52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:45.539 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.536+0000 7f3d32d9d700 1 -- 172.21.15.61:0/3539965131 >> v2:172.21.15.149:3300/0 conn(0x7f3d340c1000 msgr2=0x7f3d34154c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:45.539 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.536+0000 7f3d32d9d700 1 --2- 172.21.15.61:0/3539965131 >> v2:172.21.15.149:3300/0 conn(0x7f3d340c1000 0x7f3d34154c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:45.539 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.536+0000 7f3d32d9d700 1 -- 172.21.15.61:0/3539965131 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d340c49e0 con 0x7f3d340c5830 2023-01-01T17:39:45.539 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.536+0000 7f3d32d9d700 1 --2- 172.21.15.61:0/3539965131 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3d340c5830 0x7f3d34151360 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3d3406e510 tx=0x7f3d2c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59dfda9f87963364 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:45.539 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.536+0000 7f3d3159a700 1 -- 172.21.15.61:0/3539965131 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c00e070 con 0x7f3d340c5830 2023-01-01T17:39:45.539 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.536+0000 7f3d3159a700 1 -- 172.21.15.61:0/3539965131 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2c00b980 con 0x7f3d340c5830 2023-01-01T17:39:45.539 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.536+0000 7f3d3159a700 1 -- 172.21.15.61:0/3539965131 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c00bd30 con 0x7f3d340c5830 2023-01-01T17:39:45.540 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.537+0000 7f3d38b23700 1 -- 172.21.15.61:0/3539965131 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3d340c5830 msgr2=0x7f3d34151360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:45.540 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.537+0000 7f3d38b23700 1 --2- 172.21.15.61:0/3539965131 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3d340c5830 0x7f3d34151360 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3d3406e510 tx=0x7f3d2c00b330 comp rx=0 tx=0).stop 2023-01-01T17:39:45.540 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.537+0000 7f3d38b23700 1 -- 172.21.15.61:0/3539965131 shutdown_connections 2023-01-01T17:39:45.540 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.537+0000 7f3d38b23700 1 --2- 172.21.15.61:0/3539965131 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3d340c5830 0x7f3d34151360 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:45.540 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.537+0000 7f3d38b23700 1 --2- 172.21.15.61:0/3539965131 >> v2:172.21.15.149:3300/0 conn(0x7f3d340c1000 0x7f3d34154c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:45.540 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.537+0000 7f3d38b23700 1 --2- 172.21.15.61:0/3539965131 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d340702b0 0x7f3d340c52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:45.540 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.537+0000 7f3d38b23700 1 -- 172.21.15.61:0/3539965131 >> 172.21.15.61:0/3539965131 conn(0x7f3d340a7410 msgr2=0x7f3d340c4be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:45.540 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.537+0000 7f3d38b23700 1 -- 172.21.15.61:0/3539965131 shutdown_connections 2023-01-01T17:39:45.540 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.537+0000 7f3d38b23700 1 -- 172.21.15.61:0/3539965131 wait complete. 2023-01-01T17:39:45.543 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.538+0000 7f3d38b23700 1 Processor -- start 2023-01-01T17:39:45.543 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.538+0000 7f3d38b23700 1 -- start start 2023-01-01T17:39:45.543 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.539+0000 7f3d38b23700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3d340702b0 0x7f3d3414b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:45.543 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.539+0000 7f3d38b23700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d340c1000 0x7f3d3414a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:45.543 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.539+0000 7f3d38b23700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d340c5830 0x7f3d341e9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:45.543 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.539+0000 7f3d38b23700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d340be9d0 con 0x7f3d340702b0 2023-01-01T17:39:45.543 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.539+0000 7f3d38b23700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d340be620 con 0x7f3d340c1000 2023-01-01T17:39:45.543 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.539+0000 7f3d38b23700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d340bbcb0 con 0x7f3d340c5830 2023-01-01T17:39:45.544 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.539+0000 7f3d3259c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3d340702b0 0x7f3d3414b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:45.544 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.539+0000 7f3d3259c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3d340702b0 0x7f3d3414b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:45624/0 (socket says 172.21.15.61:45624) 2023-01-01T17:39:45.544 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.539+0000 7f3d3259c700 1 -- 172.21.15.61:0/1112048868 learned_addr learned my addr 172.21.15.61:0/1112048868 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:45.544 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.539+0000 7f3d32d9d700 1 --2- 172.21.15.61:0/1112048868 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d340c5830 0x7f3d341e9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:45.544 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.539+0000 7f3d31d9b700 1 --2- 172.21.15.61:0/1112048868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d340c1000 0x7f3d3414a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:45.544 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.539+0000 7f3d3259c700 1 -- 172.21.15.61:0/1112048868 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d340c5830 msgr2=0x7f3d341e9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:45.544 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.539+0000 7f3d3259c700 1 --2- 172.21.15.61:0/1112048868 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d340c5830 0x7f3d341e9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:45.544 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.539+0000 7f3d3259c700 1 -- 172.21.15.61:0/1112048868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d340c1000 msgr2=0x7f3d3414a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:45.544 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.539+0000 7f3d3259c700 1 --2- 172.21.15.61:0/1112048868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d340c1000 0x7f3d3414a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:45.545 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.539+0000 7f3d3259c700 1 -- 172.21.15.61:0/1112048868 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2c009b30 con 0x7f3d340702b0 2023-01-01T17:39:45.545 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.540+0000 7f3d3259c700 1 --2- 172.21.15.61:0/1112048868 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3d340702b0 0x7f3d3414b010 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3d2400c7f0 tx=0x7f3d2400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:45.545 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.540+0000 7f3d22ffd700 1 -- 172.21.15.61:0/1112048868 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d24011800 con 0x7f3d340702b0 2023-01-01T17:39:45.545 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.540+0000 7f3d22ffd700 1 -- 172.21.15.61:0/1112048868 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d24011960 con 0x7f3d340702b0 2023-01-01T17:39:45.545 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.540+0000 7f3d38b23700 1 -- 172.21.15.61:0/1112048868 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d340c4700 con 0x7f3d340702b0 2023-01-01T17:39:45.546 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.540+0000 7f3d22ffd700 1 -- 172.21.15.61:0/1112048868 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d24011cf0 con 0x7f3d340702b0 2023-01-01T17:39:45.546 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.540+0000 7f3d38b23700 1 -- 172.21.15.61:0/1112048868 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d340c4420 con 0x7f3d340702b0 2023-01-01T17:39:45.546 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.541+0000 7f3d38b23700 1 -- 172.21.15.61:0/1112048868 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d34150e40 con 0x7f3d340702b0 2023-01-01T17:39:45.546 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.541+0000 7f3d22ffd700 1 -- 172.21.15.61:0/1112048868 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 4) v1 ==== 81907+0+0 (secure 0 0 0) 0x7f3d24021070 con 0x7f3d340702b0 2023-01-01T17:39:45.547 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.541+0000 7f3d22ffd700 1 --2- 172.21.15.61:0/1112048868 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3d14063240 0x7f3d140656f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:45.547 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.541+0000 7f3d22ffd700 1 -- 172.21.15.61:0/1112048868 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f3d2407f320 con 0x7f3d340702b0 2023-01-01T17:39:45.547 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.542+0000 7f3d31d9b700 1 --2- 172.21.15.61:0/1112048868 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3d14063240 0x7f3d140656f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:45.548 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.542+0000 7f3d31d9b700 1 --2- 172.21.15.61:0/1112048868 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3d14063240 0x7f3d140656f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3d28006fd0 tx=0x7f3d28008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:45.548 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.546+0000 7f3d22ffd700 1 -- 172.21.15.61:0/1112048868 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f3d2404e9d0 con 0x7f3d340702b0 2023-01-01T17:39:45.737 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.737+0000 7f3d38b23700 1 -- 172.21.15.61:0/1112048868 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d3404d760 con 0x7f3d340702b0 2023-01-01T17:39:45.738 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.738+0000 7f3d22ffd700 1 -- 172.21.15.61:0/1112048868 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10418 (secure 0 0 0) 0x7f3d2401f090 con 0x7f3d340702b0 2023-01-01T17:39:45.738 INFO:teuthology.misc.health.smithi061.stdout: 2023-01-01T17:39:45.738 INFO:teuthology.misc.health.smithi061.stdout:{"epoch":13,"fsid":"fe0d3d8e-46ee-4ed9-92f8-749741721d01","created":"2023-01-01T17:39:34.752404+0000","modified":"2023-01-01T17:39:45.159720+0000","last_up_change":"2023-01-01T17:39:45.159720+0000","last_in_change":"2023-01-01T17:39:37.293057+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[],"osds":[{"osd":0,"uuid":"5ba13bcd-4407-4cfd-8487-80917501e525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":94349},{"type":"v1","addr":"172.21.15.61:6825","nonce":94349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":94349},{"type":"v1","addr":"172.21.15.61:6827","nonce":94349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":94349},{"type":"v1","addr":"172.21.15.61:6831","nonce":94349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":94349},{"type":"v1","addr":"172.21.15.61:6829","nonce":94349}]},"public_addr":"172.21.15.61:6825/94349","cluster_addr":"172.21.15.61:6827/94349","heartbeat_back_addr":"172.21.15.61:6831/94349","heartbeat_front_addr":"172.21.15.61:6829/94349","state":["exists","up"]},{"osd":1,"uuid":"7dca9f34-ea22-4894-b238-5606b16b9c74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6811","nonce":94348},{"type":"v1","addr":"172.21.15.61:6813","nonce":94348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":94348},{"type":"v1","addr":"172.21.15.61:6816","nonce":94348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6821","nonce":94348},{"type":"v1","addr":"172.21.15.61:6823","nonce":94348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":94348},{"type":"v1","addr":"172.21.15.61:6819","nonce":94348}]},"public_addr":"172.21.15.61:6813/94348","cluster_addr":"172.21.15.61:6816/94348","heartbeat_back_addr":"172.21.15.61:6823/94348","heartbeat_front_addr":"172.21.15.61:6819/94348","state":["exists","up"]},{"osd":2,"uuid":"7b43ea06-a7b6-49f4-a390-18ad14dfe4fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":94350},{"type":"v1","addr":"172.21.15.61:6809","nonce":94350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":94350},{"type":"v1","addr":"172.21.15.61:6812","nonce":94350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":94350},{"type":"v1","addr":"172.21.15.61:6822","nonce":94350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6815","nonce":94350},{"type":"v1","addr":"172.21.15.61:6817","nonce":94350}]},"public_addr":"172.21.15.61:6809/94350","cluster_addr":"172.21.15.61:6812/94350","heartbeat_back_addr":"172.21.15.61:6822/94350","heartbeat_front_addr":"172.21.15.61:6817/94350","state":["exists","up"]},{"osd":3,"uuid":"117c41d8-d40c-4cc0-b0e1-70bca058fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":94347},{"type":"v1","addr":"172.21.15.61:6801","nonce":94347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":94347},{"type":"v1","addr":"172.21.15.61:6803","nonce":94347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":94347},{"type":"v1","addr":"172.21.15.61:6807","nonce":94347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":94347},{"type":"v1","addr":"172.21.15.61:6805","nonce":94347}]},"public_addr":"172.21.15.61:6801/94347","cluster_addr":"172.21.15.61:6803/94347","heartbeat_back_addr":"172.21.15.61:6807/94347","heartbeat_front_addr":"172.21.15.61:6805/94347","state":["exists","up"]},{"osd":4,"uuid":"4073e0e8-c5dd-463f-aa1c-c9515ef09976","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":94711},{"type":"v1","addr":"172.21.15.149:6818","nonce":94711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":94711},{"type":"v1","addr":"172.21.15.149:6822","nonce":94711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":94711},{"type":"v1","addr":"172.21.15.149:6830","nonce":94711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":94711},{"type":"v1","addr":"172.21.15.149:6826","nonce":94711}]},"public_addr":"172.21.15.149:6818/94711","cluster_addr":"172.21.15.149:6822/94711","heartbeat_back_addr":"172.21.15.149:6830/94711","heartbeat_front_addr":"172.21.15.149:6826/94711","state":["exists","up"]},{"osd":5,"uuid":"88aa0c0f-e3c1-4dd3-af8c-61f4bc28504e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":94709},{"type":"v1","addr":"172.21.15.149:6809","nonce":94709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":94709},{"type":"v1","addr":"172.21.15.149:6811","nonce":94709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":94709},{"type":"v1","addr":"172.21.15.149:6815","nonce":94709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":94709},{"type":"v1","addr":"172.21.15.149:6813","nonce":94709}]},"public_addr":"172.21.15.149:6809/94709","cluster_addr":"172.21.15.149:6811/94709","heartbeat_back_addr":"172.21.15.149:6815/94709","heartbeat_front_addr":"172.21.15.149:6813/94709","state":["exists","up"]},{"osd":6,"uuid":"8b13fc0c-5f00-41c7-8923-c4570da77afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":94710},{"type":"v1","addr":"172.21.15.149:6801","nonce":94710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":94710},{"type":"v1","addr":"172.21.15.149:6803","nonce":94710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":94710},{"type":"v1","addr":"172.21.15.149:6807","nonce":94710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":94710},{"type":"v1","addr":"172.21.15.149:6805","nonce":94710}]},"public_addr":"172.21.15.149:6801/94710","cluster_addr":"172.21.15.149:6803/94710","heartbeat_back_addr":"172.21.15.149:6807/94710","heartbeat_front_addr":"172.21.15.149:6805/94710","state":["exists","up"]},{"osd":7,"uuid":"5390c6e5-39e7-4aa6-b73c-642458b2acf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":94734},{"type":"v1","addr":"172.21.15.149:6819","nonce":94734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":94734},{"type":"v1","addr":"172.21.15.149:6823","nonce":94734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":94734},{"type":"v1","addr":"172.21.15.149:6831","nonce":94734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":94734},{"type":"v1","addr":"172.21.15.149:6827","nonce":94734}]},"public_addr":"172.21.15.149:6819/94734","cluster_addr":"172.21.15.149:6823/94734","heartbeat_back_addr":"172.21.15.149:6831/94734","heartbeat_front_addr":"172.21.15.149:6827/94734","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-01T17:39:45.741 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.740+0000 7f3d38b23700 1 -- 172.21.15.61:0/1112048868 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3d14063240 msgr2=0x7f3d140656f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:45.741 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.740+0000 7f3d38b23700 1 --2- 172.21.15.61:0/1112048868 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3d14063240 0x7f3d140656f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3d28006fd0 tx=0x7f3d28008040 comp rx=0 tx=0).stop 2023-01-01T17:39:45.742 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.740+0000 7f3d38b23700 1 -- 172.21.15.61:0/1112048868 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3d340702b0 msgr2=0x7f3d3414b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:45.742 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.740+0000 7f3d38b23700 1 --2- 172.21.15.61:0/1112048868 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3d340702b0 0x7f3d3414b010 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3d2400c7f0 tx=0x7f3d2400cbb0 comp rx=0 tx=0).stop 2023-01-01T17:39:45.742 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.740+0000 7f3d38b23700 1 -- 172.21.15.61:0/1112048868 shutdown_connections 2023-01-01T17:39:45.742 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.740+0000 7f3d38b23700 1 --2- 172.21.15.61:0/1112048868 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d340c5830 0x7f3d341e9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:45.743 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.740+0000 7f3d38b23700 1 --2- 172.21.15.61:0/1112048868 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3d14063240 0x7f3d140656f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:45.743 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.740+0000 7f3d38b23700 1 --2- 172.21.15.61:0/1112048868 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3d340702b0 0x7f3d3414b010 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:45.743 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.740+0000 7f3d38b23700 1 --2- 172.21.15.61:0/1112048868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d340c1000 0x7f3d3414a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:45.743 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.740+0000 7f3d38b23700 1 -- 172.21.15.61:0/1112048868 >> 172.21.15.61:0/1112048868 conn(0x7f3d340a7410 msgr2=0x7f3d3414ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:45.743 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.740+0000 7f3d38b23700 1 -- 172.21.15.61:0/1112048868 shutdown_connections 2023-01-01T17:39:45.744 INFO:teuthology.misc.health.smithi061.stderr:2023-01-01T17:39:45.740+0000 7f3d38b23700 1 -- 172.21.15.61:0/1112048868 wait complete. 2023-01-01T17:39:45.752 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-01-01T17:39:45.752 INFO:tasks.ceph:Creating RBD pool 2023-01-01T17:39:45.752 DEBUG:teuthology.orchestra.run.smithi061:> sudo ceph --cluster ceph osd pool create rbd 8 2023-01-01T17:39:45.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.876+0000 7f012e20e700 1 Processor -- start 2023-01-01T17:39:45.877 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.877+0000 7f012e20e700 1 -- start start 2023-01-01T17:39:45.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.877+0000 7f012e20e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f012814c6e0 0x7f012806f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:45.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.877+0000 7f012e20e700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f012806c080 0x7f01280bff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:45.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.877+0000 7f012e20e700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f012814cab0 con 0x7f01280c0490 2023-01-01T17:39:45.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.877+0000 7f012e20e700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f012806c5f0 con 0x7f012814c6e0 2023-01-01T17:39:45.880 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.877+0000 7f012e20e700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f012806c8d0 con 0x7f012806c080 2023-01-01T17:39:45.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.878+0000 7f01277fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f012814c6e0 0x7f012806f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:45.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.878+0000 7f0126ffd700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f012806c080 0x7f01280bff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:45.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.878+0000 7f0127fff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f01280c0490 0x7f012814f0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.61:47960/0 (socket says 172.21.15.61:47960) 2023-01-01T17:39:45.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.878+0000 7f0127fff700 1 -- 172.21.15.61:0/1535748469 learned_addr learned my addr 172.21.15.61:0/1535748469 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:39:45.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.878+0000 7f01267fc700 1 -- 172.21.15.61:0/1535748469 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 506742453 0 0) 0x7f012814cab0 con 0x7f01280c0490 2023-01-01T17:39:45.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.878+0000 7f01267fc700 1 -- 172.21.15.61:0/1535748469 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01100035b0 con 0x7f01280c0490 2023-01-01T17:39:45.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.878+0000 7f01277fe700 1 -- 172.21.15.61:0/1535748469 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f012806c080 msgr2=0x7f01280bff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:45.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.878+0000 7f01277fe700 1 --2- 172.21.15.61:0/1535748469 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f012806c080 0x7f01280bff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:45.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.878+0000 7f01277fe700 1 -- 172.21.15.61:0/1535748469 >> v1:172.21.15.149:6789/0 conn(0x7f01280c0490 legacy=0x7f012814f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:45.881 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.878+0000 7f01277fe700 1 -- 172.21.15.61:0/1535748469 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01280712f0 con 0x7f012814c6e0 2023-01-01T17:39:45.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.878+0000 7f0126ffd700 1 --2- 172.21.15.61:0/1535748469 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f012806c080 0x7f01280bff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-01-01T17:39:45.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.878+0000 7f01277fe700 1 --2- 172.21.15.61:0/1535748469 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f012814c6e0 0x7f012806f390 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0118009840 tx=0x7f0118009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccf00ed094fc5c79 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:45.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.878+0000 7f01267fc700 1 -- 172.21.15.61:0/1535748469 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0118011830 con 0x7f012814c6e0 2023-01-01T17:39:45.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.878+0000 7f01267fc700 1 -- 172.21.15.61:0/1535748469 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0118011990 con 0x7f012814c6e0 2023-01-01T17:39:45.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.878+0000 7f01267fc700 1 -- 172.21.15.61:0/1535748469 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0118011d20 con 0x7f012814c6e0 2023-01-01T17:39:45.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.879+0000 7f012e20e700 1 -- 172.21.15.61:0/1535748469 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f012814c6e0 msgr2=0x7f012806f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:45.882 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.879+0000 7f012e20e700 1 --2- 172.21.15.61:0/1535748469 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f012814c6e0 0x7f012806f390 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0118009840 tx=0x7f0118009b50 comp rx=0 tx=0).stop 2023-01-01T17:39:45.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.879+0000 7f012e20e700 1 -- 172.21.15.61:0/1535748469 shutdown_connections 2023-01-01T17:39:45.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.879+0000 7f012e20e700 1 --2- 172.21.15.61:0/1535748469 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f012814c6e0 0x7f012806f390 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:45.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.879+0000 7f012e20e700 1 --2- 172.21.15.61:0/1535748469 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f012806c080 0x7f01280bff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:45.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.879+0000 7f012e20e700 1 -- 172.21.15.61:0/1535748469 >> 172.21.15.61:0/1535748469 conn(0x7f01280c1e80 msgr2=0x7f01280c2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:45.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.879+0000 7f012e20e700 1 -- 172.21.15.61:0/1535748469 shutdown_connections 2023-01-01T17:39:45.883 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.879+0000 7f012e20e700 1 -- 172.21.15.61:0/1535748469 wait complete. 2023-01-01T17:39:45.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.880+0000 7f012e20e700 1 Processor -- start 2023-01-01T17:39:45.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.880+0000 7f012e20e700 1 -- start start 2023-01-01T17:39:45.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.881+0000 7f012e20e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f012806c080 0x7f0128142db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:45.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.881+0000 7f012e20e700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01280c0490 0x7f01281ebb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:45.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.881+0000 7f012e20e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f01280c39e0 0x7f01281ec070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:45.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.881+0000 7f012e20e700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01281e97c0 con 0x7f01280c39e0 2023-01-01T17:39:45.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.881+0000 7f012e20e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01281e9d80 con 0x7f012806c080 2023-01-01T17:39:45.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.881+0000 7f012e20e700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01281d88a0 con 0x7f01280c0490 2023-01-01T17:39:45.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.881+0000 7f0127fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f01280c39e0 0x7f01281ec070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:45.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.881+0000 7f0127fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f01280c39e0 0x7f01281ec070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:45640/0 (socket says 172.21.15.61:45640) 2023-01-01T17:39:45.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.881+0000 7f0127fff700 1 -- 172.21.15.61:0/323839446 learned_addr learned my addr 172.21.15.61:0/323839446 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:45.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.881+0000 7f01277fe700 1 --2- 172.21.15.61:0/323839446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f012806c080 0x7f0128142db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:45.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.881+0000 7f0126ffd700 1 --2- 172.21.15.61:0/323839446 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01280c0490 0x7f01281ebb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:45.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.881+0000 7f0127fff700 1 -- 172.21.15.61:0/323839446 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01280c0490 msgr2=0x7f01281ebb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:45.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.881+0000 7f0127fff700 1 --2- 172.21.15.61:0/323839446 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01280c0490 0x7f01281ebb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:45.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.882+0000 7f0127fff700 1 -- 172.21.15.61:0/323839446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f012806c080 msgr2=0x7f0128142db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:45.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.882+0000 7f0127fff700 1 --2- 172.21.15.61:0/323839446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f012806c080 0x7f0128142db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:45.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.882+0000 7f0127fff700 1 -- 172.21.15.61:0/323839446 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f011c0094a0 con 0x7f01280c39e0 2023-01-01T17:39:45.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.882+0000 7f0127fff700 1 --2- 172.21.15.61:0/323839446 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f01280c39e0 0x7f01281ec070 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f012000cad0 tx=0x7f012000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:45.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.882+0000 7f010ffff700 1 -- 172.21.15.61:0/323839446 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012000a940 con 0x7f01280c39e0 2023-01-01T17:39:45.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.882+0000 7f010ffff700 1 -- 172.21.15.61:0/323839446 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f012000aaa0 con 0x7f01280c39e0 2023-01-01T17:39:45.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.882+0000 7f012e20e700 1 -- 172.21.15.61:0/323839446 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01180094a0 con 0x7f01280c39e0 2023-01-01T17:39:45.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.882+0000 7f010ffff700 1 -- 172.21.15.61:0/323839446 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012000ae30 con 0x7f01280c39e0 2023-01-01T17:39:45.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.882+0000 7f012e20e700 1 -- 172.21.15.61:0/323839446 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f012806f8d0 con 0x7f01280c39e0 2023-01-01T17:39:45.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.883+0000 7f012e20e700 1 -- 172.21.15.61:0/323839446 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01280715d0 con 0x7f01280c39e0 2023-01-01T17:39:45.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.883+0000 7f010ffff700 1 -- 172.21.15.61:0/323839446 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 4) v1 ==== 81907+0+0 (secure 0 0 0) 0x7f0120019030 con 0x7f01280c39e0 2023-01-01T17:39:45.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.883+0000 7f010ffff700 1 --2- 172.21.15.61:0/323839446 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f0114063270 0x7f0114065720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:45.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.884+0000 7f010ffff700 1 -- 172.21.15.61:0/323839446 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f012007ee90 con 0x7f01280c39e0 2023-01-01T17:39:45.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.884+0000 7f01277fe700 1 --2- 172.21.15.61:0/323839446 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f0114063270 0x7f0114065720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:45.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.884+0000 7f01277fe700 1 --2- 172.21.15.61:0/323839446 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f0114063270 0x7f0114065720 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f012806ed90 tx=0x7f0118008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:45.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:45.888+0000 7f010ffff700 1 -- 172.21.15.61:0/323839446 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f012004e4e0 con 0x7f01280c39e0 2023-01-01T17:39:46.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.080+0000 7f012e20e700 1 -- 172.21.15.61:0/323839446 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f0128070f80 con 0x7f01280c39e0 2023-01-01T17:39:46.289 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.288+0000 7f010ffff700 1 -- 172.21.15.61:0/323839446 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) v1 ==== 109+0+0 (secure 0 0 0) 0x7f0120051b00 con 0x7f01280c39e0 2023-01-01T17:39:46.291 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.291+0000 7f012e20e700 1 -- 172.21.15.61:0/323839446 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f0114063270 msgr2=0x7f0114065720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:46.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.291+0000 7f012e20e700 1 --2- 172.21.15.61:0/323839446 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f0114063270 0x7f0114065720 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f012806ed90 tx=0x7f0118008030 comp rx=0 tx=0).stop 2023-01-01T17:39:46.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.291+0000 7f012e20e700 1 -- 172.21.15.61:0/323839446 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f01280c39e0 msgr2=0x7f01281ec070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:46.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.291+0000 7f012e20e700 1 --2- 172.21.15.61:0/323839446 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f01280c39e0 0x7f01281ec070 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f012000cad0 tx=0x7f012000cde0 comp rx=0 tx=0).stop 2023-01-01T17:39:46.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.291+0000 7f012e20e700 1 -- 172.21.15.61:0/323839446 shutdown_connections 2023-01-01T17:39:46.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.291+0000 7f012e20e700 1 --2- 172.21.15.61:0/323839446 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f0114063270 0x7f0114065720 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:46.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.291+0000 7f012e20e700 1 --2- 172.21.15.61:0/323839446 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f01280c39e0 0x7f01281ec070 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:46.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.291+0000 7f012e20e700 1 --2- 172.21.15.61:0/323839446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f012806c080 0x7f0128142db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:46.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.291+0000 7f012e20e700 1 --2- 172.21.15.61:0/323839446 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01280c0490 0x7f01281ebb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:46.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.291+0000 7f012e20e700 1 -- 172.21.15.61:0/323839446 >> 172.21.15.61:0/323839446 conn(0x7f01280c1e80 msgr2=0x7f01281460e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:46.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.291+0000 7f012e20e700 1 -- 172.21.15.61:0/323839446 shutdown_connections 2023-01-01T17:39:46.292 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.291+0000 7f012e20e700 1 -- 172.21.15.61:0/323839446 wait complete. 2023-01-01T17:39:46.293 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'rbd' created 2023-01-01T17:39:46.304 DEBUG:teuthology.orchestra.run.smithi061:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-01-01T17:39:46.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.430+0000 7f9cc141d700 1 Processor -- start 2023-01-01T17:39:46.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.430+0000 7f9cc141d700 1 -- start start 2023-01-01T17:39:46.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.431+0000 7f9cc141d700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cbc150330 0x7f9cbc0c5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:46.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.431+0000 7f9cc141d700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cbc153890 con 0x7f9cbc0c5d90 2023-01-01T17:39:46.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.431+0000 7f9cc141d700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cbc153dc0 con 0x7f9cbc069890 2023-01-01T17:39:46.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.431+0000 7f9cc141d700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc06b860 con 0x7f9cbc150330 2023-01-01T17:39:46.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.431+0000 7f9cbb7fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f9cbc0c5d90 0x7f9cbc0c7830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39524/0 (socket says 172.21.15.61:39524) 2023-01-01T17:39:46.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.431+0000 7f9cbb7fe700 1 -- 172.21.15.61:0/815452238 learned_addr learned my addr 172.21.15.61:0/815452238 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:39:46.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.431+0000 7f9cbaffd700 1 --2- 172.21.15.61:0/815452238 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cbc150330 0x7f9cbc0c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:46.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.431+0000 7f9cb9ffb700 1 -- 172.21.15.61:0/815452238 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4008611550 0 0) 0x7f9cbc153890 con 0x7f9cbc0c5d90 2023-01-01T17:39:46.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.431+0000 7f9cb9ffb700 1 -- 172.21.15.61:0/815452238 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ca80035b0 con 0x7f9cbc0c5d90 2023-01-01T17:39:46.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.431+0000 7f9cb9ffb700 1 -- 172.21.15.61:0/815452238 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1279142095 0 0) 0x7f9cbc153dc0 con 0x7f9cbc069890 2023-01-01T17:39:46.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.431+0000 7f9cb9ffb700 1 -- 172.21.15.61:0/815452238 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cbc153890 con 0x7f9cbc069890 2023-01-01T17:39:46.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.432+0000 7f9cb9ffb700 1 -- 172.21.15.61:0/815452238 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1835526994 0 0) 0x7f9ca80035b0 con 0x7f9cbc0c5d90 2023-01-01T17:39:46.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.432+0000 7f9cb9ffb700 1 -- 172.21.15.61:0/815452238 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cbc150330 msgr2=0x7f9cbc0c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:46.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.432+0000 7f9cb9ffb700 1 --2- 172.21.15.61:0/815452238 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cbc150330 0x7f9cbc0c5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:46.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.432+0000 7f9cb9ffb700 1 -- 172.21.15.61:0/815452238 >> v1:172.21.15.149:6789/0 conn(0x7f9cbc069890 legacy=0x7f9cbc0c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:46.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.432+0000 7f9cb9ffb700 1 -- 172.21.15.61:0/815452238 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cbc0bc710 con 0x7f9cbc0c5d90 2023-01-01T17:39:46.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.432+0000 7f9cb9ffb700 1 -- 172.21.15.61:0/815452238 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586489653 0 0) 0x7f9cb40019f0 con 0x7f9cbc0c5d90 2023-01-01T17:39:46.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.432+0000 7f9cb9ffb700 1 -- 172.21.15.61:0/815452238 >> v1:172.21.15.61:6789/0 conn(0x7f9cbc0c5d90 legacy=0x7f9cbc0c7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:46.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.432+0000 7f9cb9ffb700 1 --2- 172.21.15.61:0/815452238 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cbc150330 0x7f9ca8003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:46.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.432+0000 7f9cb9ffb700 1 --2- 172.21.15.61:0/815452238 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ca8004120 0x7f9ca8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:46.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.432+0000 7f9cb9ffb700 1 --2- 172.21.15.61:0/815452238 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ca8004d90 0x7f9ca8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:46.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.432+0000 7f9cb9ffb700 1 -- 172.21.15.61:0/815452238 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc06b860 con 0x7f9ca8004120 2023-01-01T17:39:46.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.432+0000 7f9cb9ffb700 1 -- 172.21.15.61:0/815452238 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca800bba0 con 0x7f9ca8004d90 2023-01-01T17:39:46.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.432+0000 7f9cb9ffb700 1 -- 172.21.15.61:0/815452238 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca800bd30 con 0x7f9cbc150330 2023-01-01T17:39:46.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.432+0000 7f9cba7fc700 1 --2- 172.21.15.61:0/815452238 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ca8004120 0x7f9ca8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:46.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.432+0000 7f9cbaffd700 1 --2- 172.21.15.61:0/815452238 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cbc150330 0x7f9ca8003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:46.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.432+0000 7f9cbb7fe700 1 --2- 172.21.15.61:0/815452238 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ca8004d90 0x7f9ca8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:46.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.432+0000 7f9cba7fc700 1 -- 172.21.15.61:0/815452238 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cbc150330 msgr2=0x7f9ca8003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:46.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.432+0000 7f9cba7fc700 1 --2- 172.21.15.61:0/815452238 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9cbc150330 0x7f9ca8003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:46.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.432+0000 7f9cba7fc700 1 -- 172.21.15.61:0/815452238 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ca8004d90 msgr2=0x7f9ca8005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:46.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.432+0000 7f9cba7fc700 1 --2- 172.21.15.61:0/815452238 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ca8004d90 0x7f9ca8005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:46.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.432+0000 7f9cba7fc700 1 -- 172.21.15.61:0/815452238 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca80035b0 con 0x7f9ca8004120 2023-01-01T17:39:46.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.432+0000 7f9cba7fc700 1 --2- 172.21.15.61:0/815452238 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ca8004120 0x7f9ca8004850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4001940 tx=0x7f9ca8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea19d984e5cbb1b6 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:46.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.432+0000 7f9cb9ffb700 1 -- 172.21.15.61:0/815452238 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4001430 con 0x7f9ca8004120 2023-01-01T17:39:46.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.432+0000 7f9cb9ffb700 1 -- 172.21.15.61:0/815452238 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca4001d70 con 0x7f9ca8004120 2023-01-01T17:39:46.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.432+0000 7f9cb9ffb700 1 -- 172.21.15.61:0/815452238 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4005510 con 0x7f9ca8004120 2023-01-01T17:39:46.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.433+0000 7f9cc141d700 1 -- 172.21.15.61:0/815452238 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ca8004120 msgr2=0x7f9ca8004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:46.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.433+0000 7f9cc141d700 1 --2- 172.21.15.61:0/815452238 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9ca8004120 0x7f9ca8004850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9ca4001940 tx=0x7f9ca8005880 comp rx=0 tx=0).stop 2023-01-01T17:39:46.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.433+0000 7f9cbb7fe700 1 -- 172.21.15.61:0/815452238 reap_dead start 2023-01-01T17:39:46.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.433+0000 7f9cc141d700 1 -- 172.21.15.61:0/815452238 shutdown_connections 2023-01-01T17:39:46.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.433+0000 7f9cc141d700 1 -- 172.21.15.61:0/815452238 >> 172.21.15.61:0/815452238 conn(0x7f9cbc0c8e40 msgr2=0x7f9cbc0c9240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:46.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.433+0000 7f9cc141d700 1 -- 172.21.15.61:0/815452238 shutdown_connections 2023-01-01T17:39:46.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.433+0000 7f9cc141d700 1 -- 172.21.15.61:0/815452238 wait complete. 2023-01-01T17:39:46.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.434+0000 7f9cc141d700 1 Processor -- start 2023-01-01T17:39:46.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.434+0000 7f9cc141d700 1 -- start start 2023-01-01T17:39:46.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.435+0000 7f9cc141d700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ca8004120 0x7f9cbc14afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:46.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.435+0000 7f9cc141d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9cbc0c2890 0x7f9cbc1dcb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:46.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.435+0000 7f9cc141d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cbc0a87a0 0x7f9cbc149e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:46.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.435+0000 7f9cc141d700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc0c2d00 con 0x7f9cbc0c2890 2023-01-01T17:39:46.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.435+0000 7f9cc141d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc0c23b0 con 0x7f9cbc0a87a0 2023-01-01T17:39:46.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.435+0000 7f9cc141d700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc14ad50 con 0x7f9ca8004120 2023-01-01T17:39:46.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.435+0000 7f9cba7fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9cbc0c2890 0x7f9cbc1dcb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:46.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.435+0000 7f9cba7fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9cbc0c2890 0x7f9cbc1dcb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:45684/0 (socket says 172.21.15.61:45684) 2023-01-01T17:39:46.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.435+0000 7f9cba7fc700 1 -- 172.21.15.61:0/490062263 learned_addr learned my addr 172.21.15.61:0/490062263 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:46.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.435+0000 7f9cbaffd700 1 --2- 172.21.15.61:0/490062263 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ca8004120 0x7f9cbc14afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:46.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.435+0000 7f9cbb7fe700 1 --2- 172.21.15.61:0/490062263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cbc0a87a0 0x7f9cbc149e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:46.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.435+0000 7f9cba7fc700 1 -- 172.21.15.61:0/490062263 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ca8004120 msgr2=0x7f9cbc14afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:46.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.435+0000 7f9cba7fc700 1 --2- 172.21.15.61:0/490062263 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ca8004120 0x7f9cbc14afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:46.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.435+0000 7f9cba7fc700 1 -- 172.21.15.61:0/490062263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cbc0a87a0 msgr2=0x7f9cbc149e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:46.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.435+0000 7f9cba7fc700 1 --2- 172.21.15.61:0/490062263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cbc0a87a0 0x7f9cbc149e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:46.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.435+0000 7f9cba7fc700 1 -- 172.21.15.61:0/490062263 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cbc06b2a0 con 0x7f9cbc0c2890 2023-01-01T17:39:46.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.436+0000 7f9cba7fc700 1 --2- 172.21.15.61:0/490062263 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9cbc0c2890 0x7f9cbc1dcb90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8004790 tx=0x7f9ca40012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:46.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.436+0000 7f9cb37fe700 1 -- 172.21.15.61:0/490062263 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4006a70 con 0x7f9cbc0c2890 2023-01-01T17:39:46.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.436+0000 7f9cb37fe700 1 -- 172.21.15.61:0/490062263 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca4006bd0 con 0x7f9cbc0c2890 2023-01-01T17:39:46.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.436+0000 7f9cb37fe700 1 -- 172.21.15.61:0/490062263 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4007040 con 0x7f9cbc0c2890 2023-01-01T17:39:46.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.436+0000 7f9cc141d700 1 -- 172.21.15.61:0/490062263 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cbc153ae0 con 0x7f9cbc0c2890 2023-01-01T17:39:46.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.436+0000 7f9cc141d700 1 -- 172.21.15.61:0/490062263 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cbc06b580 con 0x7f9cbc0c2890 2023-01-01T17:39:46.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.437+0000 7f9cc141d700 1 -- 172.21.15.61:0/490062263 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cbc0c26e0 con 0x7f9cbc0c2890 2023-01-01T17:39:46.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.437+0000 7f9cb37fe700 1 -- 172.21.15.61:0/490062263 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 4) v1 ==== 81907+0+0 (secure 0 0 0) 0x7f9ca402d070 con 0x7f9cbc0c2890 2023-01-01T17:39:46.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.437+0000 7f9cb37fe700 1 --2- 172.21.15.61:0/490062263 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f9c9c063240 0x7f9c9c0656f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:46.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.438+0000 7f9cb37fe700 1 -- 172.21.15.61:0/490062263 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 5188+0+0 (secure 0 0 0) 0x7f9ca407ff90 con 0x7f9cbc0c2890 2023-01-01T17:39:46.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.438+0000 7f9cbaffd700 1 --2- 172.21.15.61:0/490062263 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f9c9c063240 0x7f9c9c0656f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:46.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.438+0000 7f9cbaffd700 1 --2- 172.21.15.61:0/490062263 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f9c9c063240 0x7f9c9c0656f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009ac0 tx=0x7f9cac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:46.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.442+0000 7f9cb37fe700 1 -- 172.21.15.61:0/490062263 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f9ca404f3f0 con 0x7f9cbc0c2890 2023-01-01T17:39:46.636 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:46.635+0000 7f9cc141d700 1 -- 172.21.15.61:0/490062263 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9cbc06ac30 con 0x7f9cbc0c2890 2023-01-01T17:39:47.297 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.296+0000 7f9cb37fe700 1 -- 172.21.15.61:0/490062263 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v15) v1 ==== 173+0+0 (secure 0 0 0) 0x7f9ca4052a10 con 0x7f9cbc0c2890 2023-01-01T17:39:47.300 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.299+0000 7f9cc141d700 1 -- 172.21.15.61:0/490062263 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f9c9c063240 msgr2=0x7f9c9c0656f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:47.300 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.299+0000 7f9cc141d700 1 --2- 172.21.15.61:0/490062263 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f9c9c063240 0x7f9c9c0656f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009ac0 tx=0x7f9cac008040 comp rx=0 tx=0).stop 2023-01-01T17:39:47.300 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.299+0000 7f9cc141d700 1 -- 172.21.15.61:0/490062263 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9cbc0c2890 msgr2=0x7f9cbc1dcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:47.300 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.299+0000 7f9cc141d700 1 --2- 172.21.15.61:0/490062263 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9cbc0c2890 0x7f9cbc1dcb90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8004790 tx=0x7f9ca40012d0 comp rx=0 tx=0).stop 2023-01-01T17:39:47.300 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.299+0000 7f9cc141d700 1 -- 172.21.15.61:0/490062263 shutdown_connections 2023-01-01T17:39:47.300 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.299+0000 7f9cc141d700 1 --2- 172.21.15.61:0/490062263 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cbc0a87a0 0x7f9cbc149e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:47.300 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.299+0000 7f9cc141d700 1 --2- 172.21.15.61:0/490062263 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9ca8004120 0x7f9cbc14afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:47.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.299+0000 7f9cc141d700 1 --2- 172.21.15.61:0/490062263 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f9c9c063240 0x7f9c9c0656f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:47.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.299+0000 7f9cc141d700 1 --2- 172.21.15.61:0/490062263 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9cbc0c2890 0x7f9cbc1dcb90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:47.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.299+0000 7f9cc141d700 1 -- 172.21.15.61:0/490062263 >> 172.21.15.61:0/490062263 conn(0x7f9cbc0c8e40 msgr2=0x7f9cbc0bffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:47.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.300+0000 7f9cc141d700 1 -- 172.21.15.61:0/490062263 shutdown_connections 2023-01-01T17:39:47.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.300+0000 7f9cc141d700 1 -- 172.21.15.61:0/490062263 wait complete. 2023-01-01T17:39:47.301 INFO:teuthology.orchestra.run.smithi061.stderr:enabled application 'rbd' on pool 'rbd' 2023-01-01T17:39:47.317 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-01-01T17:39:47.318 INFO:tasks.ceph.mds.a:Restarting daemon 2023-01-01T17:39:47.325 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-01-01T17:39:47.328 INFO:tasks.ceph.mds.a:Started 2023-01-01T17:39:47.328 INFO:tasks.ceph.mds.c:Restarting daemon 2023-01-01T17:39:47.328 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-01-01T17:39:47.330 INFO:tasks.ceph.mds.c:Started 2023-01-01T17:39:47.331 INFO:tasks.ceph.mds.b:Restarting daemon 2023-01-01T17:39:47.331 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-01-01T17:39:47.333 INFO:tasks.ceph.mds.b:Started 2023-01-01T17:39:47.333 INFO:tasks.ceph.mds.d:Restarting daemon 2023-01-01T17:39:47.334 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-01-01T17:39:47.336 INFO:tasks.ceph.mds.d:Started 2023-01-01T17:39:47.336 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-01-01T17:39:47.336 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-01T17:39:47.425 INFO:tasks.ceph.mds.b.smithi149.stdout:starting mds.b at 2023-01-01T17:39:47.428 INFO:tasks.ceph.mds.c.smithi061.stdout:starting mds.c at 2023-01-01T17:39:47.429 INFO:tasks.ceph.mds.d.smithi149.stdout:starting mds.d at 2023-01-01T17:39:47.429 INFO:tasks.ceph.mds.a.smithi061.stdout:starting mds.a at 2023-01-01T17:39:47.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.497+0000 7f2489bd6700 1 Processor -- start 2023-01-01T17:39:47.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.497+0000 7f2489bd6700 1 -- start start 2023-01-01T17:39:47.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.498+0000 7f2489bd6700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24841515b0 0x7f248406d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:47.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.498+0000 7f2489bd6700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2484147ab0 con 0x7f24840c15c0 2023-01-01T17:39:47.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.498+0000 7f2489bd6700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2484155080 con 0x7f2484071440 2023-01-01T17:39:47.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.498+0000 7f2489bd6700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2484151b90 con 0x7f24841515b0 2023-01-01T17:39:47.501 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.498+0000 7f2482ffd700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f24840c15c0 0x7f248406c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39614/0 (socket says 172.21.15.61:39614) 2023-01-01T17:39:47.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.498+0000 7f2482ffd700 1 -- 172.21.15.61:0/3671912044 learned_addr learned my addr 172.21.15.61:0/3671912044 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:39:47.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.498+0000 7f2483fff700 1 --2- 172.21.15.61:0/3671912044 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24841515b0 0x7f248406d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:47.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.498+0000 7f24827fc700 1 -- 172.21.15.61:0/3671912044 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2312505116 0 0) 0x7f2478001110 con 0x7f24840c15c0 2023-01-01T17:39:47.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.498+0000 7f24827fc700 1 -- 172.21.15.61:0/3671912044 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f246c0035b0 con 0x7f24840c15c0 2023-01-01T17:39:47.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.499+0000 7f24827fc700 1 -- 172.21.15.61:0/3671912044 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3140272711 0 0) 0x7f246c0035b0 con 0x7f24840c15c0 2023-01-01T17:39:47.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.499+0000 7f24827fc700 1 -- 172.21.15.61:0/3671912044 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24841515b0 msgr2=0x7f248406d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:47.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.499+0000 7f24827fc700 1 --2- 172.21.15.61:0/3671912044 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24841515b0 0x7f248406d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:47.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.499+0000 7f24827fc700 1 -- 172.21.15.61:0/3671912044 >> v1:172.21.15.149:6789/0 conn(0x7f2484071440 legacy=0x7f248406a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:47.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.499+0000 7f24827fc700 1 -- 172.21.15.61:0/3671912044 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24841542c0 con 0x7f24840c15c0 2023-01-01T17:39:47.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.499+0000 7f24827fc700 1 -- 172.21.15.61:0/3671912044 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586489653 0 0) 0x7f2478001800 con 0x7f24840c15c0 2023-01-01T17:39:47.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.499+0000 7f24827fc700 1 -- 172.21.15.61:0/3671912044 >> v1:172.21.15.61:6789/0 conn(0x7f24840c15c0 legacy=0x7f248406c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:47.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.499+0000 7f24827fc700 1 --2- 172.21.15.61:0/3671912044 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f246c003a30 0x7f246c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:47.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.499+0000 7f24827fc700 1 --2- 172.21.15.61:0/3671912044 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24841515b0 0x7f246c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:47.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.499+0000 7f24827fc700 1 --2- 172.21.15.61:0/3671912044 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f246c004d90 0x7f246c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:47.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.499+0000 7f24827fc700 1 -- 172.21.15.61:0/3671912044 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2484151b90 con 0x7f246c003a30 2023-01-01T17:39:47.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.499+0000 7f24827fc700 1 -- 172.21.15.61:0/3671912044 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246c00ba10 con 0x7f246c004d90 2023-01-01T17:39:47.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.499+0000 7f24827fc700 1 -- 172.21.15.61:0/3671912044 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f246c00bba0 con 0x7f24841515b0 2023-01-01T17:39:47.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.499+0000 7f24837fe700 1 --2- 172.21.15.61:0/3671912044 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f246c003a30 0x7f246c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:47.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.499+0000 7f2482ffd700 1 --2- 172.21.15.61:0/3671912044 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24841515b0 0x7f246c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:47.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.499+0000 7f2483fff700 1 --2- 172.21.15.61:0/3671912044 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f246c004d90 0x7f246c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:47.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.499+0000 7f24837fe700 1 -- 172.21.15.61:0/3671912044 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24841515b0 msgr2=0x7f246c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:47.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.499+0000 7f24837fe700 1 --2- 172.21.15.61:0/3671912044 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f24841515b0 0x7f246c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:47.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.499+0000 7f24837fe700 1 -- 172.21.15.61:0/3671912044 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f246c004d90 msgr2=0x7f246c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:47.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.499+0000 7f24837fe700 1 --2- 172.21.15.61:0/3671912044 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f246c004d90 0x7f246c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:47.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.499+0000 7f24837fe700 1 -- 172.21.15.61:0/3671912044 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246c0035b0 con 0x7f246c003a30 2023-01-01T17:39:47.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.499+0000 7f24837fe700 1 --2- 172.21.15.61:0/3671912044 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f246c003a30 0x7f246c003e00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f24740018d0 tx=0x7f246c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b3c15bf5ebb866 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:47.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.499+0000 7f24827fc700 1 -- 172.21.15.61:0/3671912044 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247400c690 con 0x7f246c003a30 2023-01-01T17:39:47.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.499+0000 7f24827fc700 1 -- 172.21.15.61:0/3671912044 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247400c810 con 0x7f246c003a30 2023-01-01T17:39:47.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.499+0000 7f24827fc700 1 -- 172.21.15.61:0/3671912044 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247400cbc0 con 0x7f246c003a30 2023-01-01T17:39:47.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.500+0000 7f2489bd6700 1 -- 172.21.15.61:0/3671912044 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f246c003a30 msgr2=0x7f246c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:47.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.500+0000 7f2489bd6700 1 --2- 172.21.15.61:0/3671912044 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f246c003a30 0x7f246c003e00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f24740018d0 tx=0x7f246c005880 comp rx=0 tx=0).stop 2023-01-01T17:39:47.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.500+0000 7f2483fff700 1 -- 172.21.15.61:0/3671912044 reap_dead start 2023-01-01T17:39:47.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.500+0000 7f2489bd6700 1 -- 172.21.15.61:0/3671912044 shutdown_connections 2023-01-01T17:39:47.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.500+0000 7f2489bd6700 1 -- 172.21.15.61:0/3671912044 >> 172.21.15.61:0/3671912044 conn(0x7f24840c1f30 msgr2=0x7f24840c2330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:47.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.500+0000 7f2489bd6700 1 -- 172.21.15.61:0/3671912044 shutdown_connections 2023-01-01T17:39:47.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.500+0000 7f2489bd6700 1 -- 172.21.15.61:0/3671912044 wait complete. 2023-01-01T17:39:47.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.501+0000 7f2489bd6700 1 Processor -- start 2023-01-01T17:39:47.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.502+0000 7f2489bd6700 1 -- start start 2023-01-01T17:39:47.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.503+0000 7f2489bd6700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f246c003a30 0x7f24840a8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:47.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.503+0000 7f2489bd6700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f24841449d0 0x7f24841ea330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:47.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.503+0000 7f2489bd6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2484144f00 0x7f24840c4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:47.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.503+0000 7f2489bd6700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24840aab70 con 0x7f24841449d0 2023-01-01T17:39:47.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.503+0000 7f2489bd6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2484150570 con 0x7f2484144f00 2023-01-01T17:39:47.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.503+0000 7f2489bd6700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24840a9050 con 0x7f246c003a30 2023-01-01T17:39:47.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.503+0000 7f2482ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f24841449d0 0x7f24841ea330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:47.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.503+0000 7f2482ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f24841449d0 0x7f24841ea330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:45776/0 (socket says 172.21.15.61:45776) 2023-01-01T17:39:47.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.503+0000 7f2482ffd700 1 -- 172.21.15.61:0/3317456571 learned_addr learned my addr 172.21.15.61:0/3317456571 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:47.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.503+0000 7f24837fe700 1 --2- 172.21.15.61:0/3317456571 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f246c003a30 0x7f24840a8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:47.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.503+0000 7f2483fff700 1 --2- 172.21.15.61:0/3317456571 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2484144f00 0x7f24840c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:47.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.503+0000 7f2482ffd700 1 -- 172.21.15.61:0/3317456571 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f246c003a30 msgr2=0x7f24840a8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:47.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.503+0000 7f2482ffd700 1 --2- 172.21.15.61:0/3317456571 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f246c003a30 0x7f24840a8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:47.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.503+0000 7f2482ffd700 1 -- 172.21.15.61:0/3317456571 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2484144f00 msgr2=0x7f24840c4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:47.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.503+0000 7f2482ffd700 1 --2- 172.21.15.61:0/3317456571 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2484144f00 0x7f24840c4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:47.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.503+0000 7f2482ffd700 1 -- 172.21.15.61:0/3317456571 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2484154880 con 0x7f24841449d0 2023-01-01T17:39:47.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.503+0000 7f24837fe700 1 --2- 172.21.15.61:0/3317456571 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f246c003a30 0x7f24840a8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-01T17:39:47.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.503+0000 7f2483fff700 1 --2- 172.21.15.61:0/3317456571 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2484144f00 0x7f24840c4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-01T17:39:47.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.503+0000 7f2482ffd700 1 --2- 172.21.15.61:0/3317456571 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f24841449d0 0x7f24841ea330 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f24780072c0 tx=0x7f2478007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:47.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.503+0000 7f246bfff700 1 -- 172.21.15.61:0/3317456571 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247800f8d0 con 0x7f24841449d0 2023-01-01T17:39:47.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.503+0000 7f246bfff700 1 -- 172.21.15.61:0/3317456571 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247800fa30 con 0x7f24841449d0 2023-01-01T17:39:47.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.503+0000 7f2489bd6700 1 -- 172.21.15.61:0/3317456571 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24841545a0 con 0x7f24841449d0 2023-01-01T17:39:47.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.503+0000 7f246bfff700 1 -- 172.21.15.61:0/3317456571 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247800fda0 con 0x7f24841449d0 2023-01-01T17:39:47.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.503+0000 7f2489bd6700 1 -- 172.21.15.61:0/3317456571 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2484154b60 con 0x7f24841449d0 2023-01-01T17:39:47.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.504+0000 7f2489bd6700 1 -- 172.21.15.61:0/3317456571 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24840668a0 con 0x7f24841449d0 2023-01-01T17:39:47.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.505+0000 7f246bfff700 1 -- 172.21.15.61:0/3317456571 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 4) v1 ==== 81907+0+0 (secure 0 0 0) 0x7f247801c030 con 0x7f24841449d0 2023-01-01T17:39:47.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.505+0000 7f246bfff700 1 --2- 172.21.15.61:0/3317456571 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f2470063240 0x7f24700656f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:47.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.505+0000 7f24837fe700 1 --2- 172.21.15.61:0/3317456571 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f2470063240 0x7f24700656f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:47.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.505+0000 7f246bfff700 1 -- 172.21.15.61:0/3317456571 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f247807efc0 con 0x7f24841449d0 2023-01-01T17:39:47.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.505+0000 7f24837fe700 1 --2- 172.21.15.61:0/3317456571 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f2470063240 0x7f24700656f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2474014040 tx=0x7f2474005040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:47.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.509+0000 7f246bfff700 1 -- 172.21.15.61:0/3317456571 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f247804e410 con 0x7f24841449d0 2023-01-01T17:39:47.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.699+0000 7f2489bd6700 1 -- 172.21.15.61:0/3317456571 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2484147ab0 con 0x7f24841449d0 2023-01-01T17:39:47.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.700+0000 7f246bfff700 1 -- 172.21.15.61:0/3317456571 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+13696 (secure 0 0 0) 0x7f2484147ab0 con 0x7f24841449d0 2023-01-01T17:39:47.701 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:47.701 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":15,"fsid":"fe0d3d8e-46ee-4ed9-92f8-749741721d01","created":"2023-01-01T17:39:34.752404+0000","modified":"2023-01-01T17:39:47.283855+0000","last_up_change":"2023-01-01T17:39:45.159720+0000","last_in_change":"2023-01-01T17:39:37.293057+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-01-01T17:39:46.110776+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-01-01T17:39:46.276625+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"5ba13bcd-4407-4cfd-8487-80917501e525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":94349},{"type":"v1","addr":"172.21.15.61:6825","nonce":94349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":94349},{"type":"v1","addr":"172.21.15.61:6827","nonce":94349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":94349},{"type":"v1","addr":"172.21.15.61:6831","nonce":94349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":94349},{"type":"v1","addr":"172.21.15.61:6829","nonce":94349}]},"public_addr":"172.21.15.61:6825/94349","cluster_addr":"172.21.15.61:6827/94349","heartbeat_back_addr":"172.21.15.61:6831/94349","heartbeat_front_addr":"172.21.15.61:6829/94349","state":["exists","up"]},{"osd":1,"uuid":"7dca9f34-ea22-4894-b238-5606b16b9c74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6811","nonce":94348},{"type":"v1","addr":"172.21.15.61:6813","nonce":94348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":94348},{"type":"v1","addr":"172.21.15.61:6816","nonce":94348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6821","nonce":94348},{"type":"v1","addr":"172.21.15.61:6823","nonce":94348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":94348},{"type":"v1","addr":"172.21.15.61:6819","nonce":94348}]},"public_addr":"172.21.15.61:6813/94348","cluster_addr":"172.21.15.61:6816/94348","heartbeat_back_addr":"172.21.15.61:6823/94348","heartbeat_front_addr":"172.21.15.61:6819/94348","state":["exists","up"]},{"osd":2,"uuid":"7b43ea06-a7b6-49f4-a390-18ad14dfe4fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":94350},{"type":"v1","addr":"172.21.15.61:6809","nonce":94350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":94350},{"type":"v1","addr":"172.21.15.61:6812","nonce":94350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":94350},{"type":"v1","addr":"172.21.15.61:6822","nonce":94350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6815","nonce":94350},{"type":"v1","addr":"172.21.15.61:6817","nonce":94350}]},"public_addr":"172.21.15.61:6809/94350","cluster_addr":"172.21.15.61:6812/94350","heartbeat_back_addr":"172.21.15.61:6822/94350","heartbeat_front_addr":"172.21.15.61:6817/94350","state":["exists","up"]},{"osd":3,"uuid":"117c41d8-d40c-4cc0-b0e1-70bca058fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":94347},{"type":"v1","addr":"172.21.15.61:6801","nonce":94347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":94347},{"type":"v1","addr":"172.21.15.61:6803","nonce":94347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":94347},{"type":"v1","addr":"172.21.15.61:6807","nonce":94347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":94347},{"type":"v1","addr":"172.21.15.61:6805","nonce":94347}]},"public_addr":"172.21.15.61:6801/94347","cluster_addr":"172.21.15.61:6803/94347","heartbeat_back_addr":"172.21.15.61:6807/94347","heartbeat_front_addr":"172.21.15.61:6805/94347","state":["exists","up"]},{"osd":4,"uuid":"4073e0e8-c5dd-463f-aa1c-c9515ef09976","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":94711},{"type":"v1","addr":"172.21.15.149:6818","nonce":94711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":94711},{"type":"v1","addr":"172.21.15.149:6822","nonce":94711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":94711},{"type":"v1","addr":"172.21.15.149:6830","nonce":94711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":94711},{"type":"v1","addr":"172.21.15.149:6826","nonce":94711}]},"public_addr":"172.21.15.149:6818/94711","cluster_addr":"172.21.15.149:6822/94711","heartbeat_back_addr":"172.21.15.149:6830/94711","heartbeat_front_addr":"172.21.15.149:6826/94711","state":["exists","up"]},{"osd":5,"uuid":"88aa0c0f-e3c1-4dd3-af8c-61f4bc28504e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":94709},{"type":"v1","addr":"172.21.15.149:6809","nonce":94709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":94709},{"type":"v1","addr":"172.21.15.149:6811","nonce":94709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":94709},{"type":"v1","addr":"172.21.15.149:6815","nonce":94709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":94709},{"type":"v1","addr":"172.21.15.149:6813","nonce":94709}]},"public_addr":"172.21.15.149:6809/94709","cluster_addr":"172.21.15.149:6811/94709","heartbeat_back_addr":"172.21.15.149:6815/94709","heartbeat_front_addr":"172.21.15.149:6813/94709","state":["exists","up"]},{"osd":6,"uuid":"8b13fc0c-5f00-41c7-8923-c4570da77afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":94710},{"type":"v1","addr":"172.21.15.149:6801","nonce":94710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":94710},{"type":"v1","addr":"172.21.15.149:6803","nonce":94710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":94710},{"type":"v1","addr":"172.21.15.149:6807","nonce":94710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":94710},{"type":"v1","addr":"172.21.15.149:6805","nonce":94710}]},"public_addr":"172.21.15.149:6801/94710","cluster_addr":"172.21.15.149:6803/94710","heartbeat_back_addr":"172.21.15.149:6807/94710","heartbeat_front_addr":"172.21.15.149:6805/94710","state":["exists","up"]},{"osd":7,"uuid":"5390c6e5-39e7-4aa6-b73c-642458b2acf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":94734},{"type":"v1","addr":"172.21.15.149:6819","nonce":94734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":94734},{"type":"v1","addr":"172.21.15.149:6823","nonce":94734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":94734},{"type":"v1","addr":"172.21.15.149:6831","nonce":94734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":94734},{"type":"v1","addr":"172.21.15.149:6827","nonce":94734}]},"public_addr":"172.21.15.149:6819/94734","cluster_addr":"172.21.15.149:6823/94734","heartbeat_back_addr":"172.21.15.149:6831/94734","heartbeat_front_addr":"172.21.15.149:6827/94734","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.555826+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.508739+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.515601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.472067+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.535257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.493397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.554910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.552343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-01T17:39:47.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.702+0000 7f2489bd6700 1 -- 172.21.15.61:0/3317456571 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f2470063240 msgr2=0x7f24700656f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:47.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.702+0000 7f2489bd6700 1 --2- 172.21.15.61:0/3317456571 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f2470063240 0x7f24700656f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2474014040 tx=0x7f2474005040 comp rx=0 tx=0).stop 2023-01-01T17:39:47.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.702+0000 7f2489bd6700 1 -- 172.21.15.61:0/3317456571 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f24841449d0 msgr2=0x7f24841ea330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:47.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.702+0000 7f2489bd6700 1 --2- 172.21.15.61:0/3317456571 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f24841449d0 0x7f24841ea330 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f24780072c0 tx=0x7f2478007680 comp rx=0 tx=0).stop 2023-01-01T17:39:47.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.702+0000 7f2489bd6700 1 -- 172.21.15.61:0/3317456571 shutdown_connections 2023-01-01T17:39:47.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.702+0000 7f2489bd6700 1 --2- 172.21.15.61:0/3317456571 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2484144f00 0x7f24840c4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:47.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.702+0000 7f2489bd6700 1 --2- 172.21.15.61:0/3317456571 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f246c003a30 0x7f24840a8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:47.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.702+0000 7f2489bd6700 1 --2- 172.21.15.61:0/3317456571 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f2470063240 0x7f24700656f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:47.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.702+0000 7f2489bd6700 1 --2- 172.21.15.61:0/3317456571 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f24841449d0 0x7f24841ea330 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:47.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.702+0000 7f2489bd6700 1 -- 172.21.15.61:0/3317456571 >> 172.21.15.61:0/3317456571 conn(0x7f24840c1f30 msgr2=0x7f24840c0840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:47.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.703+0000 7f2489bd6700 1 -- 172.21.15.61:0/3317456571 shutdown_connections 2023-01-01T17:39:47.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.703+0000 7f2489bd6700 1 -- 172.21.15.61:0/3317456571 wait complete. 2023-01-01T17:39:47.715 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-01-01T17:39:46.110776+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-01-01T17:39:46.276625+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-01-01T17:39:47.716 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-01-01T17:39:47.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.848+0000 7fa61ed66700 1 Processor -- start 2023-01-01T17:39:47.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.848+0000 7fa61ed66700 1 -- start start 2023-01-01T17:39:47.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.849+0000 7fa61ed66700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6180c7260 0x7fa6180c3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:47.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.849+0000 7fa61ed66700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa61806dae0 con 0x7fa6180c5cf0 2023-01-01T17:39:47.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.849+0000 7fa61ed66700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6180ba5b0 con 0x7fa6180c6e90 2023-01-01T17:39:47.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.849+0000 7fa61ed66700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa61806e550 con 0x7fa6180c7260 2023-01-01T17:39:47.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.849+0000 7fa61d303700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fa6180c5cf0 0x7fa6180c38b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39638/0 (socket says 172.21.15.61:39638) 2023-01-01T17:39:47.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.849+0000 7fa61d303700 1 -- 172.21.15.61:0/1076017924 learned_addr learned my addr 172.21.15.61:0/1076017924 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:39:47.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.849+0000 7fa617fff700 1 --2- 172.21.15.61:0/1076017924 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6180c7260 0x7fa6180c3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:47.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.849+0000 7fa6177fe700 1 -- 172.21.15.61:0/1076017924 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2893943964 0 0) 0x7fa61806dae0 con 0x7fa6180c5cf0 2023-01-01T17:39:47.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.849+0000 7fa6177fe700 1 -- 172.21.15.61:0/1076017924 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6080035b0 con 0x7fa6180c5cf0 2023-01-01T17:39:47.853 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.849+0000 7fa6177fe700 1 -- 172.21.15.61:0/1076017924 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1084465449 0 0) 0x7fa6180ba5b0 con 0x7fa6180c6e90 2023-01-01T17:39:47.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.849+0000 7fa6177fe700 1 -- 172.21.15.61:0/1076017924 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa61806dae0 con 0x7fa6180c6e90 2023-01-01T17:39:47.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.849+0000 7fa617fff700 1 -- 172.21.15.61:0/1076017924 >> v1:172.21.15.149:6789/0 conn(0x7fa6180c6e90 legacy=0x7fa6180c55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:47.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.849+0000 7fa617fff700 1 -- 172.21.15.61:0/1076017924 >> v1:172.21.15.61:6789/0 conn(0x7fa6180c5cf0 legacy=0x7fa6180c38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:47.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.849+0000 7fa617fff700 1 -- 172.21.15.61:0/1076017924 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61806e830 con 0x7fa6180c7260 2023-01-01T17:39:47.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.850+0000 7fa617fff700 1 --2- 172.21.15.61:0/1076017924 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6180c7260 0x7fa6180c3370 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa604009870 tx=0x7fa604009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43836445c04bd870 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:47.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.850+0000 7fa6177fe700 1 -- 172.21.15.61:0/1076017924 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa604011830 con 0x7fa6180c7260 2023-01-01T17:39:47.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.850+0000 7fa6177fe700 1 -- 172.21.15.61:0/1076017924 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa604011990 con 0x7fa6180c7260 2023-01-01T17:39:47.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.850+0000 7fa6177fe700 1 -- 172.21.15.61:0/1076017924 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa604011d20 con 0x7fa6180c7260 2023-01-01T17:39:47.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.850+0000 7fa61ed66700 1 -- 172.21.15.61:0/1076017924 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6180c7260 msgr2=0x7fa6180c3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:47.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.850+0000 7fa61ed66700 1 --2- 172.21.15.61:0/1076017924 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6180c7260 0x7fa6180c3370 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa604009870 tx=0x7fa604009b80 comp rx=0 tx=0).stop 2023-01-01T17:39:47.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.851+0000 7fa61ed66700 1 -- 172.21.15.61:0/1076017924 shutdown_connections 2023-01-01T17:39:47.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.851+0000 7fa61ed66700 1 --2- 172.21.15.61:0/1076017924 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6180c7260 0x7fa6180c3370 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:47.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.851+0000 7fa61ed66700 1 -- 172.21.15.61:0/1076017924 >> 172.21.15.61:0/1076017924 conn(0x7fa618070ad0 msgr2=0x7fa618070ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:47.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.851+0000 7fa61ed66700 1 -- 172.21.15.61:0/1076017924 shutdown_connections 2023-01-01T17:39:47.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.851+0000 7fa61ed66700 1 -- 172.21.15.61:0/1076017924 wait complete. 2023-01-01T17:39:47.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.852+0000 7fa61ed66700 1 Processor -- start 2023-01-01T17:39:47.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.852+0000 7fa61ed66700 1 -- start start 2023-01-01T17:39:47.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.853+0000 7fa61ed66700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa6180c5cf0 0x7fa6181ea4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:47.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.853+0000 7fa61ed66700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6180c6e90 0x7fa6180bf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:47.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.853+0000 7fa61ed66700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6180c7260 0x7fa6180a6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:47.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.853+0000 7fa61ed66700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6180bc860 con 0x7fa6180c5cf0 2023-01-01T17:39:47.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.853+0000 7fa61ed66700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6181dbd70 con 0x7fa6180c7260 2023-01-01T17:39:47.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.853+0000 7fa61ed66700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6180ba770 con 0x7fa6180c6e90 2023-01-01T17:39:47.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.853+0000 7fa61cb02700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa6180c5cf0 0x7fa6181ea4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:47.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.853+0000 7fa61cb02700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa6180c5cf0 0x7fa6181ea4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:45790/0 (socket says 172.21.15.61:45790) 2023-01-01T17:39:47.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.853+0000 7fa61cb02700 1 -- 172.21.15.61:0/1375334720 learned_addr learned my addr 172.21.15.61:0/1375334720 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:47.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.853+0000 7fa617fff700 1 --2- 172.21.15.61:0/1375334720 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6180c6e90 0x7fa6180bf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:47.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.853+0000 7fa61d303700 1 --2- 172.21.15.61:0/1375334720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6180c7260 0x7fa6180a6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:47.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.853+0000 7fa61cb02700 1 -- 172.21.15.61:0/1375334720 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6180c6e90 msgr2=0x7fa6180bf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:47.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.853+0000 7fa61cb02700 1 --2- 172.21.15.61:0/1375334720 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6180c6e90 0x7fa6180bf8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:47.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.853+0000 7fa61cb02700 1 -- 172.21.15.61:0/1375334720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6180c7260 msgr2=0x7fa6180a6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:47.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.853+0000 7fa61cb02700 1 --2- 172.21.15.61:0/1375334720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6180c7260 0x7fa6180a6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:47.860 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.853+0000 7fa61cb02700 1 -- 172.21.15.61:0/1375334720 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6040094a0 con 0x7fa6180c5cf0 2023-01-01T17:39:47.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.853+0000 7fa61cb02700 1 --2- 172.21.15.61:0/1375334720 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa6180c5cf0 0x7fa6181ea4c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa60c00c520 tx=0x7fa60c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:47.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.853+0000 7fa6157fa700 1 -- 172.21.15.61:0/1375334720 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60c0052d0 con 0x7fa6180c5cf0 2023-01-01T17:39:47.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.853+0000 7fa6157fa700 1 -- 172.21.15.61:0/1375334720 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60c005430 con 0x7fa6180c5cf0 2023-01-01T17:39:47.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.853+0000 7fa61ed66700 1 -- 172.21.15.61:0/1375334720 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa61806d770 con 0x7fa6180c5cf0 2023-01-01T17:39:47.861 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.854+0000 7fa6157fa700 1 -- 172.21.15.61:0/1375334720 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60c0038c0 con 0x7fa6180c5cf0 2023-01-01T17:39:47.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.854+0000 7fa61ed66700 1 -- 172.21.15.61:0/1375334720 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa61806eb10 con 0x7fa6180c5cf0 2023-01-01T17:39:47.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.855+0000 7fa61ed66700 1 -- 172.21.15.61:0/1375334720 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa61806d400 con 0x7fa6180c5cf0 2023-01-01T17:39:47.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.855+0000 7fa6157fa700 1 -- 172.21.15.61:0/1375334720 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 4) v1 ==== 81907+0+0 (secure 0 0 0) 0x7fa60c019030 con 0x7fa6180c5cf0 2023-01-01T17:39:47.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.855+0000 7fa6157fa700 1 --2- 172.21.15.61:0/1375334720 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fa5fc063240 0x7fa5fc0656f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:47.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.855+0000 7fa6157fa700 1 -- 172.21.15.61:0/1375334720 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa60c07e9c0 con 0x7fa6180c5cf0 2023-01-01T17:39:47.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.855+0000 7fa617fff700 1 --2- 172.21.15.61:0/1375334720 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fa5fc063240 0x7fa5fc0656f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:47.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.856+0000 7fa617fff700 1 --2- 172.21.15.61:0/1375334720 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fa5fc063240 0x7fa5fc0656f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa6040090b0 tx=0x7fa60401c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:47.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:47.861+0000 7fa6157fa700 1 -- 172.21.15.61:0/1375334720 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7fa60c04de10 con 0x7fa6180c5cf0 2023-01-01T17:39:48.054 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.054+0000 7fa61ed66700 1 -- 172.21.15.61:0/1375334720 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa6180668a0 con 0x7fa6180c5cf0 2023-01-01T17:39:48.055 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.054+0000 7fa6157fa700 1 -- 172.21.15.61:0/1375334720 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa60c051430 con 0x7fa6180c5cf0 2023-01-01T17:39:48.055 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 8 2023-01-01T17:39:48.057 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.056+0000 7fa61ed66700 1 -- 172.21.15.61:0/1375334720 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fa5fc063240 msgr2=0x7fa5fc0656f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:48.057 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.056+0000 7fa61ed66700 1 --2- 172.21.15.61:0/1375334720 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fa5fc063240 0x7fa5fc0656f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa6040090b0 tx=0x7fa60401c040 comp rx=0 tx=0).stop 2023-01-01T17:39:48.057 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.056+0000 7fa61ed66700 1 -- 172.21.15.61:0/1375334720 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa6180c5cf0 msgr2=0x7fa6181ea4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:48.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.056+0000 7fa61ed66700 1 --2- 172.21.15.61:0/1375334720 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa6180c5cf0 0x7fa6181ea4c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa60c00c520 tx=0x7fa60c00c830 comp rx=0 tx=0).stop 2023-01-01T17:39:48.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.057+0000 7fa61ed66700 1 -- 172.21.15.61:0/1375334720 shutdown_connections 2023-01-01T17:39:48.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.057+0000 7fa61ed66700 1 --2- 172.21.15.61:0/1375334720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6180c7260 0x7fa6180a6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:48.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.057+0000 7fa61ed66700 1 --2- 172.21.15.61:0/1375334720 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fa5fc063240 0x7fa5fc0656f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:48.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.057+0000 7fa61ed66700 1 --2- 172.21.15.61:0/1375334720 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa6180c5cf0 0x7fa6181ea4c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:48.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.057+0000 7fa61ed66700 1 --2- 172.21.15.61:0/1375334720 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa6180c6e90 0x7fa6180bf8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:48.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.057+0000 7fa61ed66700 1 -- 172.21.15.61:0/1375334720 >> 172.21.15.61:0/1375334720 conn(0x7fa618070ad0 msgr2=0x7fa6180c7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:48.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.057+0000 7fa61ed66700 1 -- 172.21.15.61:0/1375334720 shutdown_connections 2023-01-01T17:39:48.058 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.057+0000 7fa61ed66700 1 -- 172.21.15.61:0/1375334720 wait complete. 2023-01-01T17:39:48.069 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-01-01T17:39:48.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.198+0000 7f9e41e66700 1 Processor -- start 2023-01-01T17:39:48.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.198+0000 7f9e41e66700 1 -- start start 2023-01-01T17:39:48.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.198+0000 7f9e41e66700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9e3c14cf50 0x7f9e3c0c0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:48.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.198+0000 7f9e41e66700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e3c0c0760 0x7f9e3c069360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:48.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.198+0000 7f9e41e66700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e3c06aaa0 con 0x7f9e3c06cff0 2023-01-01T17:39:48.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.198+0000 7f9e41e66700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e3c069e90 con 0x7f9e3c14cf50 2023-01-01T17:39:48.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.198+0000 7f9e41e66700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c06a170 con 0x7f9e3c0c0760 2023-01-01T17:39:48.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.199+0000 7f9e3bfff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f9e3c06cff0 0x7f9e3c152ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39658/0 (socket says 172.21.15.61:39658) 2023-01-01T17:39:48.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.199+0000 7f9e3bfff700 1 -- 172.21.15.61:0/1854900 learned_addr learned my addr 172.21.15.61:0/1854900 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:39:48.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.199+0000 7f9e3b7fe700 1 --2- 172.21.15.61:0/1854900 >> v2:172.21.15.149:3300/0 conn(0x7f9e3c14cf50 0x7f9e3c0c0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:48.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.199+0000 7f9e3affd700 1 --2- 172.21.15.61:0/1854900 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e3c0c0760 0x7f9e3c069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:48.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.199+0000 7f9e3a7fc700 1 -- 172.21.15.61:0/1854900 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2294528715 0 0) 0x7f9e3c06aaa0 con 0x7f9e3c06cff0 2023-01-01T17:39:48.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.199+0000 7f9e3a7fc700 1 -- 172.21.15.61:0/1854900 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e240035b0 con 0x7f9e3c06cff0 2023-01-01T17:39:48.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.199+0000 7f9e3b7fe700 1 -- 172.21.15.61:0/1854900 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e3c0c0760 msgr2=0x7f9e3c069360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:48.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.199+0000 7f9e3b7fe700 1 --2- 172.21.15.61:0/1854900 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e3c0c0760 0x7f9e3c069360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:48.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.199+0000 7f9e3b7fe700 1 -- 172.21.15.61:0/1854900 >> v1:172.21.15.61:6789/0 conn(0x7f9e3c06cff0 legacy=0x7f9e3c152ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:48.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.199+0000 7f9e3b7fe700 1 -- 172.21.15.61:0/1854900 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3c06a450 con 0x7f9e3c14cf50 2023-01-01T17:39:48.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.199+0000 7f9e3affd700 1 --2- 172.21.15.61:0/1854900 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e3c0c0760 0x7f9e3c069360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-01-01T17:39:48.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.199+0000 7f9e3b7fe700 1 --2- 172.21.15.61:0/1854900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e3c14cf50 0x7f9e3c0c0220 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c009840 tx=0x7f9e2c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a54e2f56cad87b7 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:48.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.199+0000 7f9e3a7fc700 1 -- 172.21.15.61:0/1854900 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c011830 con 0x7f9e3c14cf50 2023-01-01T17:39:48.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.199+0000 7f9e3a7fc700 1 -- 172.21.15.61:0/1854900 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2c011990 con 0x7f9e3c14cf50 2023-01-01T17:39:48.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.199+0000 7f9e3a7fc700 1 -- 172.21.15.61:0/1854900 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c011d20 con 0x7f9e3c14cf50 2023-01-01T17:39:48.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.200+0000 7f9e41e66700 1 -- 172.21.15.61:0/1854900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e3c14cf50 msgr2=0x7f9e3c0c0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:48.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.200+0000 7f9e41e66700 1 --2- 172.21.15.61:0/1854900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e3c14cf50 0x7f9e3c0c0220 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c009840 tx=0x7f9e2c009b50 comp rx=0 tx=0).stop 2023-01-01T17:39:48.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.200+0000 7f9e41e66700 1 -- 172.21.15.61:0/1854900 shutdown_connections 2023-01-01T17:39:48.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.200+0000 7f9e41e66700 1 --2- 172.21.15.61:0/1854900 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e3c14cf50 0x7f9e3c0c0220 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:48.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.200+0000 7f9e41e66700 1 --2- 172.21.15.61:0/1854900 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e3c0c0760 0x7f9e3c069360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:48.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.200+0000 7f9e41e66700 1 -- 172.21.15.61:0/1854900 >> 172.21.15.61:0/1854900 conn(0x7f9e3c0c1e80 msgr2=0x7f9e3c0c2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:48.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.200+0000 7f9e41e66700 1 -- 172.21.15.61:0/1854900 shutdown_connections 2023-01-01T17:39:48.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.200+0000 7f9e41e66700 1 -- 172.21.15.61:0/1854900 wait complete. 2023-01-01T17:39:48.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.201+0000 7f9e41e66700 1 Processor -- start 2023-01-01T17:39:48.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.201+0000 7f9e41e66700 1 -- start start 2023-01-01T17:39:48.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.202+0000 7f9e41e66700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e3c06cff0 0x7f9e3c151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:48.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.202+0000 7f9e41e66700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9e3c14cf50 0x7f9e3c1439c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:48.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.202+0000 7f9e41e66700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e3c0a8fe0 0x7f9e3c143f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:48.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.202+0000 7f9e41e66700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c0ab370 con 0x7f9e3c14cf50 2023-01-01T17:39:48.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.202+0000 7f9e41e66700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c0aadb0 con 0x7f9e3c06cff0 2023-01-01T17:39:48.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.202+0000 7f9e41e66700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c0ab090 con 0x7f9e3c0a8fe0 2023-01-01T17:39:48.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.202+0000 7f9e3affd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9e3c14cf50 0x7f9e3c1439c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:48.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.202+0000 7f9e3affd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9e3c14cf50 0x7f9e3c1439c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:45812/0 (socket says 172.21.15.61:45812) 2023-01-01T17:39:48.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.202+0000 7f9e3affd700 1 -- 172.21.15.61:0/3771166720 learned_addr learned my addr 172.21.15.61:0/3771166720 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:48.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.202+0000 7f9e3bfff700 1 --2- 172.21.15.61:0/3771166720 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e3c0a8fe0 0x7f9e3c143f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:48.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.202+0000 7f9e3b7fe700 1 --2- 172.21.15.61:0/3771166720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e3c06cff0 0x7f9e3c151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:48.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.202+0000 7f9e3affd700 1 -- 172.21.15.61:0/3771166720 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e3c0a8fe0 msgr2=0x7f9e3c143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:48.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.202+0000 7f9e3affd700 1 --2- 172.21.15.61:0/3771166720 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e3c0a8fe0 0x7f9e3c143f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:48.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.202+0000 7f9e3affd700 1 -- 172.21.15.61:0/3771166720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e3c06cff0 msgr2=0x7f9e3c151d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:48.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.202+0000 7f9e3affd700 1 --2- 172.21.15.61:0/3771166720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e3c06cff0 0x7f9e3c151d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:48.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.202+0000 7f9e3affd700 1 -- 172.21.15.61:0/3771166720 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e300094a0 con 0x7f9e3c14cf50 2023-01-01T17:39:48.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.203+0000 7f9e3affd700 1 --2- 172.21.15.61:0/3771166720 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9e3c14cf50 0x7f9e3c1439c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9e3000ebe0 tx=0x7f9e3000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:48.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.203+0000 7f9e23fff700 1 -- 172.21.15.61:0/3771166720 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3000c850 con 0x7f9e3c14cf50 2023-01-01T17:39:48.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.203+0000 7f9e23fff700 1 -- 172.21.15.61:0/3771166720 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3000c9b0 con 0x7f9e3c14cf50 2023-01-01T17:39:48.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.203+0000 7f9e41e66700 1 -- 172.21.15.61:0/3771166720 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e2c0094a0 con 0x7f9e3c14cf50 2023-01-01T17:39:48.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.203+0000 7f9e23fff700 1 -- 172.21.15.61:0/3771166720 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3000cd40 con 0x7f9e3c14cf50 2023-01-01T17:39:48.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.203+0000 7f9e41e66700 1 -- 172.21.15.61:0/3771166720 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e3c0698a0 con 0x7f9e3c14cf50 2023-01-01T17:39:48.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.204+0000 7f9e41e66700 1 -- 172.21.15.61:0/3771166720 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e3c06a730 con 0x7f9e3c14cf50 2023-01-01T17:39:48.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.204+0000 7f9e23fff700 1 -- 172.21.15.61:0/3771166720 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 4) v1 ==== 81907+0+0 (secure 0 0 0) 0x7f9e30023070 con 0x7f9e3c14cf50 2023-01-01T17:39:48.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.204+0000 7f9e23fff700 1 --2- 172.21.15.61:0/3771166720 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f9e28063240 0x7f9e280656f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:48.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.204+0000 7f9e23fff700 1 -- 172.21.15.61:0/3771166720 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9e3007f940 con 0x7f9e3c14cf50 2023-01-01T17:39:48.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.205+0000 7f9e3b7fe700 1 --2- 172.21.15.61:0/3771166720 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f9e28063240 0x7f9e280656f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:48.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.205+0000 7f9e3b7fe700 1 --2- 172.21.15.61:0/3771166720 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f9e28063240 0x7f9e280656f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c000c00 tx=0x7f9e2c01c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:48.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.209+0000 7f9e23fff700 1 -- 172.21.15.61:0/3771166720 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f9e3004ed90 con 0x7f9e3c14cf50 2023-01-01T17:39:48.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.405+0000 7f9e41e66700 1 -- 172.21.15.61:0/3771166720 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9e3c069a30 con 0x7f9e3c14cf50 2023-01-01T17:39:48.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.406+0000 7f9e23fff700 1 -- 172.21.15.61:0/3771166720 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9e3000cea0 con 0x7f9e3c14cf50 2023-01-01T17:39:48.406 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 1 2023-01-01T17:39:48.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.408+0000 7f9e41e66700 1 -- 172.21.15.61:0/3771166720 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f9e28063240 msgr2=0x7f9e280656f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:48.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.408+0000 7f9e41e66700 1 --2- 172.21.15.61:0/3771166720 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f9e28063240 0x7f9e280656f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c000c00 tx=0x7f9e2c01c040 comp rx=0 tx=0).stop 2023-01-01T17:39:48.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.408+0000 7f9e41e66700 1 -- 172.21.15.61:0/3771166720 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9e3c14cf50 msgr2=0x7f9e3c1439c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:48.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.408+0000 7f9e41e66700 1 --2- 172.21.15.61:0/3771166720 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9e3c14cf50 0x7f9e3c1439c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9e3000ebe0 tx=0x7f9e3000eef0 comp rx=0 tx=0).stop 2023-01-01T17:39:48.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.408+0000 7f9e41e66700 1 -- 172.21.15.61:0/3771166720 shutdown_connections 2023-01-01T17:39:48.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.408+0000 7f9e41e66700 1 --2- 172.21.15.61:0/3771166720 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9e3c0a8fe0 0x7f9e3c143f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:48.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.408+0000 7f9e41e66700 1 --2- 172.21.15.61:0/3771166720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9e3c06cff0 0x7f9e3c151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:48.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.408+0000 7f9e41e66700 1 --2- 172.21.15.61:0/3771166720 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f9e28063240 0x7f9e280656f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:48.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.408+0000 7f9e41e66700 1 --2- 172.21.15.61:0/3771166720 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9e3c14cf50 0x7f9e3c1439c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:48.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.408+0000 7f9e41e66700 1 -- 172.21.15.61:0/3771166720 >> 172.21.15.61:0/3771166720 conn(0x7f9e3c0c1e80 msgr2=0x7f9e3c147eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:48.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.408+0000 7f9e41e66700 1 -- 172.21.15.61:0/3771166720 shutdown_connections 2023-01-01T17:39:48.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.408+0000 7f9e41e66700 1 -- 172.21.15.61:0/3771166720 wait complete. 2023-01-01T17:39:48.421 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-01-01T17:39:48.548 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.548+0000 7ff548764700 1 Processor -- start 2023-01-01T17:39:48.549 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.548+0000 7ff548764700 1 -- start start 2023-01-01T17:39:48.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.549+0000 7ff548764700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff5400695d0 0x7ff5400c3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:48.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.549+0000 7ff548764700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff5400699a0 0x7ff540071020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:48.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.549+0000 7ff548764700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff540070420 con 0x7ff540154ce0 2023-01-01T17:39:48.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.549+0000 7ff548764700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5401548c0 con 0x7ff5400695d0 2023-01-01T17:39:48.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.549+0000 7ff548764700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff540070010 con 0x7ff5400699a0 2023-01-01T17:39:48.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.549+0000 7ff546500700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff5400695d0 0x7ff5400c3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:48.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.549+0000 7ff545cff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff5400699a0 0x7ff540071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:48.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.549+0000 7ff546500700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff5400695d0 0x7ff5400c3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:45832/0 (socket says 172.21.15.61:45832) 2023-01-01T17:39:48.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.549+0000 7ff546500700 1 -- 172.21.15.61:0/320886182 learned_addr learned my addr 172.21.15.61:0/320886182 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:48.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.549+0000 7ff545cff700 1 -- 172.21.15.61:0/320886182 >> v2:172.21.15.61:3300/0 conn(0x7ff5400695d0 msgr2=0x7ff5400c3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:48.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.549+0000 7ff545cff700 1 --2- 172.21.15.61:0/320886182 >> v2:172.21.15.61:3300/0 conn(0x7ff5400695d0 0x7ff5400c3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:48.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.549+0000 7ff545cff700 1 -- 172.21.15.61:0/320886182 >> v1:172.21.15.149:6789/0 conn(0x7ff540154ce0 legacy=0x7ff540155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:48.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.549+0000 7ff545cff700 1 -- 172.21.15.61:0/320886182 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff540070670 con 0x7ff5400699a0 2023-01-01T17:39:48.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.549+0000 7ff5454fe700 1 -- 172.21.15.61:0/320886182 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2636392752 0 0) 0x7ff540070420 con 0x7ff540154ce0 2023-01-01T17:39:48.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.550+0000 7ff545cff700 1 --2- 172.21.15.61:0/320886182 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5400699a0 0x7ff540071020 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff540069e30 tx=0x7ff530009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=353282cab988698c server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:48.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.550+0000 7ff5454fe700 1 -- 172.21.15.61:0/320886182 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff530011830 con 0x7ff5400699a0 2023-01-01T17:39:48.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.550+0000 7ff5454fe700 1 -- 172.21.15.61:0/320886182 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff530011990 con 0x7ff5400699a0 2023-01-01T17:39:48.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.550+0000 7ff5454fe700 1 -- 172.21.15.61:0/320886182 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff530011d20 con 0x7ff5400699a0 2023-01-01T17:39:48.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.550+0000 7ff548764700 1 -- 172.21.15.61:0/320886182 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5400699a0 msgr2=0x7ff540071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:48.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.550+0000 7ff548764700 1 --2- 172.21.15.61:0/320886182 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5400699a0 0x7ff540071020 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff540069e30 tx=0x7ff530009b20 comp rx=0 tx=0).stop 2023-01-01T17:39:48.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.550+0000 7ff548764700 1 -- 172.21.15.61:0/320886182 shutdown_connections 2023-01-01T17:39:48.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.550+0000 7ff548764700 1 --2- 172.21.15.61:0/320886182 >> v2:172.21.15.61:3300/0 conn(0x7ff5400695d0 0x7ff5400c3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:48.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.550+0000 7ff548764700 1 --2- 172.21.15.61:0/320886182 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff5400699a0 0x7ff540071020 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:48.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.550+0000 7ff548764700 1 -- 172.21.15.61:0/320886182 >> 172.21.15.61:0/320886182 conn(0x7ff54006b100 msgr2=0x7ff5400c5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:48.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.550+0000 7ff548764700 1 -- 172.21.15.61:0/320886182 shutdown_connections 2023-01-01T17:39:48.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.551+0000 7ff548764700 1 -- 172.21.15.61:0/320886182 wait complete. 2023-01-01T17:39:48.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.552+0000 7ff548764700 1 Processor -- start 2023-01-01T17:39:48.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.552+0000 7ff548764700 1 -- start start 2023-01-01T17:39:48.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.552+0000 7ff548764700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff5400695d0 0x7ff5401e8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:48.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.552+0000 7ff548764700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5400699a0 0x7ff5401ec2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:48.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.552+0000 7ff548764700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff540154ce0 0x7ff5400be0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:48.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.552+0000 7ff548764700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5401e9330 con 0x7ff5400695d0 2023-01-01T17:39:48.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.552+0000 7ff548764700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5401ebae0 con 0x7ff540154ce0 2023-01-01T17:39:48.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.552+0000 7ff548764700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5400a8c50 con 0x7ff5400699a0 2023-01-01T17:39:48.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.552+0000 7ff546500700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff5400695d0 0x7ff5401e8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:48.558 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.552+0000 7ff546500700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff5400695d0 0x7ff5401e8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:45838/0 (socket says 172.21.15.61:45838) 2023-01-01T17:39:48.558 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.552+0000 7ff546500700 1 -- 172.21.15.61:0/868468464 learned_addr learned my addr 172.21.15.61:0/868468464 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:48.558 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.553+0000 7ff546d01700 1 --2- 172.21.15.61:0/868468464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff540154ce0 0x7ff5400be0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:48.558 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.553+0000 7ff545cff700 1 --2- 172.21.15.61:0/868468464 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5400699a0 0x7ff5401ec2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:48.558 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.553+0000 7ff546500700 1 -- 172.21.15.61:0/868468464 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5400699a0 msgr2=0x7ff5401ec2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:48.558 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.553+0000 7ff546500700 1 --2- 172.21.15.61:0/868468464 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5400699a0 0x7ff5401ec2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:48.558 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.553+0000 7ff546500700 1 -- 172.21.15.61:0/868468464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff540154ce0 msgr2=0x7ff5400be0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:48.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.553+0000 7ff546500700 1 --2- 172.21.15.61:0/868468464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff540154ce0 0x7ff5400be0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:48.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.553+0000 7ff546500700 1 -- 172.21.15.61:0/868468464 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5300094a0 con 0x7ff5400695d0 2023-01-01T17:39:48.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.553+0000 7ff546500700 1 --2- 172.21.15.61:0/868468464 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff5400695d0 0x7ff5401e8df0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff53c00e800 tx=0x7ff53c00eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:48.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.572+0000 7ff536ffd700 1 -- 172.21.15.61:0/868468464 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c013680 con 0x7ff5400695d0 2023-01-01T17:39:48.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.572+0000 7ff548764700 1 -- 172.21.15.61:0/868468464 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff540070c30 con 0x7ff5400695d0 2023-01-01T17:39:48.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.572+0000 7ff548764700 1 -- 172.21.15.61:0/868468464 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff540070950 con 0x7ff5400695d0 2023-01-01T17:39:48.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.573+0000 7ff536ffd700 1 -- 172.21.15.61:0/868468464 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53c0137e0 con 0x7ff5400695d0 2023-01-01T17:39:48.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.573+0000 7ff536ffd700 1 -- 172.21.15.61:0/868468464 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c013b50 con 0x7ff5400695d0 2023-01-01T17:39:48.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.574+0000 7ff548764700 1 -- 172.21.15.61:0/868468464 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff540155810 con 0x7ff5400695d0 2023-01-01T17:39:48.577 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.574+0000 7ff536ffd700 1 -- 172.21.15.61:0/868468464 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 4) v1 ==== 81907+0+0 (secure 0 0 0) 0x7ff53c019030 con 0x7ff5400695d0 2023-01-01T17:39:48.577 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.574+0000 7ff536ffd700 1 --2- 172.21.15.61:0/868468464 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7ff524063240 0x7ff5240656f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:48.577 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.575+0000 7ff536ffd700 1 -- 172.21.15.61:0/868468464 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff53c07fba0 con 0x7ff5400695d0 2023-01-01T17:39:48.577 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.575+0000 7ff545cff700 1 --2- 172.21.15.61:0/868468464 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7ff524063240 0x7ff5240656f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:48.577 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.575+0000 7ff545cff700 1 --2- 172.21.15.61:0/868468464 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7ff524063240 0x7ff5240656f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff5300090b0 tx=0x7ff53001c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:48.579 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.579+0000 7ff536ffd700 1 -- 172.21.15.61:0/868468464 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7ff53c04ef90 con 0x7ff5400695d0 2023-01-01T17:39:48.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.814+0000 7ff548764700 1 -- 172.21.15.61:0/868468464 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5400a9170 con 0x7ff5400695d0 2023-01-01T17:39:48.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.814+0000 7ff536ffd700 1 -- 172.21.15.61:0/868468464 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3521 (secure 0 0 0) 0x7ff53c021de0 con 0x7ff5400695d0 2023-01-01T17:39:48.816 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:48.816 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/671276443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":671276443},{"type":"v1","addr":"172.21.15.149:6835","nonce":671276443}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6836/1287782466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6834","nonce":1287782466},{"type":"v1","addr":"172.21.15.61:6836","nonce":1287782466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/594691675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":594691675},{"type":"v1","addr":"172.21.15.149:6833","nonce":594691675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6837/426398173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6835","nonce":426398173},{"type":"v1","addr":"172.21.15.61:6837","nonce":426398173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-01-01T17:39:48.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.816+0000 7ff548764700 1 -- 172.21.15.61:0/868468464 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7ff524063240 msgr2=0x7ff5240656f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:48.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.816+0000 7ff548764700 1 --2- 172.21.15.61:0/868468464 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7ff524063240 0x7ff5240656f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff5300090b0 tx=0x7ff53001c040 comp rx=0 tx=0).stop 2023-01-01T17:39:48.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.816+0000 7ff548764700 1 -- 172.21.15.61:0/868468464 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff5400695d0 msgr2=0x7ff5401e8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:48.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.816+0000 7ff548764700 1 --2- 172.21.15.61:0/868468464 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff5400695d0 0x7ff5401e8df0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff53c00e800 tx=0x7ff53c00eb10 comp rx=0 tx=0).stop 2023-01-01T17:39:48.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.816+0000 7ff548764700 1 -- 172.21.15.61:0/868468464 shutdown_connections 2023-01-01T17:39:48.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.816+0000 7ff548764700 1 --2- 172.21.15.61:0/868468464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff540154ce0 0x7ff5400be0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:48.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.816+0000 7ff548764700 1 --2- 172.21.15.61:0/868468464 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7ff524063240 0x7ff5240656f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:48.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.816+0000 7ff548764700 1 --2- 172.21.15.61:0/868468464 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff5400695d0 0x7ff5401e8df0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:48.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.816+0000 7ff548764700 1 --2- 172.21.15.61:0/868468464 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff5400699a0 0x7ff5401ec2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:48.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.816+0000 7ff548764700 1 -- 172.21.15.61:0/868468464 >> 172.21.15.61:0/868468464 conn(0x7ff54006b100 msgr2=0x7ff5400c1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:48.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.816+0000 7ff548764700 1 -- 172.21.15.61:0/868468464 shutdown_connections 2023-01-01T17:39:48.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.816+0000 7ff548764700 1 -- 172.21.15.61:0/868468464 wait complete. 2023-01-01T17:39:48.820 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 3 2023-01-01T17:39:48.833 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-01T17:39:48.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.956+0000 7f91b2a1f700 1 Processor -- start 2023-01-01T17:39:48.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.956+0000 7f91b2a1f700 1 -- start start 2023-01-01T17:39:48.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.957+0000 7f91b2a1f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f91ac0c1ad0 0x7f91ac152de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:48.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.957+0000 7f91b2a1f700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91ac06dc10 con 0x7f91ac06a640 2023-01-01T17:39:48.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.957+0000 7f91b2a1f700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91ac156ba0 con 0x7f91ac157030 2023-01-01T17:39:48.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.957+0000 7f91b2a1f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91ac071770 con 0x7f91ac0c1ad0 2023-01-01T17:39:48.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.957+0000 7f91abfff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f91ac06a640 0x7f91ac14ffa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39700/0 (socket says 172.21.15.61:39700) 2023-01-01T17:39:48.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.957+0000 7f91abfff700 1 -- 172.21.15.61:0/433714253 learned_addr learned my addr 172.21.15.61:0/433714253 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:39:48.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.957+0000 7f91ab7fe700 1 --2- 172.21.15.61:0/433714253 >> v2:172.21.15.149:3300/0 conn(0x7f91ac0c1ad0 0x7f91ac152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:48.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.957+0000 7f91aaffd700 1 -- 172.21.15.61:0/433714253 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 352458540 0 0) 0x7f91ac06dc10 con 0x7f91ac06a640 2023-01-01T17:39:48.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.957+0000 7f91aaffd700 1 -- 172.21.15.61:0/433714253 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91980035b0 con 0x7f91ac06a640 2023-01-01T17:39:48.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.957+0000 7f91aaffd700 1 -- 172.21.15.61:0/433714253 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3141760352 0 0) 0x7f91ac156ba0 con 0x7f91ac157030 2023-01-01T17:39:48.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.957+0000 7f91aaffd700 1 -- 172.21.15.61:0/433714253 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91ac06dc10 con 0x7f91ac157030 2023-01-01T17:39:48.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.957+0000 7f91aaffd700 1 -- 172.21.15.61:0/433714253 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2261498304 0 0) 0x7f91980035b0 con 0x7f91ac06a640 2023-01-01T17:39:48.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.957+0000 7f91aaffd700 1 -- 172.21.15.61:0/433714253 >> v2:172.21.15.149:3300/0 conn(0x7f91ac0c1ad0 msgr2=0x7f91ac152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:48.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.957+0000 7f91aaffd700 1 --2- 172.21.15.61:0/433714253 >> v2:172.21.15.149:3300/0 conn(0x7f91ac0c1ad0 0x7f91ac152de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:48.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.957+0000 7f91aaffd700 1 -- 172.21.15.61:0/433714253 >> v1:172.21.15.149:6789/0 conn(0x7f91ac157030 legacy=0x7f91ac15d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:48.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.957+0000 7f91aaffd700 1 -- 172.21.15.61:0/433714253 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ac06f7a0 con 0x7f91ac06a640 2023-01-01T17:39:48.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.957+0000 7f91aaffd700 1 -- 172.21.15.61:0/433714253 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586489653 0 0) 0x7f9194001670 con 0x7f91ac06a640 2023-01-01T17:39:48.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.957+0000 7f91aaffd700 1 -- 172.21.15.61:0/433714253 >> v1:172.21.15.61:6789/0 conn(0x7f91ac06a640 legacy=0x7f91ac14ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:48.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.957+0000 7f91aaffd700 1 --2- 172.21.15.61:0/433714253 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9198003be0 0x7f9198003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:48.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.957+0000 7f91aaffd700 1 --2- 172.21.15.61:0/433714253 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9198004850 0x7f9198004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:48.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.957+0000 7f91aaffd700 1 --2- 172.21.15.61:0/433714253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91980052c0 0x7f919800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:48.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.957+0000 7f91aaffd700 1 -- 172.21.15.61:0/433714253 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919800c1d0 con 0x7f9198004850 2023-01-01T17:39:48.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.957+0000 7f91aaffd700 1 -- 172.21.15.61:0/433714253 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919800c340 con 0x7f91980052c0 2023-01-01T17:39:48.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.957+0000 7f91aaffd700 1 -- 172.21.15.61:0/433714253 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f919800c500 con 0x7f9198003be0 2023-01-01T17:39:48.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.958+0000 7f91ab7fe700 1 --2- 172.21.15.61:0/433714253 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9198004850 0x7f9198004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:48.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.958+0000 7f91b0fbc700 1 --2- 172.21.15.61:0/433714253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91980052c0 0x7f919800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:48.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.958+0000 7f91abfff700 1 --2- 172.21.15.61:0/433714253 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9198003be0 0x7f9198003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:48.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.958+0000 7f91ab7fe700 1 -- 172.21.15.61:0/433714253 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9198003be0 msgr2=0x7f9198003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:48.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.958+0000 7f91ab7fe700 1 --2- 172.21.15.61:0/433714253 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9198003be0 0x7f9198003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:48.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.958+0000 7f91ab7fe700 1 -- 172.21.15.61:0/433714253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91980052c0 msgr2=0x7f919800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:48.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.958+0000 7f91ab7fe700 1 --2- 172.21.15.61:0/433714253 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91980052c0 0x7f919800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:48.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.958+0000 7f91ab7fe700 1 -- 172.21.15.61:0/433714253 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91980035b0 con 0x7f9198004850 2023-01-01T17:39:48.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.958+0000 7f91b0fbc700 1 -- 172.21.15.61:0/433714253 reap_dead start 2023-01-01T17:39:48.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.958+0000 7f91ab7fe700 1 --2- 172.21.15.61:0/433714253 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9198004850 0x7f9198004cc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f919c009b60 tx=0x7f9198005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a9ce4713a44b58 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:48.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.958+0000 7f91aaffd700 1 -- 172.21.15.61:0/433714253 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c00e6c0 con 0x7f9198004850 2023-01-01T17:39:48.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.958+0000 7f91aaffd700 1 -- 172.21.15.61:0/433714253 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919c00e820 con 0x7f9198004850 2023-01-01T17:39:48.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.958+0000 7f91aaffd700 1 -- 172.21.15.61:0/433714253 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c00eb90 con 0x7f9198004850 2023-01-01T17:39:48.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.959+0000 7f91b2a1f700 1 -- 172.21.15.61:0/433714253 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9198004850 msgr2=0x7f9198004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:48.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.959+0000 7f91b2a1f700 1 --2- 172.21.15.61:0/433714253 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9198004850 0x7f9198004cc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f919c009b60 tx=0x7f9198005880 comp rx=0 tx=0).stop 2023-01-01T17:39:48.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.959+0000 7f91b2a1f700 1 -- 172.21.15.61:0/433714253 shutdown_connections 2023-01-01T17:39:48.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.959+0000 7f91b2a1f700 1 --2- 172.21.15.61:0/433714253 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f9198004850 0x7f9198004cc0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:48.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.959+0000 7f91b2a1f700 1 -- 172.21.15.61:0/433714253 >> 172.21.15.61:0/433714253 conn(0x7f91ac0c1f30 msgr2=0x7f91ac0c2330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:48.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.959+0000 7f91b2a1f700 1 -- 172.21.15.61:0/433714253 shutdown_connections 2023-01-01T17:39:48.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.959+0000 7f91b2a1f700 1 -- 172.21.15.61:0/433714253 wait complete. 2023-01-01T17:39:48.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.960+0000 7f91b2a1f700 1 Processor -- start 2023-01-01T17:39:48.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.960+0000 7f91b2a1f700 1 -- start start 2023-01-01T17:39:48.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.961+0000 7f91b2a1f700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9198004850 0x7f91ac1539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:48.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.961+0000 7f91b2a1f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91ac0aac60 0x7f91ac1eb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:48.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.961+0000 7f91b2a1f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91ac06cd00 0x7f91ac1e87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:48.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.961+0000 7f91b2a1f700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac0ab340 con 0x7f91ac0aac60 2023-01-01T17:39:48.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.961+0000 7f91b2a1f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac151db0 con 0x7f91ac06cd00 2023-01-01T17:39:48.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.961+0000 7f91b2a1f700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac152090 con 0x7f9198004850 2023-01-01T17:39:48.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.961+0000 7f91ab7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91ac0aac60 0x7f91ac1eb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:48.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.961+0000 7f91ab7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91ac0aac60 0x7f91ac1eb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:45864/0 (socket says 172.21.15.61:45864) 2023-01-01T17:39:48.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.961+0000 7f91ab7fe700 1 -- 172.21.15.61:0/2411705390 learned_addr learned my addr 172.21.15.61:0/2411705390 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:48.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.961+0000 7f91b0fbc700 1 --2- 172.21.15.61:0/2411705390 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91ac06cd00 0x7f91ac1e87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:48.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.961+0000 7f91abfff700 1 --2- 172.21.15.61:0/2411705390 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9198004850 0x7f91ac1539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:48.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.961+0000 7f91ab7fe700 1 -- 172.21.15.61:0/2411705390 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9198004850 msgr2=0x7f91ac1539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:48.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.961+0000 7f91ab7fe700 1 --2- 172.21.15.61:0/2411705390 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9198004850 0x7f91ac1539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:48.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.961+0000 7f91ab7fe700 1 -- 172.21.15.61:0/2411705390 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91ac06cd00 msgr2=0x7f91ac1e87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:48.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.961+0000 7f91ab7fe700 1 --2- 172.21.15.61:0/2411705390 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91ac06cd00 0x7f91ac1e87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:48.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.961+0000 7f91ab7fe700 1 -- 172.21.15.61:0/2411705390 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ac06f4c0 con 0x7f91ac0aac60 2023-01-01T17:39:48.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.961+0000 7f91b0fbc700 1 --2- 172.21.15.61:0/2411705390 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91ac06cd00 0x7f91ac1e87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-01T17:39:48.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.961+0000 7f91ab7fe700 1 --2- 172.21.15.61:0/2411705390 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91ac0aac60 0x7f91ac1eb440 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f919800c310 tx=0x7f919c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:48.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.961+0000 7f91a8ff9700 1 -- 172.21.15.61:0/2411705390 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c00e6c0 con 0x7f91ac0aac60 2023-01-01T17:39:48.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.961+0000 7f91a8ff9700 1 -- 172.21.15.61:0/2411705390 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919c003ad0 con 0x7f91ac0aac60 2023-01-01T17:39:48.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.961+0000 7f91b2a1f700 1 -- 172.21.15.61:0/2411705390 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91ac06f1e0 con 0x7f91ac0aac60 2023-01-01T17:39:48.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.961+0000 7f91a8ff9700 1 -- 172.21.15.61:0/2411705390 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c003e80 con 0x7f91ac0aac60 2023-01-01T17:39:48.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.962+0000 7f91b2a1f700 1 -- 172.21.15.61:0/2411705390 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91ac156550 con 0x7f91ac0aac60 2023-01-01T17:39:48.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.962+0000 7f91b2a1f700 1 -- 172.21.15.61:0/2411705390 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91ac0668a0 con 0x7f91ac0aac60 2023-01-01T17:39:48.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.963+0000 7f91a8ff9700 1 -- 172.21.15.61:0/2411705390 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f919c019030 con 0x7f91ac0aac60 2023-01-01T17:39:48.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.963+0000 7f91a8ff9700 1 --2- 172.21.15.61:0/2411705390 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f918c063290 0x7f918c065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:48.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.963+0000 7f91abfff700 1 --2- 172.21.15.61:0/2411705390 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f918c063290 0x7f918c065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:48.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.963+0000 7f91a8ff9700 1 -- 172.21.15.61:0/2411705390 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f919c080d10 con 0x7f91ac0aac60 2023-01-01T17:39:48.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.964+0000 7f91abfff700 1 --2- 172.21.15.61:0/2411705390 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f918c063290 0x7f918c065740 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9194000c00 tx=0x7f9194009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:48.970 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:48.968+0000 7f91a8ff9700 1 -- 172.21.15.61:0/2411705390 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f919c050110 con 0x7f91ac0aac60 2023-01-01T17:39:49.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.161+0000 7f91b2a1f700 1 -- 172.21.15.61:0/2411705390 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91ac1e85f0 con 0x7f91ac0aac60 2023-01-01T17:39:49.162 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.162+0000 7f91a8ff9700 1 -- 172.21.15.61:0/2411705390 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+13670 (secure 0 0 0) 0x7f919c017090 con 0x7f91ac0aac60 2023-01-01T17:39:49.163 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:49.163 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":16,"fsid":"fe0d3d8e-46ee-4ed9-92f8-749741721d01","created":"2023-01-01T17:39:34.752404+0000","modified":"2023-01-01T17:39:48.292800+0000","last_up_change":"2023-01-01T17:39:45.159720+0000","last_in_change":"2023-01-01T17:39:37.293057+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-01-01T17:39:46.110776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-01-01T17:39:46.276625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"5ba13bcd-4407-4cfd-8487-80917501e525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":94349},{"type":"v1","addr":"172.21.15.61:6825","nonce":94349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":94349},{"type":"v1","addr":"172.21.15.61:6827","nonce":94349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":94349},{"type":"v1","addr":"172.21.15.61:6831","nonce":94349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":94349},{"type":"v1","addr":"172.21.15.61:6829","nonce":94349}]},"public_addr":"172.21.15.61:6825/94349","cluster_addr":"172.21.15.61:6827/94349","heartbeat_back_addr":"172.21.15.61:6831/94349","heartbeat_front_addr":"172.21.15.61:6829/94349","state":["exists","up"]},{"osd":1,"uuid":"7dca9f34-ea22-4894-b238-5606b16b9c74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6811","nonce":94348},{"type":"v1","addr":"172.21.15.61:6813","nonce":94348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":94348},{"type":"v1","addr":"172.21.15.61:6816","nonce":94348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6821","nonce":94348},{"type":"v1","addr":"172.21.15.61:6823","nonce":94348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":94348},{"type":"v1","addr":"172.21.15.61:6819","nonce":94348}]},"public_addr":"172.21.15.61:6813/94348","cluster_addr":"172.21.15.61:6816/94348","heartbeat_back_addr":"172.21.15.61:6823/94348","heartbeat_front_addr":"172.21.15.61:6819/94348","state":["exists","up"]},{"osd":2,"uuid":"7b43ea06-a7b6-49f4-a390-18ad14dfe4fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":94350},{"type":"v1","addr":"172.21.15.61:6809","nonce":94350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":94350},{"type":"v1","addr":"172.21.15.61:6812","nonce":94350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":94350},{"type":"v1","addr":"172.21.15.61:6822","nonce":94350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6815","nonce":94350},{"type":"v1","addr":"172.21.15.61:6817","nonce":94350}]},"public_addr":"172.21.15.61:6809/94350","cluster_addr":"172.21.15.61:6812/94350","heartbeat_back_addr":"172.21.15.61:6822/94350","heartbeat_front_addr":"172.21.15.61:6817/94350","state":["exists","up"]},{"osd":3,"uuid":"117c41d8-d40c-4cc0-b0e1-70bca058fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":94347},{"type":"v1","addr":"172.21.15.61:6801","nonce":94347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":94347},{"type":"v1","addr":"172.21.15.61:6803","nonce":94347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":94347},{"type":"v1","addr":"172.21.15.61:6807","nonce":94347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":94347},{"type":"v1","addr":"172.21.15.61:6805","nonce":94347}]},"public_addr":"172.21.15.61:6801/94347","cluster_addr":"172.21.15.61:6803/94347","heartbeat_back_addr":"172.21.15.61:6807/94347","heartbeat_front_addr":"172.21.15.61:6805/94347","state":["exists","up"]},{"osd":4,"uuid":"4073e0e8-c5dd-463f-aa1c-c9515ef09976","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":94711},{"type":"v1","addr":"172.21.15.149:6818","nonce":94711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":94711},{"type":"v1","addr":"172.21.15.149:6822","nonce":94711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":94711},{"type":"v1","addr":"172.21.15.149:6830","nonce":94711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":94711},{"type":"v1","addr":"172.21.15.149:6826","nonce":94711}]},"public_addr":"172.21.15.149:6818/94711","cluster_addr":"172.21.15.149:6822/94711","heartbeat_back_addr":"172.21.15.149:6830/94711","heartbeat_front_addr":"172.21.15.149:6826/94711","state":["exists","up"]},{"osd":5,"uuid":"88aa0c0f-e3c1-4dd3-af8c-61f4bc28504e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":94709},{"type":"v1","addr":"172.21.15.149:6809","nonce":94709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":94709},{"type":"v1","addr":"172.21.15.149:6811","nonce":94709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":94709},{"type":"v1","addr":"172.21.15.149:6815","nonce":94709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":94709},{"type":"v1","addr":"172.21.15.149:6813","nonce":94709}]},"public_addr":"172.21.15.149:6809/94709","cluster_addr":"172.21.15.149:6811/94709","heartbeat_back_addr":"172.21.15.149:6815/94709","heartbeat_front_addr":"172.21.15.149:6813/94709","state":["exists","up"]},{"osd":6,"uuid":"8b13fc0c-5f00-41c7-8923-c4570da77afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":94710},{"type":"v1","addr":"172.21.15.149:6801","nonce":94710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":94710},{"type":"v1","addr":"172.21.15.149:6803","nonce":94710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":94710},{"type":"v1","addr":"172.21.15.149:6807","nonce":94710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":94710},{"type":"v1","addr":"172.21.15.149:6805","nonce":94710}]},"public_addr":"172.21.15.149:6801/94710","cluster_addr":"172.21.15.149:6803/94710","heartbeat_back_addr":"172.21.15.149:6807/94710","heartbeat_front_addr":"172.21.15.149:6805/94710","state":["exists","up"]},{"osd":7,"uuid":"5390c6e5-39e7-4aa6-b73c-642458b2acf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":94734},{"type":"v1","addr":"172.21.15.149:6819","nonce":94734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":94734},{"type":"v1","addr":"172.21.15.149:6823","nonce":94734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":94734},{"type":"v1","addr":"172.21.15.149:6831","nonce":94734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":94734},{"type":"v1","addr":"172.21.15.149:6827","nonce":94734}]},"public_addr":"172.21.15.149:6819/94734","cluster_addr":"172.21.15.149:6823/94734","heartbeat_back_addr":"172.21.15.149:6831/94734","heartbeat_front_addr":"172.21.15.149:6827/94734","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.555826+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.508739+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.515601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.472067+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.535257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.493397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.554910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.552343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-01T17:39:49.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.164+0000 7f91b2a1f700 1 -- 172.21.15.61:0/2411705390 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f918c063290 msgr2=0x7f918c065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:49.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.164+0000 7f91b2a1f700 1 --2- 172.21.15.61:0/2411705390 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f918c063290 0x7f918c065740 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9194000c00 tx=0x7f9194009040 comp rx=0 tx=0).stop 2023-01-01T17:39:49.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.164+0000 7f91b2a1f700 1 -- 172.21.15.61:0/2411705390 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91ac0aac60 msgr2=0x7f91ac1eb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:49.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.164+0000 7f91b2a1f700 1 --2- 172.21.15.61:0/2411705390 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91ac0aac60 0x7f91ac1eb440 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f919800c310 tx=0x7f919c0047c0 comp rx=0 tx=0).stop 2023-01-01T17:39:49.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.164+0000 7f91b2a1f700 1 -- 172.21.15.61:0/2411705390 shutdown_connections 2023-01-01T17:39:49.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.164+0000 7f91b2a1f700 1 --2- 172.21.15.61:0/2411705390 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91ac06cd00 0x7f91ac1e87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:49.165 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.164+0000 7f91b2a1f700 1 --2- 172.21.15.61:0/2411705390 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f9198004850 0x7f91ac1539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:49.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.164+0000 7f91b2a1f700 1 --2- 172.21.15.61:0/2411705390 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f918c063290 0x7f918c065740 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:49.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.164+0000 7f91b2a1f700 1 --2- 172.21.15.61:0/2411705390 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91ac0aac60 0x7f91ac1eb440 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:49.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.164+0000 7f91b2a1f700 1 -- 172.21.15.61:0/2411705390 >> 172.21.15.61:0/2411705390 conn(0x7f91ac0c1f30 msgr2=0x7f91ac150010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:49.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.164+0000 7f91b2a1f700 1 -- 172.21.15.61:0/2411705390 shutdown_connections 2023-01-01T17:39:49.166 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.164+0000 7f91b2a1f700 1 -- 172.21.15.61:0/2411705390 wait complete. 2023-01-01T17:39:49.177 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-01-01T17:39:46.110776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-01-01T17:39:46.276625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-01-01T17:39:49.178 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-01-01T17:39:49.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.303+0000 7f1550f91700 1 Processor -- start 2023-01-01T17:39:49.316 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.303+0000 7f1550f91700 1 -- start start 2023-01-01T17:39:49.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.304+0000 7f1550f91700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f154c06cff0 0x7f154c069360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:49.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.304+0000 7f1550f91700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f154c0698a0 0x7f154c152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:49.320 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.304+0000 7f1550f91700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f154c06aaa0 con 0x7f154c14cf50 2023-01-01T17:39:49.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.304+0000 7f1550f91700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f154c0c0930 con 0x7f154c0698a0 2023-01-01T17:39:49.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.304+0000 7f1550f91700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f154c069e90 con 0x7f154c06cff0 2023-01-01T17:39:49.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.304+0000 7f154ad9d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f154c0698a0 0x7f154c152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:49.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.304+0000 7f1549d9b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f154c06cff0 0x7f154c069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:49.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.304+0000 7f154ad9d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f154c0698a0 0x7f154c152ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:45874/0 (socket says 172.21.15.61:45874) 2023-01-01T17:39:49.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.304+0000 7f1549d9b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f154c06cff0 0x7f154c069360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.61:41708/0 (socket says 172.21.15.61:41708) 2023-01-01T17:39:49.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.304+0000 7f154ad9d700 1 -- 172.21.15.61:0/3630146099 learned_addr learned my addr 172.21.15.61:0/3630146099 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:49.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.304+0000 7f154a59c700 1 --1- 172.21.15.61:0/3630146099 >> v1:172.21.15.149:6789/0 conn(0x7f154c14cf50 0x7f154c0c0220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.61:48194/0 (socket says 172.21.15.61:48194) 2023-01-01T17:39:49.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.305+0000 7f154ad9d700 1 -- 172.21.15.61:0/3630146099 >> v2:172.21.15.149:3300/0 conn(0x7f154c06cff0 msgr2=0x7f154c069360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:49.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.305+0000 7f154ad9d700 1 --2- 172.21.15.61:0/3630146099 >> v2:172.21.15.149:3300/0 conn(0x7f154c06cff0 0x7f154c069360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:49.321 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.305+0000 7f154ad9d700 1 -- 172.21.15.61:0/3630146099 >> v1:172.21.15.149:6789/0 conn(0x7f154c14cf50 legacy=0x7f154c0c0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:49.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.305+0000 7f154ad9d700 1 -- 172.21.15.61:0/3630146099 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f154c06a170 con 0x7f154c0698a0 2023-01-01T17:39:49.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.305+0000 7f154ad9d700 1 --2- 172.21.15.61:0/3630146099 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f154c0698a0 0x7f154c152ec0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f154c073740 tx=0x7f154400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc49e4aa7d62cb3c server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:49.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.306+0000 7f154959a700 1 -- 172.21.15.61:0/3630146099 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154400e070 con 0x7f154c0698a0 2023-01-01T17:39:49.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.306+0000 7f154959a700 1 -- 172.21.15.61:0/3630146099 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f154400b910 con 0x7f154c0698a0 2023-01-01T17:39:49.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.306+0000 7f154959a700 1 -- 172.21.15.61:0/3630146099 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154400bcc0 con 0x7f154c0698a0 2023-01-01T17:39:49.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.307+0000 7f1550f91700 1 -- 172.21.15.61:0/3630146099 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f154c0698a0 msgr2=0x7f154c152ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:49.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.307+0000 7f1550f91700 1 --2- 172.21.15.61:0/3630146099 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f154c0698a0 0x7f154c152ec0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f154c073740 tx=0x7f154400b330 comp rx=0 tx=0).stop 2023-01-01T17:39:49.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.307+0000 7f1550f91700 1 -- 172.21.15.61:0/3630146099 shutdown_connections 2023-01-01T17:39:49.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.307+0000 7f1550f91700 1 --2- 172.21.15.61:0/3630146099 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f154c0698a0 0x7f154c152ec0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:49.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.307+0000 7f1550f91700 1 --2- 172.21.15.61:0/3630146099 >> v2:172.21.15.149:3300/0 conn(0x7f154c06cff0 0x7f154c069360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:49.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.307+0000 7f1550f91700 1 -- 172.21.15.61:0/3630146099 >> 172.21.15.61:0/3630146099 conn(0x7f154c0c1e80 msgr2=0x7f154c0c2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:49.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.307+0000 7f1550f91700 1 -- 172.21.15.61:0/3630146099 shutdown_connections 2023-01-01T17:39:49.322 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.307+0000 7f1550f91700 1 -- 172.21.15.61:0/3630146099 wait complete. 2023-01-01T17:39:49.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.308+0000 7f1550f91700 1 Processor -- start 2023-01-01T17:39:49.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.308+0000 7f1550f91700 1 -- start start 2023-01-01T17:39:49.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.309+0000 7f1550f91700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f154c0698a0 0x7f154c1ebb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:49.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.309+0000 7f1550f91700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f154c06cff0 0x7f154c1429d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:49.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.309+0000 7f1550f91700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f154c14cf50 0x7f154c142f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:49.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.309+0000 7f1550f91700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154c143450 con 0x7f154c14cf50 2023-01-01T17:39:49.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.309+0000 7f1550f91700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154c14da30 con 0x7f154c0698a0 2023-01-01T17:39:49.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.309+0000 7f1550f91700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f154c1ec630 con 0x7f154c06cff0 2023-01-01T17:39:49.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.309+0000 7f154ad9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f154c14cf50 0x7f154c142f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:49.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.309+0000 7f154ad9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f154c14cf50 0x7f154c142f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:45880/0 (socket says 172.21.15.61:45880) 2023-01-01T17:39:49.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.309+0000 7f154ad9d700 1 -- 172.21.15.61:0/2515698674 learned_addr learned my addr 172.21.15.61:0/2515698674 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:49.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.309+0000 7f154a59c700 1 --2- 172.21.15.61:0/2515698674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f154c0698a0 0x7f154c1ebb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:49.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.309+0000 7f1549d9b700 1 --2- 172.21.15.61:0/2515698674 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f154c06cff0 0x7f154c1429d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:49.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.309+0000 7f154ad9d700 1 -- 172.21.15.61:0/2515698674 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f154c06cff0 msgr2=0x7f154c1429d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:49.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.309+0000 7f154ad9d700 1 --2- 172.21.15.61:0/2515698674 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f154c06cff0 0x7f154c1429d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:49.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.309+0000 7f154ad9d700 1 -- 172.21.15.61:0/2515698674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f154c0698a0 msgr2=0x7f154c1ebb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:49.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.309+0000 7f154ad9d700 1 --2- 172.21.15.61:0/2515698674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f154c0698a0 0x7f154c1ebb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:49.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.309+0000 7f154ad9d700 1 -- 172.21.15.61:0/2515698674 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1544009b30 con 0x7f154c14cf50 2023-01-01T17:39:49.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.310+0000 7f154ad9d700 1 --2- 172.21.15.61:0/2515698674 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f154c14cf50 0x7f154c142f10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f154400b370 tx=0x7f1544004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:49.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.310+0000 7f153affd700 1 -- 172.21.15.61:0/2515698674 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1544004900 con 0x7f154c14cf50 2023-01-01T17:39:49.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.310+0000 7f153affd700 1 -- 172.21.15.61:0/2515698674 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15440099b0 con 0x7f154c14cf50 2023-01-01T17:39:49.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.310+0000 7f1550f91700 1 -- 172.21.15.61:0/2515698674 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f154c06a730 con 0x7f154c14cf50 2023-01-01T17:39:49.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.310+0000 7f153affd700 1 -- 172.21.15.61:0/2515698674 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154401c680 con 0x7f154c14cf50 2023-01-01T17:39:49.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.310+0000 7f1550f91700 1 -- 172.21.15.61:0/2515698674 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f154c06a450 con 0x7f154c14cf50 2023-01-01T17:39:49.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.311+0000 7f1550f91700 1 -- 172.21.15.61:0/2515698674 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f154c153400 con 0x7f154c14cf50 2023-01-01T17:39:49.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.311+0000 7f153affd700 1 -- 172.21.15.61:0/2515698674 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f154402c070 con 0x7f154c14cf50 2023-01-01T17:39:49.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.312+0000 7f153affd700 1 --2- 172.21.15.61:0/2515698674 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f152c063290 0x7f152c065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:49.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.312+0000 7f153affd700 1 -- 172.21.15.61:0/2515698674 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f15440811d0 con 0x7f154c14cf50 2023-01-01T17:39:49.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.312+0000 7f154a59c700 1 --2- 172.21.15.61:0/2515698674 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f152c063290 0x7f152c065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:49.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.312+0000 7f154a59c700 1 --2- 172.21.15.61:0/2515698674 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f152c063290 0x7f152c065740 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f153c000f60 tx=0x7f153c007f10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:49.325 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.316+0000 7f153affd700 1 -- 172.21.15.61:0/2515698674 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f1544050550 con 0x7f154c14cf50 2023-01-01T17:39:49.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.506+0000 7f1550f91700 1 -- 172.21.15.61:0/2515698674 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f154c0668a0 con 0x7f154c14cf50 2023-01-01T17:39:49.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.506+0000 7f153affd700 1 -- 172.21.15.61:0/2515698674 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1544053b70 con 0x7f154c14cf50 2023-01-01T17:39:49.507 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 8 2023-01-01T17:39:49.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.508+0000 7f1550f91700 1 -- 172.21.15.61:0/2515698674 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f152c063290 msgr2=0x7f152c065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:49.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.508+0000 7f1550f91700 1 --2- 172.21.15.61:0/2515698674 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f152c063290 0x7f152c065740 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f153c000f60 tx=0x7f153c007f10 comp rx=0 tx=0).stop 2023-01-01T17:39:49.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.508+0000 7f1550f91700 1 -- 172.21.15.61:0/2515698674 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f154c14cf50 msgr2=0x7f154c142f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:49.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.508+0000 7f1550f91700 1 --2- 172.21.15.61:0/2515698674 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f154c14cf50 0x7f154c142f10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f154400b370 tx=0x7f1544004ad0 comp rx=0 tx=0).stop 2023-01-01T17:39:49.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.508+0000 7f1550f91700 1 -- 172.21.15.61:0/2515698674 shutdown_connections 2023-01-01T17:39:49.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.508+0000 7f1550f91700 1 --2- 172.21.15.61:0/2515698674 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f152c063290 0x7f152c065740 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:49.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.508+0000 7f1550f91700 1 --2- 172.21.15.61:0/2515698674 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f154c14cf50 0x7f154c142f10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:49.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.508+0000 7f1550f91700 1 --2- 172.21.15.61:0/2515698674 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f154c0698a0 0x7f154c1ebb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:49.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.508+0000 7f1550f91700 1 --2- 172.21.15.61:0/2515698674 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f154c06cff0 0x7f154c1429d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:49.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.508+0000 7f1550f91700 1 -- 172.21.15.61:0/2515698674 >> 172.21.15.61:0/2515698674 conn(0x7f154c0c1e80 msgr2=0x7f154c06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:49.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.509+0000 7f1550f91700 1 -- 172.21.15.61:0/2515698674 shutdown_connections 2023-01-01T17:39:49.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.509+0000 7f1550f91700 1 -- 172.21.15.61:0/2515698674 wait complete. 2023-01-01T17:39:49.521 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-01-01T17:39:49.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.648+0000 7f336d6ce700 1 Processor -- start 2023-01-01T17:39:49.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.648+0000 7f336d6ce700 1 -- start start 2023-01-01T17:39:49.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.648+0000 7f336d6ce700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3368150330 0x7f33680c5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:49.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.648+0000 7f336d6ce700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3368069890 0x7f33680c7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:49.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.648+0000 7f336d6ce700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3368153890 con 0x7f33680c5d90 2023-01-01T17:39:49.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.648+0000 7f336d6ce700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f336806b860 con 0x7f3368150330 2023-01-01T17:39:49.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.648+0000 7f336d6ce700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f336806a5b0 con 0x7f3368069890 2023-01-01T17:39:49.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.648+0000 7f33677fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f33680c5d90 0x7f33680c7660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39738/0 (socket says 172.21.15.61:39738) 2023-01-01T17:39:49.651 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.649+0000 7f33677fe700 1 -- 172.21.15.61:0/4112969945 learned_addr learned my addr 172.21.15.61:0/4112969945 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:39:49.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.649+0000 7f33667fc700 1 --2- 172.21.15.61:0/4112969945 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3368069890 0x7f33680c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:49.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.649+0000 7f3366ffd700 1 --2- 172.21.15.61:0/4112969945 >> v2:172.21.15.149:3300/0 conn(0x7f3368150330 0x7f33680c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:49.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.649+0000 7f3365ffb700 1 -- 172.21.15.61:0/4112969945 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3428646210 0 0) 0x7f3368153890 con 0x7f33680c5d90 2023-01-01T17:39:49.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.649+0000 7f3365ffb700 1 -- 172.21.15.61:0/4112969945 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33500035b0 con 0x7f33680c5d90 2023-01-01T17:39:49.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.649+0000 7f3365ffb700 1 -- 172.21.15.61:0/4112969945 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2938831677 0 0) 0x7f33500035b0 con 0x7f33680c5d90 2023-01-01T17:39:49.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.649+0000 7f3366ffd700 1 -- 172.21.15.61:0/4112969945 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3368069890 msgr2=0x7f33680c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:49.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.649+0000 7f3366ffd700 1 --2- 172.21.15.61:0/4112969945 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3368069890 0x7f33680c7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:49.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.649+0000 7f3366ffd700 1 -- 172.21.15.61:0/4112969945 >> v1:172.21.15.61:6789/0 conn(0x7f33680c5d90 legacy=0x7f33680c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:49.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.649+0000 7f3366ffd700 1 -- 172.21.15.61:0/4112969945 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3368153dc0 con 0x7f3368150330 2023-01-01T17:39:49.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.649+0000 7f33667fc700 1 --2- 172.21.15.61:0/4112969945 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3368069890 0x7f33680c7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-01-01T17:39:49.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.649+0000 7f3366ffd700 1 --2- 172.21.15.61:0/4112969945 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3368150330 0x7f33680c5850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3358009840 tx=0x7f3358009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32a585abd7405ef8 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:49.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.649+0000 7f3365ffb700 1 -- 172.21.15.61:0/4112969945 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33600019f0 con 0x7f3368150330 2023-01-01T17:39:49.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.649+0000 7f3365ffb700 1 -- 172.21.15.61:0/4112969945 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3358004030 con 0x7f3368150330 2023-01-01T17:39:49.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.649+0000 7f3365ffb700 1 -- 172.21.15.61:0/4112969945 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33580043c0 con 0x7f3368150330 2023-01-01T17:39:49.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.650+0000 7f336d6ce700 1 -- 172.21.15.61:0/4112969945 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3368150330 msgr2=0x7f33680c5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:49.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.650+0000 7f336d6ce700 1 --2- 172.21.15.61:0/4112969945 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3368150330 0x7f33680c5850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3358009840 tx=0x7f3358009b50 comp rx=0 tx=0).stop 2023-01-01T17:39:49.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.650+0000 7f336d6ce700 1 -- 172.21.15.61:0/4112969945 shutdown_connections 2023-01-01T17:39:49.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.650+0000 7f336d6ce700 1 --2- 172.21.15.61:0/4112969945 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3368150330 0x7f33680c5850 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:49.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.650+0000 7f336d6ce700 1 --2- 172.21.15.61:0/4112969945 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3368069890 0x7f33680c7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:49.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.650+0000 7f336d6ce700 1 -- 172.21.15.61:0/4112969945 >> 172.21.15.61:0/4112969945 conn(0x7f33680c8e40 msgr2=0x7f33680c9240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:49.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.650+0000 7f336d6ce700 1 -- 172.21.15.61:0/4112969945 shutdown_connections 2023-01-01T17:39:49.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.650+0000 7f336d6ce700 1 -- 172.21.15.61:0/4112969945 wait complete. 2023-01-01T17:39:49.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.652+0000 7f336d6ce700 1 Processor -- start 2023-01-01T17:39:49.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.652+0000 7f336d6ce700 1 -- start start 2023-01-01T17:39:49.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.653+0000 7f336d6ce700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3368069890 0x7f33680c0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:49.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.653+0000 7f336d6ce700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f33680c5d90 0x7f33680c1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:49.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.653+0000 7f336d6ce700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3368150330 0x7f33680ad960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:49.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.653+0000 7f336d6ce700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33680abfe0 con 0x7f33680c5d90 2023-01-01T17:39:49.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.653+0000 7f336d6ce700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33680c1450 con 0x7f3368069890 2023-01-01T17:39:49.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.653+0000 7f336d6ce700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33680c1dc0 con 0x7f3368150330 2023-01-01T17:39:49.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.653+0000 7f33667fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f33680c5d90 0x7f33680c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:49.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.653+0000 7f33667fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f33680c5d90 0x7f33680c1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:45892/0 (socket says 172.21.15.61:45892) 2023-01-01T17:39:49.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.653+0000 7f33667fc700 1 -- 172.21.15.61:0/2487976947 learned_addr learned my addr 172.21.15.61:0/2487976947 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:49.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.653+0000 7f3366ffd700 1 --2- 172.21.15.61:0/2487976947 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3368069890 0x7f33680c0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:49.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.653+0000 7f33677fe700 1 --2- 172.21.15.61:0/2487976947 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3368150330 0x7f33680ad960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:49.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.653+0000 7f33667fc700 1 -- 172.21.15.61:0/2487976947 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3368150330 msgr2=0x7f33680ad960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:49.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.653+0000 7f33667fc700 1 --2- 172.21.15.61:0/2487976947 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3368150330 0x7f33680ad960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:49.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.653+0000 7f33667fc700 1 -- 172.21.15.61:0/2487976947 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3368069890 msgr2=0x7f33680c0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:49.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.653+0000 7f33667fc700 1 --2- 172.21.15.61:0/2487976947 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3368069890 0x7f33680c0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:49.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.653+0000 7f33667fc700 1 -- 172.21.15.61:0/2487976947 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335c0094a0 con 0x7f33680c5d90 2023-01-01T17:39:49.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.653+0000 7f33667fc700 1 --2- 172.21.15.61:0/2487976947 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f33680c5d90 0x7f33680c1880 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f335c00ebe0 tx=0x7f335c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:49.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.653+0000 7f334f7fe700 1 -- 172.21.15.61:0/2487976947 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c00c850 con 0x7f33680c5d90 2023-01-01T17:39:49.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.653+0000 7f334f7fe700 1 -- 172.21.15.61:0/2487976947 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335c00c9b0 con 0x7f33680c5d90 2023-01-01T17:39:49.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.653+0000 7f336d6ce700 1 -- 172.21.15.61:0/2487976947 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33580094a0 con 0x7f33680c5d90 2023-01-01T17:39:49.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.653+0000 7f334f7fe700 1 -- 172.21.15.61:0/2487976947 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c00cd40 con 0x7f33680c5d90 2023-01-01T17:39:49.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.653+0000 7f336d6ce700 1 -- 172.21.15.61:0/2487976947 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3368153ae0 con 0x7f33680c5d90 2023-01-01T17:39:49.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.654+0000 7f336d6ce700 1 -- 172.21.15.61:0/2487976947 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33680bc710 con 0x7f33680c5d90 2023-01-01T17:39:49.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.655+0000 7f334f7fe700 1 -- 172.21.15.61:0/2487976947 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f335c019030 con 0x7f33680c5d90 2023-01-01T17:39:49.660 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.655+0000 7f334f7fe700 1 --2- 172.21.15.61:0/2487976947 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3354063290 0x7f3354065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:49.660 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.655+0000 7f334f7fe700 1 -- 172.21.15.61:0/2487976947 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f335c07f620 con 0x7f33680c5d90 2023-01-01T17:39:49.660 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.655+0000 7f3366ffd700 1 --2- 172.21.15.61:0/2487976947 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3354063290 0x7f3354065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:49.660 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.655+0000 7f3366ffd700 1 --2- 172.21.15.61:0/2487976947 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3354063290 0x7f3354065740 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f33580090b0 tx=0x7f3358008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:49.660 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.659+0000 7f334f7fe700 1 -- 172.21.15.61:0/2487976947 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f335c04ea20 con 0x7f33680c5d90 2023-01-01T17:39:49.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.848+0000 7f336d6ce700 1 -- 172.21.15.61:0/2487976947 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f33680aee50 con 0x7f33680c5d90 2023-01-01T17:39:49.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.848+0000 7f334f7fe700 1 -- 172.21.15.61:0/2487976947 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f335c00cea0 con 0x7f33680c5d90 2023-01-01T17:39:49.849 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 1 2023-01-01T17:39:49.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.850+0000 7f336d6ce700 1 -- 172.21.15.61:0/2487976947 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3354063290 msgr2=0x7f3354065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:49.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.850+0000 7f336d6ce700 1 --2- 172.21.15.61:0/2487976947 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3354063290 0x7f3354065740 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f33580090b0 tx=0x7f3358008030 comp rx=0 tx=0).stop 2023-01-01T17:39:49.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.850+0000 7f336d6ce700 1 -- 172.21.15.61:0/2487976947 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f33680c5d90 msgr2=0x7f33680c1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:49.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.850+0000 7f336d6ce700 1 --2- 172.21.15.61:0/2487976947 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f33680c5d90 0x7f33680c1880 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f335c00ebe0 tx=0x7f335c00eef0 comp rx=0 tx=0).stop 2023-01-01T17:39:49.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.850+0000 7f336d6ce700 1 -- 172.21.15.61:0/2487976947 shutdown_connections 2023-01-01T17:39:49.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.850+0000 7f336d6ce700 1 --2- 172.21.15.61:0/2487976947 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3368150330 0x7f33680ad960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:49.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.850+0000 7f336d6ce700 1 --2- 172.21.15.61:0/2487976947 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3368069890 0x7f33680c0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:49.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.850+0000 7f336d6ce700 1 --2- 172.21.15.61:0/2487976947 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3354063290 0x7f3354065740 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:49.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.850+0000 7f336d6ce700 1 --2- 172.21.15.61:0/2487976947 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f33680c5d90 0x7f33680c1880 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:49.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.850+0000 7f336d6ce700 1 -- 172.21.15.61:0/2487976947 >> 172.21.15.61:0/2487976947 conn(0x7f33680c8e40 msgr2=0x7f33680aa910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:49.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.850+0000 7f336d6ce700 1 -- 172.21.15.61:0/2487976947 shutdown_connections 2023-01-01T17:39:49.852 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.850+0000 7f336d6ce700 1 -- 172.21.15.61:0/2487976947 wait complete. 2023-01-01T17:39:49.862 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-01-01T17:39:49.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.987+0000 7f2d39680700 1 Processor -- start 2023-01-01T17:39:49.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.987+0000 7f2d39680700 1 -- start start 2023-01-01T17:39:49.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.988+0000 7f2d39680700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f2d3406a640 0x7f2d3414ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:49.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.988+0000 7f2d39680700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d3406dc10 con 0x7f2d34157030 2023-01-01T17:39:49.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.988+0000 7f2d39680700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d34156ba0 con 0x7f2d340c1ad0 2023-01-01T17:39:49.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.988+0000 7f2d39680700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d34071770 con 0x7f2d3406a640 2023-01-01T17:39:49.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.988+0000 7f2d32ffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f2d3406a640 0x7f2d3414ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:49.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.988+0000 7f2d32ffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f2d3406a640 0x7f2d3414ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:45898/0 (socket says 172.21.15.61:45898) 2023-01-01T17:39:49.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.988+0000 7f2d32ffd700 1 -- 172.21.15.61:0/831441885 learned_addr learned my addr 172.21.15.61:0/831441885 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:49.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.988+0000 7f2d337fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f2d34157030 0x7f2d3415d760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39752/0 (socket says 172.21.15.61:39752) 2023-01-01T17:39:49.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.988+0000 7f2d32ffd700 1 -- 172.21.15.61:0/831441885 >> v1:172.21.15.149:6789/0 conn(0x7f2d340c1ad0 legacy=0x7f2d34152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:49.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.988+0000 7f2d32ffd700 1 -- 172.21.15.61:0/831441885 >> v1:172.21.15.61:6789/0 conn(0x7f2d34157030 legacy=0x7f2d3415d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:49.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.988+0000 7f2d32ffd700 1 -- 172.21.15.61:0/831441885 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3406f7a0 con 0x7f2d3406a640 2023-01-01T17:39:49.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.988+0000 7f2d32ffd700 1 --2- 172.21.15.61:0/831441885 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d3406a640 0x7f2d3414ffa0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2d280098f0 tx=0x7f2d28009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74c7dba8872e783d server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:49.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.988+0000 7f2d31ffb700 1 -- 172.21.15.61:0/831441885 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d28004230 con 0x7f2d3406a640 2023-01-01T17:39:49.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.989+0000 7f2d31ffb700 1 -- 172.21.15.61:0/831441885 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d28004390 con 0x7f2d3406a640 2023-01-01T17:39:49.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.989+0000 7f2d31ffb700 1 -- 172.21.15.61:0/831441885 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d280036a0 con 0x7f2d3406a640 2023-01-01T17:39:49.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.989+0000 7f2d39680700 1 -- 172.21.15.61:0/831441885 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d3406a640 msgr2=0x7f2d3414ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:49.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.989+0000 7f2d39680700 1 --2- 172.21.15.61:0/831441885 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d3406a640 0x7f2d3414ffa0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2d280098f0 tx=0x7f2d28009c00 comp rx=0 tx=0).stop 2023-01-01T17:39:49.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.989+0000 7f2d39680700 1 -- 172.21.15.61:0/831441885 shutdown_connections 2023-01-01T17:39:49.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.989+0000 7f2d39680700 1 --2- 172.21.15.61:0/831441885 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d3406a640 0x7f2d3414ffa0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:49.993 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.989+0000 7f2d39680700 1 -- 172.21.15.61:0/831441885 >> 172.21.15.61:0/831441885 conn(0x7f2d340c1f30 msgr2=0x7f2d340c2330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:49.993 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.989+0000 7f2d39680700 1 -- 172.21.15.61:0/831441885 shutdown_connections 2023-01-01T17:39:49.993 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.989+0000 7f2d39680700 1 -- 172.21.15.61:0/831441885 wait complete. 2023-01-01T17:39:49.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.990+0000 7f2d39680700 1 Processor -- start 2023-01-01T17:39:49.997 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.990+0000 7f2d39680700 1 -- start start 2023-01-01T17:39:49.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.991+0000 7f2d39680700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d3406a640 0x7f2d341498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:49.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.991+0000 7f2d39680700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d340c1ad0 0x7f2d340a92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:49.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.991+0000 7f2d39680700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d34157030 0x7f2d3414b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:49.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.991+0000 7f2d39680700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d340ab380 con 0x7f2d340c1ad0 2023-01-01T17:39:49.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.991+0000 7f2d39680700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d340aa650 con 0x7f2d3406a640 2023-01-01T17:39:49.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.991+0000 7f2d39680700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d34149e30 con 0x7f2d34157030 2023-01-01T17:39:49.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.991+0000 7f2d327fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d340c1ad0 0x7f2d340a92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:49.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.991+0000 7f2d327fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d340c1ad0 0x7f2d340a92b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:45906/0 (socket says 172.21.15.61:45906) 2023-01-01T17:39:49.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.991+0000 7f2d327fc700 1 -- 172.21.15.61:0/3610940456 learned_addr learned my addr 172.21.15.61:0/3610940456 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:49.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.991+0000 7f2d32ffd700 1 --2- 172.21.15.61:0/3610940456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d3406a640 0x7f2d341498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:49.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.991+0000 7f2d337fe700 1 --2- 172.21.15.61:0/3610940456 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d34157030 0x7f2d3414b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:49.998 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.991+0000 7f2d327fc700 1 -- 172.21.15.61:0/3610940456 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d34157030 msgr2=0x7f2d3414b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:49.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.991+0000 7f2d327fc700 1 --2- 172.21.15.61:0/3610940456 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d34157030 0x7f2d3414b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:49.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.991+0000 7f2d327fc700 1 -- 172.21.15.61:0/3610940456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d3406a640 msgr2=0x7f2d341498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:49.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.991+0000 7f2d327fc700 1 --2- 172.21.15.61:0/3610940456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d3406a640 0x7f2d341498f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:49.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.992+0000 7f2d327fc700 1 -- 172.21.15.61:0/3610940456 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d28009550 con 0x7f2d340c1ad0 2023-01-01T17:39:49.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.992+0000 7f2d327fc700 1 --2- 172.21.15.61:0/3610940456 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d340c1ad0 0x7f2d340a92b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2d2400c500 tx=0x7f2d2400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:49.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.992+0000 7f2d1b7fe700 1 -- 172.21.15.61:0/3610940456 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d24011790 con 0x7f2d340c1ad0 2023-01-01T17:39:49.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.992+0000 7f2d1b7fe700 1 -- 172.21.15.61:0/3610940456 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d240118f0 con 0x7f2d340c1ad0 2023-01-01T17:39:49.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.992+0000 7f2d39680700 1 -- 172.21.15.61:0/3610940456 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d3406f4c0 con 0x7f2d340c1ad0 2023-01-01T17:39:49.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.992+0000 7f2d1b7fe700 1 -- 172.21.15.61:0/3610940456 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d24011ca0 con 0x7f2d340c1ad0 2023-01-01T17:39:49.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.992+0000 7f2d39680700 1 -- 172.21.15.61:0/3610940456 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d3406f1e0 con 0x7f2d340c1ad0 2023-01-01T17:39:49.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.993+0000 7f2d39680700 1 -- 172.21.15.61:0/3610940456 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d340a8550 con 0x7f2d340c1ad0 2023-01-01T17:39:49.999 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.993+0000 7f2d1b7fe700 1 -- 172.21.15.61:0/3610940456 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f2d24010050 con 0x7f2d340c1ad0 2023-01-01T17:39:50.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.993+0000 7f2d1b7fe700 1 --2- 172.21.15.61:0/3610940456 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f2d20063290 0x7f2d20065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:50.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.994+0000 7f2d1b7fe700 1 -- 172.21.15.61:0/3610940456 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2d2407f2d0 con 0x7f2d340c1ad0 2023-01-01T17:39:50.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.994+0000 7f2d32ffd700 1 --2- 172.21.15.61:0/3610940456 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f2d20063290 0x7f2d20065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:50.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.994+0000 7f2d32ffd700 1 --2- 172.21.15.61:0/3610940456 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f2d20063290 0x7f2d20065740 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2d28009840 tx=0x7f2d28008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:50.000 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:49.998+0000 7f2d1b7fe700 1 -- 172.21.15.61:0/3610940456 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f2d2404e6d0 con 0x7f2d340c1ad0 2023-01-01T17:39:50.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.190+0000 7f2d39680700 1 -- 172.21.15.61:0/3610940456 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2d34156550 con 0x7f2d340c1ad0 2023-01-01T17:39:50.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.191+0000 7f2d1b7fe700 1 -- 172.21.15.61:0/3610940456 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+126 (secure 0 0 0) 0x7f2d24051cf0 con 0x7f2d340c1ad0 2023-01-01T17:39:50.191 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:50.192 INFO:teuthology.orchestra.run.smithi061.stdout:[ 2023-01-01T17:39:50.192 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-01-01T17:39:50.192 INFO:teuthology.orchestra.run.smithi061.stdout: "poolnum": 1, 2023-01-01T17:39:50.192 INFO:teuthology.orchestra.run.smithi061.stdout: "poolname": "rbd" 2023-01-01T17:39:50.192 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-01-01T17:39:50.192 INFO:teuthology.orchestra.run.smithi061.stdout: { 2023-01-01T17:39:50.192 INFO:teuthology.orchestra.run.smithi061.stdout: "poolnum": 2, 2023-01-01T17:39:50.192 INFO:teuthology.orchestra.run.smithi061.stdout: "poolname": ".mgr" 2023-01-01T17:39:50.192 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-01-01T17:39:50.193 INFO:teuthology.orchestra.run.smithi061.stdout:] 2023-01-01T17:39:50.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.193+0000 7f2d39680700 1 -- 172.21.15.61:0/3610940456 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f2d20063290 msgr2=0x7f2d20065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:50.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.193+0000 7f2d39680700 1 --2- 172.21.15.61:0/3610940456 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f2d20063290 0x7f2d20065740 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2d28009840 tx=0x7f2d28008030 comp rx=0 tx=0).stop 2023-01-01T17:39:50.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.193+0000 7f2d39680700 1 -- 172.21.15.61:0/3610940456 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d340c1ad0 msgr2=0x7f2d340a92b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:50.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.193+0000 7f2d39680700 1 --2- 172.21.15.61:0/3610940456 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d340c1ad0 0x7f2d340a92b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2d2400c500 tx=0x7f2d2400c810 comp rx=0 tx=0).stop 2023-01-01T17:39:50.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.193+0000 7f2d39680700 1 -- 172.21.15.61:0/3610940456 shutdown_connections 2023-01-01T17:39:50.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.193+0000 7f2d39680700 1 --2- 172.21.15.61:0/3610940456 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d34157030 0x7f2d3414b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:50.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.193+0000 7f2d39680700 1 --2- 172.21.15.61:0/3610940456 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d3406a640 0x7f2d341498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:50.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.193+0000 7f2d39680700 1 --2- 172.21.15.61:0/3610940456 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f2d20063290 0x7f2d20065740 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:50.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.193+0000 7f2d39680700 1 --2- 172.21.15.61:0/3610940456 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d340c1ad0 0x7f2d340a92b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:50.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.193+0000 7f2d39680700 1 -- 172.21.15.61:0/3610940456 >> 172.21.15.61:0/3610940456 conn(0x7f2d340c1f30 msgr2=0x7f2d340bfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:50.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.193+0000 7f2d39680700 1 -- 172.21.15.61:0/3610940456 shutdown_connections 2023-01-01T17:39:50.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.193+0000 7f2d39680700 1 -- 172.21.15.61:0/3610940456 wait complete. 2023-01-01T17:39:50.206 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-01-01T17:39:50.206 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-01-01T17:39:50.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.334+0000 7f6b6f54b700 1 Processor -- start 2023-01-01T17:39:50.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.334+0000 7f6b6f54b700 1 -- start start 2023-01-01T17:39:50.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.335+0000 7f6b6f54b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6b6806cff0 0x7f6b68069360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:50.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.335+0000 7f6b6f54b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f6b680698a0 0x7f6b68152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:50.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.335+0000 7f6b6f54b700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b6806aaa0 con 0x7f6b6814cf50 2023-01-01T17:39:50.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.335+0000 7f6b6f54b700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b680c0930 con 0x7f6b680698a0 2023-01-01T17:39:50.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.335+0000 7f6b6f54b700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b68069e90 con 0x7f6b6806cff0 2023-01-01T17:39:50.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.335+0000 7f6b6dae8700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f6b680698a0 0x7f6b68152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:50.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.335+0000 7f6b6dae8700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f6b680698a0 0x7f6b68152ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:45916/0 (socket says 172.21.15.61:45916) 2023-01-01T17:39:50.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.335+0000 7f6b6dae8700 1 -- 172.21.15.61:0/2219140759 learned_addr learned my addr 172.21.15.61:0/2219140759 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:50.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.336+0000 7f6b6cae6700 1 --2- 172.21.15.61:0/2219140759 >> v2:172.21.15.149:3300/0 conn(0x7f6b6806cff0 0x7f6b68069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:50.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.336+0000 7f6b6dae8700 1 -- 172.21.15.61:0/2219140759 >> v2:172.21.15.149:3300/0 conn(0x7f6b6806cff0 msgr2=0x7f6b68069360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:50.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.336+0000 7f6b6dae8700 1 --2- 172.21.15.61:0/2219140759 >> v2:172.21.15.149:3300/0 conn(0x7f6b6806cff0 0x7f6b68069360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:50.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.336+0000 7f6b6dae8700 1 -- 172.21.15.61:0/2219140759 >> v1:172.21.15.149:6789/0 conn(0x7f6b6814cf50 legacy=0x7f6b680c0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:50.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.336+0000 7f6b6dae8700 1 -- 172.21.15.61:0/2219140759 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6806a170 con 0x7f6b680698a0 2023-01-01T17:39:50.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.336+0000 7f6b6cae6700 1 --2- 172.21.15.61:0/2219140759 >> v2:172.21.15.149:3300/0 conn(0x7f6b6806cff0 0x7f6b68069360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-01-01T17:39:50.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.336+0000 7f6b6dae8700 1 --2- 172.21.15.61:0/2219140759 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6b680698a0 0x7f6b68152ec0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6b68073740 tx=0x7f6b6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=277eef045f00cef7 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:50.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.336+0000 7f6b5bfff700 1 -- 172.21.15.61:0/2219140759 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6000e070 con 0x7f6b680698a0 2023-01-01T17:39:50.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.336+0000 7f6b5bfff700 1 -- 172.21.15.61:0/2219140759 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b60003a20 con 0x7f6b680698a0 2023-01-01T17:39:50.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.336+0000 7f6b5bfff700 1 -- 172.21.15.61:0/2219140759 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b60003dd0 con 0x7f6b680698a0 2023-01-01T17:39:50.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.336+0000 7f6b6f54b700 1 -- 172.21.15.61:0/2219140759 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6b680698a0 msgr2=0x7f6b68152ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:50.339 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.336+0000 7f6b6f54b700 1 --2- 172.21.15.61:0/2219140759 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6b680698a0 0x7f6b68152ec0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6b68073740 tx=0x7f6b6000b330 comp rx=0 tx=0).stop 2023-01-01T17:39:50.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.337+0000 7f6b6f54b700 1 -- 172.21.15.61:0/2219140759 shutdown_connections 2023-01-01T17:39:50.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.337+0000 7f6b6f54b700 1 --2- 172.21.15.61:0/2219140759 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6b680698a0 0x7f6b68152ec0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:50.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.337+0000 7f6b6f54b700 1 --2- 172.21.15.61:0/2219140759 >> v2:172.21.15.149:3300/0 conn(0x7f6b6806cff0 0x7f6b68069360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:50.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.337+0000 7f6b6f54b700 1 -- 172.21.15.61:0/2219140759 >> 172.21.15.61:0/2219140759 conn(0x7f6b680c1e80 msgr2=0x7f6b680c2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:50.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.337+0000 7f6b6f54b700 1 -- 172.21.15.61:0/2219140759 shutdown_connections 2023-01-01T17:39:50.340 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.337+0000 7f6b6f54b700 1 -- 172.21.15.61:0/2219140759 wait complete. 2023-01-01T17:39:50.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.338+0000 7f6b6f54b700 1 Processor -- start 2023-01-01T17:39:50.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.338+0000 7f6b6f54b700 1 -- start start 2023-01-01T17:39:50.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.338+0000 7f6b6f54b700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b680698a0 0x7f6b68154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:50.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.338+0000 7f6b6f54b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6b6806cff0 0x7f6b681453f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:50.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.338+0000 7f6b6f54b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b6814cf50 0x7f6b681427a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:50.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.338+0000 7f6b6f54b700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b681ec9c0 con 0x7f6b6806cff0 2023-01-01T17:39:50.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.338+0000 7f6b6f54b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b680a85f0 con 0x7f6b6814cf50 2023-01-01T17:39:50.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.338+0000 7f6b6f54b700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b681435e0 con 0x7f6b680698a0 2023-01-01T17:39:50.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.339+0000 7f6b6cae6700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6b6806cff0 0x7f6b681453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:50.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.339+0000 7f6b6cae6700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6b6806cff0 0x7f6b681453f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:45920/0 (socket says 172.21.15.61:45920) 2023-01-01T17:39:50.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.339+0000 7f6b6cae6700 1 -- 172.21.15.61:0/4055881590 learned_addr learned my addr 172.21.15.61:0/4055881590 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:50.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.339+0000 7f6b6d2e7700 1 --2- 172.21.15.61:0/4055881590 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b680698a0 0x7f6b68154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:50.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.339+0000 7f6b6dae8700 1 --2- 172.21.15.61:0/4055881590 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b6814cf50 0x7f6b681427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:50.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.339+0000 7f6b6cae6700 1 -- 172.21.15.61:0/4055881590 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b680698a0 msgr2=0x7f6b68154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:50.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.339+0000 7f6b6cae6700 1 --2- 172.21.15.61:0/4055881590 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b680698a0 0x7f6b68154aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:50.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.339+0000 7f6b6cae6700 1 -- 172.21.15.61:0/4055881590 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b6814cf50 msgr2=0x7f6b681427a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:50.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.339+0000 7f6b6cae6700 1 --2- 172.21.15.61:0/4055881590 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b6814cf50 0x7f6b681427a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:50.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.339+0000 7f6b6cae6700 1 -- 172.21.15.61:0/4055881590 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b60009b30 con 0x7f6b6806cff0 2023-01-01T17:39:50.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.339+0000 7f6b6d2e7700 1 --2- 172.21.15.61:0/4055881590 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b680698a0 0x7f6b68154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-01-01T17:39:50.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.339+0000 7f6b6dae8700 1 --2- 172.21.15.61:0/4055881590 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b6814cf50 0x7f6b681427a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-01-01T17:39:50.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.339+0000 7f6b6cae6700 1 --2- 172.21.15.61:0/4055881590 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6b6806cff0 0x7f6b681453f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00c750 tx=0x7f6b5c00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:50.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.339+0000 7f6b59ffb700 1 -- 172.21.15.61:0/4055881590 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c011800 con 0x7f6b6806cff0 2023-01-01T17:39:50.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.339+0000 7f6b59ffb700 1 -- 172.21.15.61:0/4055881590 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b5c011960 con 0x7f6b6806cff0 2023-01-01T17:39:50.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.339+0000 7f6b6f54b700 1 -- 172.21.15.61:0/4055881590 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b6806a730 con 0x7f6b6806cff0 2023-01-01T17:39:50.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.339+0000 7f6b59ffb700 1 -- 172.21.15.61:0/4055881590 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c011cd0 con 0x7f6b6806cff0 2023-01-01T17:39:50.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.339+0000 7f6b6f54b700 1 -- 172.21.15.61:0/4055881590 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b6806a450 con 0x7f6b6806cff0 2023-01-01T17:39:50.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.340+0000 7f6b59ffb700 1 -- 172.21.15.61:0/4055881590 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f6b5c020070 con 0x7f6b6806cff0 2023-01-01T17:39:50.347 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.340+0000 7f6b6f54b700 1 -- 172.21.15.61:0/4055881590 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b68153400 con 0x7f6b6806cff0 2023-01-01T17:39:50.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.341+0000 7f6b59ffb700 1 --2- 172.21.15.61:0/4055881590 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f6b4c063290 0x7f6b4c065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:50.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.341+0000 7f6b59ffb700 1 -- 172.21.15.61:0/4055881590 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6b5c07f6c0 con 0x7f6b6806cff0 2023-01-01T17:39:50.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.341+0000 7f6b6d2e7700 1 --2- 172.21.15.61:0/4055881590 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f6b4c063290 0x7f6b4c065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:50.348 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.341+0000 7f6b6d2e7700 1 --2- 172.21.15.61:0/4055881590 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f6b4c063290 0x7f6b4c065740 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6b68150840 tx=0x7f6b64008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:50.349 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.345+0000 7f6b59ffb700 1 -- 172.21.15.61:0/4055881590 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f6b5c04e9d0 con 0x7f6b6806cff0 2023-01-01T17:39:50.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:50.537+0000 7f6b6f54b700 1 -- 172.21.15.61:0/4055881590 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f6b680a9590 con 0x7f6b6806cff0 2023-01-01T17:39:51.522 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.521+0000 7f6b59ffb700 1 -- 172.21.15.61:0/4055881590 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6b680a9590 con 0x7f6b6806cff0 2023-01-01T17:39:51.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.524+0000 7f6b6f54b700 1 -- 172.21.15.61:0/4055881590 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f6b4c063290 msgr2=0x7f6b4c065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:51.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.524+0000 7f6b6f54b700 1 --2- 172.21.15.61:0/4055881590 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f6b4c063290 0x7f6b4c065740 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6b68150840 tx=0x7f6b64008040 comp rx=0 tx=0).stop 2023-01-01T17:39:51.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.524+0000 7f6b6f54b700 1 -- 172.21.15.61:0/4055881590 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6b6806cff0 msgr2=0x7f6b681453f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:51.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.524+0000 7f6b6f54b700 1 --2- 172.21.15.61:0/4055881590 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6b6806cff0 0x7f6b681453f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00c750 tx=0x7f6b5c00cb10 comp rx=0 tx=0).stop 2023-01-01T17:39:51.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.524+0000 7f6b6f54b700 1 -- 172.21.15.61:0/4055881590 shutdown_connections 2023-01-01T17:39:51.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.524+0000 7f6b6f54b700 1 --2- 172.21.15.61:0/4055881590 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6b6814cf50 0x7f6b681427a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:51.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.524+0000 7f6b6f54b700 1 --2- 172.21.15.61:0/4055881590 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6b680698a0 0x7f6b68154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:51.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.524+0000 7f6b6f54b700 1 --2- 172.21.15.61:0/4055881590 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f6b4c063290 0x7f6b4c065740 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:51.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.524+0000 7f6b6f54b700 1 --2- 172.21.15.61:0/4055881590 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6b6806cff0 0x7f6b681453f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:51.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.524+0000 7f6b6f54b700 1 -- 172.21.15.61:0/4055881590 >> 172.21.15.61:0/4055881590 conn(0x7f6b680c1e80 msgr2=0x7f6b680c2370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:51.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.525+0000 7f6b6f54b700 1 -- 172.21.15.61:0/4055881590 shutdown_connections 2023-01-01T17:39:51.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.525+0000 7f6b6f54b700 1 -- 172.21.15.61:0/4055881590 wait complete. 2023-01-01T17:39:51.527 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_metadata' created 2023-01-01T17:39:51.545 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-01-01T17:39:51.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.682+0000 7f7ee56ec700 1 Processor -- start 2023-01-01T17:39:51.684 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.682+0000 7f7ee56ec700 1 -- start start 2023-01-01T17:39:51.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.683+0000 7f7ee56ec700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ee00c8510 0x7f7ee00c7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:51.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.683+0000 7f7ee56ec700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee0153890 con 0x7f7ee0150330 2023-01-01T17:39:51.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.683+0000 7f7ee56ec700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee0153dc0 con 0x7f7ee0069890 2023-01-01T17:39:51.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.683+0000 7f7ee56ec700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee006b860 con 0x7f7ee00c8510 2023-01-01T17:39:51.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.683+0000 7f7edeffd700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f7ee0150330 0x7f7ee00c5850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39776/0 (socket says 172.21.15.61:39776) 2023-01-01T17:39:51.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.683+0000 7f7edeffd700 1 -- 172.21.15.61:0/3974792119 learned_addr learned my addr 172.21.15.61:0/3974792119 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:39:51.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.684+0000 7f7edf7fe700 1 --2- 172.21.15.61:0/3974792119 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ee00c8510 0x7f7ee00c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:51.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.684+0000 7f7eddffb700 1 -- 172.21.15.61:0/3974792119 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3198999551 0 0) 0x7f7ee0153890 con 0x7f7ee0150330 2023-01-01T17:39:51.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.684+0000 7f7eddffb700 1 -- 172.21.15.61:0/3974792119 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ec80035b0 con 0x7f7ee0150330 2023-01-01T17:39:51.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.684+0000 7f7eddffb700 1 -- 172.21.15.61:0/3974792119 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3754577117 0 0) 0x7f7ee0153dc0 con 0x7f7ee0069890 2023-01-01T17:39:51.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.684+0000 7f7eddffb700 1 -- 172.21.15.61:0/3974792119 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ee0153890 con 0x7f7ee0069890 2023-01-01T17:39:51.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.684+0000 7f7edf7fe700 1 -- 172.21.15.61:0/3974792119 >> v1:172.21.15.149:6789/0 conn(0x7f7ee0069890 legacy=0x7f7ee00c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:51.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.684+0000 7f7edf7fe700 1 -- 172.21.15.61:0/3974792119 >> v1:172.21.15.61:6789/0 conn(0x7f7ee0150330 legacy=0x7f7ee00c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:51.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.684+0000 7f7eddffb700 1 -- 172.21.15.61:0/3974792119 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 286995638 0 0) 0x7f7ec80035b0 con 0x7f7ee0150330 2023-01-01T17:39:51.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.684+0000 7f7edf7fe700 1 -- 172.21.15.61:0/3974792119 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee00bc710 con 0x7f7ee00c8510 2023-01-01T17:39:51.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.684+0000 7f7edf7fe700 1 --2- 172.21.15.61:0/3974792119 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ee00c8510 0x7f7ee00c7830 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8009dc0 tx=0x7f7ed800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73ead4032c609103 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:51.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.684+0000 7f7eddffb700 1 -- 172.21.15.61:0/3974792119 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed800e070 con 0x7f7ee00c8510 2023-01-01T17:39:51.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.684+0000 7f7eddffb700 1 -- 172.21.15.61:0/3974792119 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed8003a20 con 0x7f7ee00c8510 2023-01-01T17:39:51.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.684+0000 7f7eddffb700 1 -- 172.21.15.61:0/3974792119 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed4001670 con 0x7f7ee00c8510 2023-01-01T17:39:51.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.685+0000 7f7ee56ec700 1 -- 172.21.15.61:0/3974792119 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ee00c8510 msgr2=0x7f7ee00c7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:51.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.685+0000 7f7ee56ec700 1 --2- 172.21.15.61:0/3974792119 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ee00c8510 0x7f7ee00c7830 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8009dc0 tx=0x7f7ed800b330 comp rx=0 tx=0).stop 2023-01-01T17:39:51.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.685+0000 7f7ee56ec700 1 -- 172.21.15.61:0/3974792119 shutdown_connections 2023-01-01T17:39:51.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.685+0000 7f7ee56ec700 1 --2- 172.21.15.61:0/3974792119 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ee00c8510 0x7f7ee00c7830 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:51.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.685+0000 7f7ee56ec700 1 -- 172.21.15.61:0/3974792119 >> 172.21.15.61:0/3974792119 conn(0x7f7ee00c8e40 msgr2=0x7f7ee00c9240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:51.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.685+0000 7f7ee56ec700 1 -- 172.21.15.61:0/3974792119 shutdown_connections 2023-01-01T17:39:51.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.685+0000 7f7ee56ec700 1 -- 172.21.15.61:0/3974792119 wait complete. 2023-01-01T17:39:51.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.686+0000 7f7ee56ec700 1 Processor -- start 2023-01-01T17:39:51.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.686+0000 7f7ee56ec700 1 -- start start 2023-01-01T17:39:51.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.687+0000 7f7ee56ec700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7ee0069890 0x7f7ee00bff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:51.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.687+0000 7f7ee56ec700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ee00c8510 0x7f7ee01e8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:51.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.687+0000 7f7ee56ec700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ee0150330 0x7f7ee014cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:51.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.687+0000 7f7ee56ec700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee00c0450 con 0x7f7ee0069890 2023-01-01T17:39:51.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.687+0000 7f7ee56ec700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee00c2850 con 0x7f7ee0150330 2023-01-01T17:39:51.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.687+0000 7f7ee56ec700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee00c0660 con 0x7f7ee00c8510 2023-01-01T17:39:51.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.687+0000 7f7edeffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7ee0069890 0x7f7ee00bff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:51.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.687+0000 7f7edeffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7ee0069890 0x7f7ee00bff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:45932/0 (socket says 172.21.15.61:45932) 2023-01-01T17:39:51.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.687+0000 7f7edeffd700 1 -- 172.21.15.61:0/1434540522 learned_addr learned my addr 172.21.15.61:0/1434540522 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:51.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.687+0000 7f7edf7fe700 1 --2- 172.21.15.61:0/1434540522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ee0150330 0x7f7ee014cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:51.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.687+0000 7f7ede7fc700 1 --2- 172.21.15.61:0/1434540522 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ee00c8510 0x7f7ee01e8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:51.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.687+0000 7f7edeffd700 1 -- 172.21.15.61:0/1434540522 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ee00c8510 msgr2=0x7f7ee01e8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:51.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.687+0000 7f7edeffd700 1 --2- 172.21.15.61:0/1434540522 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ee00c8510 0x7f7ee01e8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:51.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.687+0000 7f7edeffd700 1 -- 172.21.15.61:0/1434540522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ee0150330 msgr2=0x7f7ee014cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:51.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.687+0000 7f7edeffd700 1 --2- 172.21.15.61:0/1434540522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ee0150330 0x7f7ee014cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:51.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.687+0000 7f7edeffd700 1 -- 172.21.15.61:0/1434540522 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed8009a70 con 0x7f7ee0069890 2023-01-01T17:39:51.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.687+0000 7f7edf7fe700 1 --2- 172.21.15.61:0/1434540522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ee0150330 0x7f7ee014cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-01-01T17:39:51.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.687+0000 7f7ede7fc700 1 --2- 172.21.15.61:0/1434540522 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ee00c8510 0x7f7ee01e8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-01-01T17:39:51.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.687+0000 7f7edeffd700 1 --2- 172.21.15.61:0/1434540522 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7ee0069890 0x7f7ee00bff10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7ed400c700 tx=0x7f7ed400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:51.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.688+0000 7f7ec77fe700 1 -- 172.21.15.61:0/1434540522 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed4004c80 con 0x7f7ee0069890 2023-01-01T17:39:51.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.688+0000 7f7ec77fe700 1 -- 172.21.15.61:0/1434540522 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed4004de0 con 0x7f7ee0069890 2023-01-01T17:39:51.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.688+0000 7f7ee56ec700 1 -- 172.21.15.61:0/1434540522 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee006b2a0 con 0x7f7ee0069890 2023-01-01T17:39:51.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.688+0000 7f7ec77fe700 1 -- 172.21.15.61:0/1434540522 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed4007310 con 0x7f7ee0069890 2023-01-01T17:39:51.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.688+0000 7f7ee56ec700 1 -- 172.21.15.61:0/1434540522 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee0153ae0 con 0x7f7ee0069890 2023-01-01T17:39:51.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.689+0000 7f7ee56ec700 1 -- 172.21.15.61:0/1434540522 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee006b580 con 0x7f7ee0069890 2023-01-01T17:39:51.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.689+0000 7f7ec77fe700 1 -- 172.21.15.61:0/1434540522 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f7ed401a020 con 0x7f7ee0069890 2023-01-01T17:39:51.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.689+0000 7f7ec77fe700 1 --2- 172.21.15.61:0/1434540522 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f7ecc063290 0x7f7ecc065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:51.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.690+0000 7f7ec77fe700 1 -- 172.21.15.61:0/1434540522 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f7ed407f4d0 con 0x7f7ee0069890 2023-01-01T17:39:51.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.690+0000 7f7ede7fc700 1 --2- 172.21.15.61:0/1434540522 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f7ecc063290 0x7f7ecc065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:51.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.690+0000 7f7ede7fc700 1 --2- 172.21.15.61:0/1434540522 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f7ecc063290 0x7f7ecc065740 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0007fd0 tx=0x7f7ed0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:51.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.694+0000 7f7ec77fe700 1 -- 172.21.15.61:0/1434540522 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f7ed404e760 con 0x7f7ee0069890 2023-01-01T17:39:51.884 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:51.884+0000 7f7ee56ec700 1 -- 172.21.15.61:0/1434540522 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f7ee0066190 con 0x7f7ee0069890 2023-01-01T17:39:52.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.531+0000 7f7ec77fe700 1 -- 172.21.15.61:0/1434540522 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7f7ed4051d80 con 0x7f7ee0069890 2023-01-01T17:39:52.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.539+0000 7f7ee56ec700 1 -- 172.21.15.61:0/1434540522 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f7ecc063290 msgr2=0x7f7ecc065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:52.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.539+0000 7f7ee56ec700 1 --2- 172.21.15.61:0/1434540522 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f7ecc063290 0x7f7ecc065740 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0007fd0 tx=0x7f7ed0009040 comp rx=0 tx=0).stop 2023-01-01T17:39:52.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.539+0000 7f7ee56ec700 1 -- 172.21.15.61:0/1434540522 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7ee0069890 msgr2=0x7f7ee00bff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:52.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.539+0000 7f7ee56ec700 1 --2- 172.21.15.61:0/1434540522 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7ee0069890 0x7f7ee00bff10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7ed400c700 tx=0x7f7ed400cac0 comp rx=0 tx=0).stop 2023-01-01T17:39:52.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.539+0000 7f7ee56ec700 1 -- 172.21.15.61:0/1434540522 shutdown_connections 2023-01-01T17:39:52.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.539+0000 7f7ee56ec700 1 --2- 172.21.15.61:0/1434540522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ee0150330 0x7f7ee014cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:52.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.539+0000 7f7ee56ec700 1 --2- 172.21.15.61:0/1434540522 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f7ecc063290 0x7f7ecc065740 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:52.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.539+0000 7f7ee56ec700 1 --2- 172.21.15.61:0/1434540522 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7ee0069890 0x7f7ee00bff10 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7ed400c700 tx=0x7f7ed400cac0 comp rx=0 tx=0).stop 2023-01-01T17:39:52.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.539+0000 7f7ee56ec700 1 --2- 172.21.15.61:0/1434540522 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ee00c8510 0x7f7ee01e8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:52.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.539+0000 7f7ee56ec700 1 -- 172.21.15.61:0/1434540522 >> 172.21.15.61:0/1434540522 conn(0x7f7ee00c8e40 msgr2=0x7f7ee00a9cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:52.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.546+0000 7f7ee56ec700 1 -- 172.21.15.61:0/1434540522 shutdown_connections 2023-01-01T17:39:52.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.546+0000 7f7ee56ec700 1 -- 172.21.15.61:0/1434540522 wait complete. 2023-01-01T17:39:52.551 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_data' created 2023-01-01T17:39:52.562 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-01-01T17:39:52.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.690+0000 7f91fa4c7700 1 Processor -- start 2023-01-01T17:39:52.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.690+0000 7f91fa4c7700 1 -- start start 2023-01-01T17:39:52.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.691+0000 7f91fa4c7700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f91f40c6e90 0x7f91f40c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:52.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.691+0000 7f91fa4c7700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f91f406df70 0x7f91f40c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:52.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.691+0000 7f91fa4c7700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f406dae0 con 0x7f91f40c7260 2023-01-01T17:39:52.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.691+0000 7f91fa4c7700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91f40ba5b0 con 0x7f91f406df70 2023-01-01T17:39:52.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.691+0000 7f91fa4c7700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91f406e550 con 0x7f91f40c6e90 2023-01-01T17:39:52.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.691+0000 7f91f8a64700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f91f406df70 0x7f91f40c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:52.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.691+0000 7f91f8a64700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f91f406df70 0x7f91f40c5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:45942/0 (socket says 172.21.15.61:45942) 2023-01-01T17:39:52.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.691+0000 7f91f8a64700 1 -- 172.21.15.61:0/2752196175 learned_addr learned my addr 172.21.15.61:0/2752196175 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:52.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.691+0000 7f91f3fff700 1 --2- 172.21.15.61:0/2752196175 >> v2:172.21.15.149:3300/0 conn(0x7f91f40c6e90 0x7f91f40c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:52.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.691+0000 7f91f8a64700 1 -- 172.21.15.61:0/2752196175 >> v2:172.21.15.149:3300/0 conn(0x7f91f40c6e90 msgr2=0x7f91f40c55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:52.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.691+0000 7f91f8a64700 1 --2- 172.21.15.61:0/2752196175 >> v2:172.21.15.149:3300/0 conn(0x7f91f40c6e90 0x7f91f40c55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:52.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.691+0000 7f91f8a64700 1 -- 172.21.15.61:0/2752196175 >> v1:172.21.15.149:6789/0 conn(0x7f91f40c7260 legacy=0x7f91f41544b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:52.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.691+0000 7f91f8a64700 1 -- 172.21.15.61:0/2752196175 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f406e830 con 0x7f91f406df70 2023-01-01T17:39:52.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.691+0000 7f91f2ffd700 1 -- 172.21.15.61:0/2752196175 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1869906352 0 0) 0x7f91f406dae0 con 0x7f91f40c7260 2023-01-01T17:39:52.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.692+0000 7f91f8a64700 1 --2- 172.21.15.61:0/2752196175 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91f406df70 0x7f91f40c5b20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f91f4071600 tx=0x7f91ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4aec38a28c44e3 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:52.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.692+0000 7f91f2ffd700 1 -- 172.21.15.61:0/2752196175 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec00e070 con 0x7f91f406df70 2023-01-01T17:39:52.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.692+0000 7f91f2ffd700 1 -- 172.21.15.61:0/2752196175 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ec00b910 con 0x7f91f406df70 2023-01-01T17:39:52.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.692+0000 7f91f2ffd700 1 -- 172.21.15.61:0/2752196175 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec00bcc0 con 0x7f91f406df70 2023-01-01T17:39:52.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.692+0000 7f91fa4c7700 1 -- 172.21.15.61:0/2752196175 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91f406df70 msgr2=0x7f91f40c5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:52.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.692+0000 7f91fa4c7700 1 --2- 172.21.15.61:0/2752196175 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91f406df70 0x7f91f40c5b20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f91f4071600 tx=0x7f91ec00b330 comp rx=0 tx=0).stop 2023-01-01T17:39:52.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.692+0000 7f91fa4c7700 1 -- 172.21.15.61:0/2752196175 shutdown_connections 2023-01-01T17:39:52.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.692+0000 7f91fa4c7700 1 --2- 172.21.15.61:0/2752196175 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91f406df70 0x7f91f40c5b20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:52.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.692+0000 7f91fa4c7700 1 --2- 172.21.15.61:0/2752196175 >> v2:172.21.15.149:3300/0 conn(0x7f91f40c6e90 0x7f91f40c55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:52.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.692+0000 7f91fa4c7700 1 -- 172.21.15.61:0/2752196175 >> 172.21.15.61:0/2752196175 conn(0x7f91f4070ad0 msgr2=0x7f91f4070ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:52.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.692+0000 7f91fa4c7700 1 -- 172.21.15.61:0/2752196175 shutdown_connections 2023-01-01T17:39:52.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.692+0000 7f91fa4c7700 1 -- 172.21.15.61:0/2752196175 wait complete. 2023-01-01T17:39:52.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.693+0000 7f91fa4c7700 1 Processor -- start 2023-01-01T17:39:52.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.694+0000 7f91fa4c7700 1 -- start start 2023-01-01T17:39:52.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.694+0000 7f91fa4c7700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91f406df70 0x7f91f40c03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:52.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.694+0000 7f91fa4c7700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91f40c6e90 0x7f91f41ec0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:52.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.694+0000 7f91fa4c7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91f40c7260 0x7f91f41ec610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:52.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.694+0000 7f91fa4c7700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f414ef60 con 0x7f91f40c6e90 2023-01-01T17:39:52.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.694+0000 7f91fa4c7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f4153030 con 0x7f91f40c7260 2023-01-01T17:39:52.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.694+0000 7f91fa4c7700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f41532d0 con 0x7f91f406df70 2023-01-01T17:39:52.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.695+0000 7f91f37fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91f40c6e90 0x7f91f41ec0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:52.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.695+0000 7f91f8a64700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91f40c7260 0x7f91f41ec610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:52.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.695+0000 7f91f37fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91f40c6e90 0x7f91f41ec0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:45946/0 (socket says 172.21.15.61:45946) 2023-01-01T17:39:52.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.695+0000 7f91f37fe700 1 -- 172.21.15.61:0/4292304052 learned_addr learned my addr 172.21.15.61:0/4292304052 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:52.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.695+0000 7f91f3fff700 1 --2- 172.21.15.61:0/4292304052 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91f406df70 0x7f91f40c03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:52.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.695+0000 7f91f37fe700 1 -- 172.21.15.61:0/4292304052 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91f406df70 msgr2=0x7f91f40c03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:52.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.695+0000 7f91f37fe700 1 --2- 172.21.15.61:0/4292304052 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91f406df70 0x7f91f40c03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:52.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.695+0000 7f91f37fe700 1 -- 172.21.15.61:0/4292304052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91f40c7260 msgr2=0x7f91f41ec610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:52.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.695+0000 7f91f37fe700 1 --2- 172.21.15.61:0/4292304052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91f40c7260 0x7f91f41ec610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:52.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.695+0000 7f91f37fe700 1 -- 172.21.15.61:0/4292304052 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ec009b30 con 0x7f91f40c6e90 2023-01-01T17:39:52.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.695+0000 7f91f37fe700 1 --2- 172.21.15.61:0/4292304052 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91f40c6e90 0x7f91f41ec0d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f91dc007fd0 tx=0x7f91dc00c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:52.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.695+0000 7f91f0ff9700 1 -- 172.21.15.61:0/4292304052 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc0054e0 con 0x7f91f40c6e90 2023-01-01T17:39:52.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.695+0000 7f91f0ff9700 1 -- 172.21.15.61:0/4292304052 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91dc00ce30 con 0x7f91f40c6e90 2023-01-01T17:39:52.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.695+0000 7f91f0ff9700 1 -- 172.21.15.61:0/4292304052 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc0038c0 con 0x7f91f40c6e90 2023-01-01T17:39:52.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.695+0000 7f91fa4c7700 1 -- 172.21.15.61:0/4292304052 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f406d770 con 0x7f91f40c6e90 2023-01-01T17:39:52.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.695+0000 7f91fa4c7700 1 -- 172.21.15.61:0/4292304052 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f406eb10 con 0x7f91f40c6e90 2023-01-01T17:39:52.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.696+0000 7f91fa4c7700 1 -- 172.21.15.61:0/4292304052 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f406d400 con 0x7f91f40c6e90 2023-01-01T17:39:52.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.696+0000 7f91f0ff9700 1 -- 172.21.15.61:0/4292304052 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f91dc019030 con 0x7f91f40c6e90 2023-01-01T17:39:52.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.697+0000 7f91f0ff9700 1 --2- 172.21.15.61:0/4292304052 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f91d4063290 0x7f91d4065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:52.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.697+0000 7f91f0ff9700 1 -- 172.21.15.61:0/4292304052 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f91dc07ecc0 con 0x7f91f40c6e90 2023-01-01T17:39:52.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.697+0000 7f91f3fff700 1 --2- 172.21.15.61:0/4292304052 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f91d4063290 0x7f91d4065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:52.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.697+0000 7f91f3fff700 1 --2- 172.21.15.61:0/4292304052 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f91d4063290 0x7f91d4065740 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f91e4009be0 tx=0x7f91e4009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:52.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.701+0000 7f91f0ff9700 1 -- 172.21.15.61:0/4292304052 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f91dc04dd50 con 0x7f91f40c6e90 2023-01-01T17:39:52.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.936+0000 7f91fa4c7700 1 -- 172.21.15.61:0/4292304052 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f91f40668a0 con 0x7f91f40c6e90 2023-01-01T17:39:52.945 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.943+0000 7f91f0ff9700 1 -- 172.21.15.61:0/4292304052 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f91dc0170c0 con 0x7f91f40c6e90 2023-01-01T17:39:52.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.947+0000 7f91fa4c7700 1 -- 172.21.15.61:0/4292304052 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f91d4063290 msgr2=0x7f91d4065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:52.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.947+0000 7f91fa4c7700 1 --2- 172.21.15.61:0/4292304052 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f91d4063290 0x7f91d4065740 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f91e4009be0 tx=0x7f91e4009210 comp rx=0 tx=0).stop 2023-01-01T17:39:52.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.947+0000 7f91fa4c7700 1 -- 172.21.15.61:0/4292304052 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91f40c6e90 msgr2=0x7f91f41ec0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:52.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.947+0000 7f91fa4c7700 1 --2- 172.21.15.61:0/4292304052 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91f40c6e90 0x7f91f41ec0d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f91dc007fd0 tx=0x7f91dc00c730 comp rx=0 tx=0).stop 2023-01-01T17:39:52.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.952+0000 7f91fa4c7700 1 -- 172.21.15.61:0/4292304052 shutdown_connections 2023-01-01T17:39:52.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.952+0000 7f91fa4c7700 1 --2- 172.21.15.61:0/4292304052 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91f40c7260 0x7f91f41ec610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:52.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.952+0000 7f91fa4c7700 1 --2- 172.21.15.61:0/4292304052 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f91f406df70 0x7f91f40c03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:52.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.952+0000 7f91fa4c7700 1 --2- 172.21.15.61:0/4292304052 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f91d4063290 0x7f91d4065740 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:52.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.952+0000 7f91fa4c7700 1 --2- 172.21.15.61:0/4292304052 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f91f40c6e90 0x7f91f41ec0d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:52.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.952+0000 7f91fa4c7700 1 -- 172.21.15.61:0/4292304052 >> 172.21.15.61:0/4292304052 conn(0x7f91f4070ad0 msgr2=0x7f91f40aaf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:52.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.953+0000 7f91fa4c7700 1 -- 172.21.15.61:0/4292304052 shutdown_connections 2023-01-01T17:39:52.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:52.953+0000 7f91fa4c7700 1 -- 172.21.15.61:0/4292304052 wait complete. 2023-01-01T17:39:52.963 INFO:teuthology.orchestra.run.smithi061.stderr:new fs with metadata pool 3 and data pool 4 2023-01-01T17:39:52.977 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-01-01T17:39:52.977 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-01-01T17:39:53.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.104+0000 7f3f3f448700 1 Processor -- start 2023-01-01T17:39:53.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.105+0000 7f3f3f448700 1 -- start start 2023-01-01T17:39:53.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.105+0000 7f3f3f448700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f380c64f0 0x7f3f380c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:53.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.105+0000 7f3f3f448700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3f38071750 0x7f3f380c1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:53.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.105+0000 7f3f3f448700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f380c4e30 con 0x7f3f380c68c0 2023-01-01T17:39:53.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.105+0000 7f3f3f448700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f381562c0 con 0x7f3f38071750 2023-01-01T17:39:53.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.105+0000 7f3f3f448700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3806de00 con 0x7f3f380c64f0 2023-01-01T17:39:53.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.106+0000 7f3f3d9e5700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3f38071750 0x7f3f380c1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:53.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.106+0000 7f3f3d9e5700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3f38071750 0x7f3f380c1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:45968/0 (socket says 172.21.15.61:45968) 2023-01-01T17:39:53.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.106+0000 7f3f3d9e5700 1 -- 172.21.15.61:0/3455489924 learned_addr learned my addr 172.21.15.61:0/3455489924 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:53.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.106+0000 7f3f3d1e4700 1 --2- 172.21.15.61:0/3455489924 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f380c64f0 0x7f3f380c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:53.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.106+0000 7f3f3d9e5700 1 -- 172.21.15.61:0/3455489924 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f380c64f0 msgr2=0x7f3f380c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:53.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.106+0000 7f3f3d9e5700 1 --2- 172.21.15.61:0/3455489924 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f380c64f0 0x7f3f380c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:53.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.106+0000 7f3f3d9e5700 1 -- 172.21.15.61:0/3455489924 >> v1:172.21.15.149:6789/0 conn(0x7f3f380c68c0 legacy=0x7f3f381567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:53.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.106+0000 7f3f2ffff700 1 -- 172.21.15.61:0/3455489924 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1288266090 0 0) 0x7f3f380c4e30 con 0x7f3f380c68c0 2023-01-01T17:39:53.108 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.106+0000 7f3f3d9e5700 1 -- 172.21.15.61:0/3455489924 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f380c5080 con 0x7f3f38071750 2023-01-01T17:39:53.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.106+0000 7f3f3d9e5700 1 --2- 172.21.15.61:0/3455489924 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f38071750 0x7f3f380c1f20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3f30009e50 tx=0x7f3f3000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d4f2651d9a7676 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:53.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.106+0000 7f3f2ffff700 1 -- 172.21.15.61:0/3455489924 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3000e070 con 0x7f3f38071750 2023-01-01T17:39:53.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.106+0000 7f3f2ffff700 1 -- 172.21.15.61:0/3455489924 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3000b910 con 0x7f3f38071750 2023-01-01T17:39:53.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.106+0000 7f3f2ffff700 1 -- 172.21.15.61:0/3455489924 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3000bcc0 con 0x7f3f38071750 2023-01-01T17:39:53.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.107+0000 7f3f3f448700 1 -- 172.21.15.61:0/3455489924 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f38071750 msgr2=0x7f3f380c1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:53.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.107+0000 7f3f3f448700 1 --2- 172.21.15.61:0/3455489924 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f38071750 0x7f3f380c1f20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3f30009e50 tx=0x7f3f3000b330 comp rx=0 tx=0).stop 2023-01-01T17:39:53.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.107+0000 7f3f3f448700 1 -- 172.21.15.61:0/3455489924 shutdown_connections 2023-01-01T17:39:53.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.107+0000 7f3f3f448700 1 --2- 172.21.15.61:0/3455489924 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f38071750 0x7f3f380c1f20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:53.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.107+0000 7f3f3f448700 1 --2- 172.21.15.61:0/3455489924 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f380c64f0 0x7f3f380c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:53.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.107+0000 7f3f3f448700 1 -- 172.21.15.61:0/3455489924 >> 172.21.15.61:0/3455489924 conn(0x7f3f380a8420 msgr2=0x7f3f380c5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:53.109 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.107+0000 7f3f3f448700 1 -- 172.21.15.61:0/3455489924 shutdown_connections 2023-01-01T17:39:53.110 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.107+0000 7f3f3f448700 1 -- 172.21.15.61:0/3455489924 wait complete. 2023-01-01T17:39:53.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.108+0000 7f3f3f448700 1 Processor -- start 2023-01-01T17:39:53.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.108+0000 7f3f3f448700 1 -- start start 2023-01-01T17:39:53.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.110+0000 7f3f3f448700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f38071750 0x7f3f381526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:53.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.110+0000 7f3f3f448700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f380c64f0 0x7f3f3814d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:53.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.110+0000 7f3f3f448700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f381502e0 0x7f3f3814b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:53.113 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.110+0000 7f3f3f448700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f381513f0 con 0x7f3f381502e0 2023-01-01T17:39:53.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.110+0000 7f3f3f448700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f38153e90 con 0x7f3f380c64f0 2023-01-01T17:39:53.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.110+0000 7f3f3f448700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f38154170 con 0x7f3f38071750 2023-01-01T17:39:53.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.110+0000 7f3f3d9e5700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f381502e0 0x7f3f3814b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:53.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.110+0000 7f3f3d9e5700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f381502e0 0x7f3f3814b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:45974/0 (socket says 172.21.15.61:45974) 2023-01-01T17:39:53.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.110+0000 7f3f3d9e5700 1 -- 172.21.15.61:0/1835297434 learned_addr learned my addr 172.21.15.61:0/1835297434 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:53.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.110+0000 7f3f3c9e3700 1 --2- 172.21.15.61:0/1835297434 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f380c64f0 0x7f3f3814d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:53.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.110+0000 7f3f3d1e4700 1 --2- 172.21.15.61:0/1835297434 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f38071750 0x7f3f381526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:53.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.110+0000 7f3f3d9e5700 1 -- 172.21.15.61:0/1835297434 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f38071750 msgr2=0x7f3f381526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:53.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.110+0000 7f3f3d9e5700 1 --2- 172.21.15.61:0/1835297434 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f38071750 0x7f3f381526e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:53.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.110+0000 7f3f3d9e5700 1 -- 172.21.15.61:0/1835297434 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f380c64f0 msgr2=0x7f3f3814d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:53.114 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.110+0000 7f3f3d9e5700 1 --2- 172.21.15.61:0/1835297434 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f380c64f0 0x7f3f3814d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:53.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.110+0000 7f3f3d9e5700 1 -- 172.21.15.61:0/1835297434 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f30009b30 con 0x7f3f381502e0 2023-01-01T17:39:53.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.110+0000 7f3f3d9e5700 1 --2- 172.21.15.61:0/1835297434 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f381502e0 0x7f3f3814b070 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3f3806f600 tx=0x7f3f30004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:53.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.110+0000 7f3f2dffb700 1 -- 172.21.15.61:0/1835297434 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f300099b0 con 0x7f3f381502e0 2023-01-01T17:39:53.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.110+0000 7f3f2dffb700 1 -- 172.21.15.61:0/1835297434 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f300092e0 con 0x7f3f381502e0 2023-01-01T17:39:53.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.110+0000 7f3f3f448700 1 -- 172.21.15.61:0/1835297434 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f38152cd0 con 0x7f3f381502e0 2023-01-01T17:39:53.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.110+0000 7f3f2dffb700 1 -- 172.21.15.61:0/1835297434 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3001c660 con 0x7f3f381502e0 2023-01-01T17:39:53.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.110+0000 7f3f3f448700 1 -- 172.21.15.61:0/1835297434 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f3806e1b0 con 0x7f3f381502e0 2023-01-01T17:39:53.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.110+0000 7f3f3f448700 1 -- 172.21.15.61:0/1835297434 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f381543b0 con 0x7f3f381502e0 2023-01-01T17:39:53.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.113+0000 7f3f2dffb700 1 -- 172.21.15.61:0/1835297434 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f3f30022030 con 0x7f3f381502e0 2023-01-01T17:39:53.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.113+0000 7f3f2dffb700 1 --2- 172.21.15.61:0/1835297434 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3f1c063290 0x7f3f1c065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:53.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.113+0000 7f3f2dffb700 1 -- 172.21.15.61:0/1835297434 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3f30081560 con 0x7f3f381502e0 2023-01-01T17:39:53.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.113+0000 7f3f3d1e4700 1 --2- 172.21.15.61:0/1835297434 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3f1c063290 0x7f3f1c065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:53.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.113+0000 7f3f3d1e4700 1 --2- 172.21.15.61:0/1835297434 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3f1c063290 0x7f3f1c065740 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3f380abd20 tx=0x7f3f28008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:53.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.117+0000 7f3f2dffb700 1 -- 172.21.15.61:0/1835297434 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f3f30050540 con 0x7f3f381502e0 2023-01-01T17:39:53.318 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.318+0000 7f3f3f448700 1 -- 172.21.15.61:0/1835297434 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f3f3806d400 con 0x7f3f381502e0 2023-01-01T17:39:53.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.950+0000 7f3f2dffb700 1 -- 172.21.15.61:0/1835297434 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7f3f3806d400 con 0x7f3f381502e0 2023-01-01T17:39:53.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.953+0000 7f3f3f448700 1 -- 172.21.15.61:0/1835297434 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3f1c063290 msgr2=0x7f3f1c065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:53.952 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.953+0000 7f3f3f448700 1 --2- 172.21.15.61:0/1835297434 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3f1c063290 0x7f3f1c065740 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3f380abd20 tx=0x7f3f28008040 comp rx=0 tx=0).stop 2023-01-01T17:39:53.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.953+0000 7f3f3f448700 1 -- 172.21.15.61:0/1835297434 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f381502e0 msgr2=0x7f3f3814b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:53.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.953+0000 7f3f3f448700 1 --2- 172.21.15.61:0/1835297434 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f381502e0 0x7f3f3814b070 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3f3806f600 tx=0x7f3f30004ad0 comp rx=0 tx=0).stop 2023-01-01T17:39:53.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.953+0000 7f3f3f448700 1 -- 172.21.15.61:0/1835297434 shutdown_connections 2023-01-01T17:39:53.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.953+0000 7f3f3f448700 1 --2- 172.21.15.61:0/1835297434 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3f1c063290 0x7f3f1c065740 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:53.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.953+0000 7f3f3f448700 1 --2- 172.21.15.61:0/1835297434 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f381502e0 0x7f3f3814b070 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:53.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.953+0000 7f3f3f448700 1 --2- 172.21.15.61:0/1835297434 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f38071750 0x7f3f381526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:53.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.953+0000 7f3f3f448700 1 --2- 172.21.15.61:0/1835297434 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f380c64f0 0x7f3f3814d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:53.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.953+0000 7f3f3f448700 1 -- 172.21.15.61:0/1835297434 >> 172.21.15.61:0/1835297434 conn(0x7f3f380a8420 msgr2=0x7f3f3814f210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:53.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.953+0000 7f3f3f448700 1 -- 172.21.15.61:0/1835297434 shutdown_connections 2023-01-01T17:39:53.953 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:53.953+0000 7f3f3f448700 1 -- 172.21.15.61:0/1835297434 wait complete. 2023-01-01T17:39:53.970 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-01-01T17:39:54.111 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.112+0000 7f01494c8700 1 Processor -- start 2023-01-01T17:39:54.112 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.112+0000 7f01494c8700 1 -- start start 2023-01-01T17:39:54.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.113+0000 7f01494c8700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01440c4ff0 0x7f0144150230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:54.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.113+0000 7f01494c8700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01440c9530 con 0x7f014406b030 2023-01-01T17:39:54.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.113+0000 7f01494c8700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01441530d0 con 0x7f0144153bb0 2023-01-01T17:39:54.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.113+0000 7f01494c8700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01440c9810 con 0x7f01440c4ff0 2023-01-01T17:39:54.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.113+0000 7f0142ffd700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f014406b030 0x7f014406b400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39828/0 (socket says 172.21.15.61:39828) 2023-01-01T17:39:54.115 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.113+0000 7f0142ffd700 1 -- 172.21.15.61:0/183085453 learned_addr learned my addr 172.21.15.61:0/183085453 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:39:54.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.113+0000 7f01437fe700 1 --2- 172.21.15.61:0/183085453 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01440c4ff0 0x7f0144150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:54.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.113+0000 7f0141ffb700 1 -- 172.21.15.61:0/183085453 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2458630056 0 0) 0x7f01440c9530 con 0x7f014406b030 2023-01-01T17:39:54.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.113+0000 7f0141ffb700 1 -- 172.21.15.61:0/183085453 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f012c0035b0 con 0x7f014406b030 2023-01-01T17:39:54.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.113+0000 7f0141ffb700 1 -- 172.21.15.61:0/183085453 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 181226871 0 0) 0x7f012c0035b0 con 0x7f014406b030 2023-01-01T17:39:54.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.113+0000 7f0141ffb700 1 -- 172.21.15.61:0/183085453 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01440c4ff0 msgr2=0x7f0144150230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:54.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.113+0000 7f0141ffb700 1 --2- 172.21.15.61:0/183085453 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01440c4ff0 0x7f0144150230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:54.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.113+0000 7f0141ffb700 1 -- 172.21.15.61:0/183085453 >> v1:172.21.15.149:6789/0 conn(0x7f0144153bb0 legacy=0x7f0144156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:54.116 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.113+0000 7f0141ffb700 1 -- 172.21.15.61:0/183085453 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01441533b0 con 0x7f014406b030 2023-01-01T17:39:54.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.113+0000 7f0141ffb700 1 -- 172.21.15.61:0/183085453 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586489653 0 0) 0x7f0138001670 con 0x7f014406b030 2023-01-01T17:39:54.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.113+0000 7f0141ffb700 1 -- 172.21.15.61:0/183085453 >> v1:172.21.15.61:6789/0 conn(0x7f014406b030 legacy=0x7f014406b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:54.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.113+0000 7f0141ffb700 1 --2- 172.21.15.61:0/183085453 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01440c4ff0 0x7f012c003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:54.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.113+0000 7f0141ffb700 1 --2- 172.21.15.61:0/183085453 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f012c003f70 0x7f012c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:54.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.113+0000 7f0141ffb700 1 --2- 172.21.15.61:0/183085453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f012c004d90 0x7f012c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:54.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.113+0000 7f0141ffb700 1 -- 172.21.15.61:0/183085453 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01440c9810 con 0x7f012c003f70 2023-01-01T17:39:54.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.113+0000 7f0141ffb700 1 -- 172.21.15.61:0/183085453 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f012c00ba40 con 0x7f012c004d90 2023-01-01T17:39:54.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.113+0000 7f0141ffb700 1 -- 172.21.15.61:0/183085453 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f012c00bc00 con 0x7f01440c4ff0 2023-01-01T17:39:54.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.114+0000 7f01427fc700 1 --2- 172.21.15.61:0/183085453 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f012c003f70 0x7f012c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:54.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.114+0000 7f0142ffd700 1 --2- 172.21.15.61:0/183085453 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01440c4ff0 0x7f012c003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:54.117 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.114+0000 7f01437fe700 1 --2- 172.21.15.61:0/183085453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f012c004d90 0x7f012c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:54.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.114+0000 7f01427fc700 1 -- 172.21.15.61:0/183085453 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01440c4ff0 msgr2=0x7f012c003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:54.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.114+0000 7f01427fc700 1 --2- 172.21.15.61:0/183085453 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01440c4ff0 0x7f012c003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:54.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.114+0000 7f01427fc700 1 -- 172.21.15.61:0/183085453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f012c004d90 msgr2=0x7f012c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:54.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.114+0000 7f01427fc700 1 --2- 172.21.15.61:0/183085453 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f012c004d90 0x7f012c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:54.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.114+0000 7f01427fc700 1 -- 172.21.15.61:0/183085453 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f012c0035b0 con 0x7f012c003f70 2023-01-01T17:39:54.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.114+0000 7f01427fc700 1 --2- 172.21.15.61:0/183085453 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f012c003f70 0x7f012c004850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0144154030 tx=0x7f012c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e8ea2079239f41 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:54.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.114+0000 7f0141ffb700 1 -- 172.21.15.61:0/183085453 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013400c660 con 0x7f012c003f70 2023-01-01T17:39:54.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.114+0000 7f0141ffb700 1 -- 172.21.15.61:0/183085453 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013400c7c0 con 0x7f012c003f70 2023-01-01T17:39:54.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.114+0000 7f0141ffb700 1 -- 172.21.15.61:0/183085453 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013400cb70 con 0x7f012c003f70 2023-01-01T17:39:54.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.115+0000 7f01494c8700 1 -- 172.21.15.61:0/183085453 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f012c003f70 msgr2=0x7f012c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:54.118 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.115+0000 7f01494c8700 1 --2- 172.21.15.61:0/183085453 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f012c003f70 0x7f012c004850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0144154030 tx=0x7f012c005880 comp rx=0 tx=0).stop 2023-01-01T17:39:54.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.115+0000 7f01437fe700 1 -- 172.21.15.61:0/183085453 reap_dead start 2023-01-01T17:39:54.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.115+0000 7f01494c8700 1 -- 172.21.15.61:0/183085453 shutdown_connections 2023-01-01T17:39:54.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.115+0000 7f01494c8700 1 -- 172.21.15.61:0/183085453 >> 172.21.15.61:0/183085453 conn(0x7f0144070a90 msgr2=0x7f0144070e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:54.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.115+0000 7f01494c8700 1 -- 172.21.15.61:0/183085453 shutdown_connections 2023-01-01T17:39:54.119 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.115+0000 7f01494c8700 1 -- 172.21.15.61:0/183085453 wait complete. 2023-01-01T17:39:54.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.116+0000 7f01494c8700 1 Processor -- start 2023-01-01T17:39:54.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.117+0000 7f01494c8700 1 -- start start 2023-01-01T17:39:54.121 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.117+0000 7f01494c8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f012c003f70 0x7f01441ec550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:54.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.117+0000 7f01494c8700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f01440c16d0 0x7f01440c5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:54.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.117+0000 7f01494c8700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01441e8ee0 0x7f014414d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:54.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.117+0000 7f01494c8700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01440c5420 con 0x7f01440c16d0 2023-01-01T17:39:54.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.117+0000 7f01494c8700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01441eca90 con 0x7f012c003f70 2023-01-01T17:39:54.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.117+0000 7f01494c8700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01440ac040 con 0x7f01441e8ee0 2023-01-01T17:39:54.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.118+0000 7f01427fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f01440c16d0 0x7f01440c5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:54.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.118+0000 7f01427fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f01440c16d0 0x7f01440c5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:45990/0 (socket says 172.21.15.61:45990) 2023-01-01T17:39:54.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.118+0000 7f01427fc700 1 -- 172.21.15.61:0/2035134372 learned_addr learned my addr 172.21.15.61:0/2035134372 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:54.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.118+0000 7f0142ffd700 1 --2- 172.21.15.61:0/2035134372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f012c003f70 0x7f01441ec550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:54.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.118+0000 7f01437fe700 1 --2- 172.21.15.61:0/2035134372 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01441e8ee0 0x7f014414d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:54.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.118+0000 7f01427fc700 1 -- 172.21.15.61:0/2035134372 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01441e8ee0 msgr2=0x7f014414d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:54.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.118+0000 7f01427fc700 1 --2- 172.21.15.61:0/2035134372 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01441e8ee0 0x7f014414d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:54.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.118+0000 7f01427fc700 1 -- 172.21.15.61:0/2035134372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f012c003f70 msgr2=0x7f01441ec550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:54.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.118+0000 7f01427fc700 1 --2- 172.21.15.61:0/2035134372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f012c003f70 0x7f01441ec550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:54.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.118+0000 7f01427fc700 1 -- 172.21.15.61:0/2035134372 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01440c9200 con 0x7f01440c16d0 2023-01-01T17:39:54.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.118+0000 7f01427fc700 1 --2- 172.21.15.61:0/2035134372 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f01440c16d0 0x7f01440c5bc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0134005300 tx=0x7f0134001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:54.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.118+0000 7f012b7fe700 1 -- 172.21.15.61:0/2035134372 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013400cb30 con 0x7f01440c16d0 2023-01-01T17:39:54.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.118+0000 7f012b7fe700 1 -- 172.21.15.61:0/2035134372 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0134021070 con 0x7f01440c16d0 2023-01-01T17:39:54.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.118+0000 7f01494c8700 1 -- 172.21.15.61:0/2035134372 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0144153690 con 0x7f01440c16d0 2023-01-01T17:39:54.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.118+0000 7f012b7fe700 1 -- 172.21.15.61:0/2035134372 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013400ced0 con 0x7f01440c16d0 2023-01-01T17:39:54.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.118+0000 7f01494c8700 1 -- 172.21.15.61:0/2035134372 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01440c3a50 con 0x7f01440c16d0 2023-01-01T17:39:54.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.119+0000 7f01494c8700 1 -- 172.21.15.61:0/2035134372 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01441e8d30 con 0x7f01440c16d0 2023-01-01T17:39:54.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.119+0000 7f012b7fe700 1 -- 172.21.15.61:0/2035134372 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f0134010050 con 0x7f01440c16d0 2023-01-01T17:39:54.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.120+0000 7f012b7fe700 1 --2- 172.21.15.61:0/2035134372 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f0130063290 0x7f0130065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:54.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.120+0000 7f012b7fe700 1 -- 172.21.15.61:0/2035134372 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6288+0+0 (secure 0 0 0) 0x7f0134080e70 con 0x7f01440c16d0 2023-01-01T17:39:54.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.120+0000 7f0142ffd700 1 --2- 172.21.15.61:0/2035134372 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f0130063290 0x7f0130065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:54.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.120+0000 7f0142ffd700 1 --2- 172.21.15.61:0/2035134372 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f0130063290 0x7f0130065740 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0144152d40 tx=0x7f0138009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:54.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.124+0000 7f012b7fe700 1 -- 172.21.15.61:0/2035134372 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f013404fd70 con 0x7f01440c16d0 2023-01-01T17:39:54.314 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:54.313+0000 7f01494c8700 1 -- 172.21.15.61:0/2035134372 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f01440aef50 con 0x7f01440c16d0 2023-01-01T17:39:55.961 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:55.962+0000 7f012b7fe700 1 -- 172.21.15.61:0/2035134372 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7f013402b100 con 0x7f01440c16d0 2023-01-01T17:39:55.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:55.967+0000 7f01494c8700 1 -- 172.21.15.61:0/2035134372 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f0130063290 msgr2=0x7f0130065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:55.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:55.967+0000 7f01494c8700 1 --2- 172.21.15.61:0/2035134372 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f0130063290 0x7f0130065740 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0144152d40 tx=0x7f0138009040 comp rx=0 tx=0).stop 2023-01-01T17:39:55.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:55.967+0000 7f01494c8700 1 -- 172.21.15.61:0/2035134372 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f01440c16d0 msgr2=0x7f01440c5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:55.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:55.967+0000 7f01494c8700 1 --2- 172.21.15.61:0/2035134372 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f01440c16d0 0x7f01440c5bc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0134005300 tx=0x7f0134001230 comp rx=0 tx=0).stop 2023-01-01T17:39:55.967 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:55.967+0000 7f01494c8700 1 -- 172.21.15.61:0/2035134372 shutdown_connections 2023-01-01T17:39:55.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:55.967+0000 7f01494c8700 1 --2- 172.21.15.61:0/2035134372 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f01441e8ee0 0x7f014414d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:55.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:55.967+0000 7f01494c8700 1 --2- 172.21.15.61:0/2035134372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f012c003f70 0x7f01441ec550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:55.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:55.967+0000 7f01494c8700 1 --2- 172.21.15.61:0/2035134372 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f0130063290 0x7f0130065740 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:55.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:55.967+0000 7f01494c8700 1 --2- 172.21.15.61:0/2035134372 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f01440c16d0 0x7f01440c5bc0 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0134005300 tx=0x7f0134001230 comp rx=0 tx=0).stop 2023-01-01T17:39:55.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:55.967+0000 7f01494c8700 1 -- 172.21.15.61:0/2035134372 >> 172.21.15.61:0/2035134372 conn(0x7f0144070a90 msgr2=0x7f01441dd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:55.968 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:55.969+0000 7f01494c8700 1 -- 172.21.15.61:0/2035134372 shutdown_connections 2023-01-01T17:39:55.969 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:55.969+0000 7f01494c8700 1 -- 172.21.15.61:0/2035134372 wait complete. 2023-01-01T17:39:55.975 INFO:teuthology.orchestra.run.smithi061.stderr:pool 'cephfs_data_ec' created 2023-01-01T17:39:55.988 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-01-01T17:39:56.122 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.123+0000 7fb3d05c6700 1 Processor -- start 2023-01-01T17:39:56.123 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.123+0000 7fb3d05c6700 1 -- start start 2023-01-01T17:39:56.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.124+0000 7fb3d05c6700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb3c81537e0 0x7fb3c80c48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:56.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.124+0000 7fb3d05c6700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3c80c2710 con 0x7fb3c8152df0 2023-01-01T17:39:56.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.124+0000 7fb3d05c6700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3c8150780 con 0x7fb3c8069360 2023-01-01T17:39:56.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.124+0000 7fb3d05c6700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c80c51b0 con 0x7fb3c81537e0 2023-01-01T17:39:56.124 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.124+0000 7fb3cdb61700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fb3c8152df0 0x7fb3c80c2ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39846/0 (socket says 172.21.15.61:39846) 2023-01-01T17:39:56.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.124+0000 7fb3cdb61700 1 -- 172.21.15.61:0/1227458157 learned_addr learned my addr 172.21.15.61:0/1227458157 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:39:56.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.124+0000 7fb3ce362700 1 --2- 172.21.15.61:0/1227458157 >> v2:172.21.15.149:3300/0 conn(0x7fb3c81537e0 0x7fb3c80c48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:56.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.124+0000 7fb3cd360700 1 -- 172.21.15.61:0/1227458157 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1682008390 0 0) 0x7fb3c80c2710 con 0x7fb3c8152df0 2023-01-01T17:39:56.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.124+0000 7fb3cd360700 1 -- 172.21.15.61:0/1227458157 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3b40035b0 con 0x7fb3c8152df0 2023-01-01T17:39:56.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.125+0000 7fb3ce362700 1 -- 172.21.15.61:0/1227458157 >> v1:172.21.15.149:6789/0 conn(0x7fb3c8069360 legacy=0x7fb3c8070870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:56.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.125+0000 7fb3ce362700 1 -- 172.21.15.61:0/1227458157 >> v1:172.21.15.61:6789/0 conn(0x7fb3c8152df0 legacy=0x7fb3c80c2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:56.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.125+0000 7fb3ce362700 1 -- 172.21.15.61:0/1227458157 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c80c5490 con 0x7fb3c81537e0 2023-01-01T17:39:56.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.125+0000 7fb3ce362700 1 --2- 172.21.15.61:0/1227458157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3c81537e0 0x7fb3c80c48b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8009840 tx=0x7fb3b8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80576cd1d5f6f83f server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:56.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.125+0000 7fb3cd360700 1 -- 172.21.15.61:0/1227458157 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8011830 con 0x7fb3c81537e0 2023-01-01T17:39:56.125 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.125+0000 7fb3cd360700 1 -- 172.21.15.61:0/1227458157 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b8011990 con 0x7fb3c81537e0 2023-01-01T17:39:56.126 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.125+0000 7fb3cd360700 1 -- 172.21.15.61:0/1227458157 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8011d20 con 0x7fb3c81537e0 2023-01-01T17:39:56.126 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.125+0000 7fb3d05c6700 1 -- 172.21.15.61:0/1227458157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3c81537e0 msgr2=0x7fb3c80c48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:56.127 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.125+0000 7fb3d05c6700 1 --2- 172.21.15.61:0/1227458157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3c81537e0 0x7fb3c80c48b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8009840 tx=0x7fb3b8009b50 comp rx=0 tx=0).stop 2023-01-01T17:39:56.127 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.126+0000 7fb3d05c6700 1 -- 172.21.15.61:0/1227458157 shutdown_connections 2023-01-01T17:39:56.127 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.126+0000 7fb3d05c6700 1 --2- 172.21.15.61:0/1227458157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3c81537e0 0x7fb3c80c48b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:56.127 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.126+0000 7fb3d05c6700 1 -- 172.21.15.61:0/1227458157 >> 172.21.15.61:0/1227458157 conn(0x7fb3c80a7670 msgr2=0x7fb3c80a7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:56.127 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.126+0000 7fb3d05c6700 1 -- 172.21.15.61:0/1227458157 shutdown_connections 2023-01-01T17:39:56.127 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.126+0000 7fb3d05c6700 1 -- 172.21.15.61:0/1227458157 wait complete. 2023-01-01T17:39:56.127 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.127+0000 7fb3d05c6700 1 Processor -- start 2023-01-01T17:39:56.127 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.127+0000 7fb3d05c6700 1 -- start start 2023-01-01T17:39:56.130 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.128+0000 7fb3d05c6700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb3c8069360 0x7fb3c80c0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:56.130 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.128+0000 7fb3d05c6700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3c8152df0 0x7fb3c81e7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:56.130 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.128+0000 7fb3d05c6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3c81537e0 0x7fb3c81e8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:56.130 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.128+0000 7fb3d05c6700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c81eb360 con 0x7fb3c8069360 2023-01-01T17:39:56.130 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.128+0000 7fb3d05c6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c80aa020 con 0x7fb3c81537e0 2023-01-01T17:39:56.130 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.128+0000 7fb3d05c6700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c80a8b10 con 0x7fb3c8152df0 2023-01-01T17:39:56.130 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.128+0000 7fb3ce362700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb3c8069360 0x7fb3c80c0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:56.130 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.128+0000 7fb3ce362700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb3c8069360 0x7fb3c80c0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46002/0 (socket says 172.21.15.61:46002) 2023-01-01T17:39:56.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.128+0000 7fb3ce362700 1 -- 172.21.15.61:0/3204054010 learned_addr learned my addr 172.21.15.61:0/3204054010 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:56.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.128+0000 7fb3cdb61700 1 --2- 172.21.15.61:0/3204054010 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3c8152df0 0x7fb3c81e7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:56.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.128+0000 7fb3ceb63700 1 --2- 172.21.15.61:0/3204054010 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3c81537e0 0x7fb3c81e8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:56.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.128+0000 7fb3ce362700 1 -- 172.21.15.61:0/3204054010 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3c8152df0 msgr2=0x7fb3c81e7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:56.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.128+0000 7fb3ce362700 1 --2- 172.21.15.61:0/3204054010 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3c8152df0 0x7fb3c81e7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:56.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.128+0000 7fb3ce362700 1 -- 172.21.15.61:0/3204054010 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3c81537e0 msgr2=0x7fb3c81e8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:56.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.128+0000 7fb3ce362700 1 --2- 172.21.15.61:0/3204054010 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3c81537e0 0x7fb3c81e8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:56.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.128+0000 7fb3ce362700 1 -- 172.21.15.61:0/3204054010 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b80094a0 con 0x7fb3c8069360 2023-01-01T17:39:56.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.128+0000 7fb3ceb63700 1 --2- 172.21.15.61:0/3204054010 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3c81537e0 0x7fb3c81e8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-01-01T17:39:56.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.129+0000 7fb3ce362700 1 --2- 172.21.15.61:0/3204054010 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb3c8069360 0x7fb3c80c0630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8009fd0 tx=0x7fb3b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:56.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.129+0000 7fb3beffd700 1 -- 172.21.15.61:0/3204054010 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b80038a0 con 0x7fb3c8069360 2023-01-01T17:39:56.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.129+0000 7fb3beffd700 1 -- 172.21.15.61:0/3204054010 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b801e070 con 0x7fb3c8069360 2023-01-01T17:39:56.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.129+0000 7fb3d05c6700 1 -- 172.21.15.61:0/3204054010 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c80c32b0 con 0x7fb3c8069360 2023-01-01T17:39:56.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.129+0000 7fb3beffd700 1 -- 172.21.15.61:0/3204054010 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8003c40 con 0x7fb3c8069360 2023-01-01T17:39:56.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.129+0000 7fb3d05c6700 1 -- 172.21.15.61:0/3204054010 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c80c5770 con 0x7fb3c8069360 2023-01-01T17:39:56.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.130+0000 7fb3d05c6700 1 -- 172.21.15.61:0/3204054010 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3c8153bb0 con 0x7fb3c8069360 2023-01-01T17:39:56.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.130+0000 7fb3beffd700 1 -- 172.21.15.61:0/3204054010 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7fb3b800f050 con 0x7fb3c8069360 2023-01-01T17:39:56.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.131+0000 7fb3beffd700 1 --2- 172.21.15.61:0/3204054010 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fb3ac063290 0x7fb3ac065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:56.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.131+0000 7fb3beffd700 1 -- 172.21.15.61:0/3204054010 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6781+0+0 (secure 0 0 0) 0x7fb3b8080d20 con 0x7fb3c8069360 2023-01-01T17:39:56.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.131+0000 7fb3cdb61700 1 --2- 172.21.15.61:0/3204054010 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fb3ac063290 0x7fb3ac065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:56.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.131+0000 7fb3cdb61700 1 --2- 172.21.15.61:0/3204054010 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fb3ac063290 0x7fb3ac065740 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb3c40011e0 tx=0x7fb3c4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:56.134 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.135+0000 7fb3beffd700 1 -- 172.21.15.61:0/3204054010 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7fb3b804fb00 con 0x7fb3c8069360 2023-01-01T17:39:56.323 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.324+0000 7fb3d05c6700 1 -- 172.21.15.61:0/3204054010 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fb3c80668a0 con 0x7fb3c8069360 2023-01-01T17:39:56.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.963+0000 7fb3beffd700 1 -- 172.21.15.61:0/3204054010 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb3b80150c0 con 0x7fb3c8069360 2023-01-01T17:39:56.978 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.979+0000 7fb3d05c6700 1 -- 172.21.15.61:0/3204054010 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fb3ac063290 msgr2=0x7fb3ac065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:56.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.979+0000 7fb3d05c6700 1 --2- 172.21.15.61:0/3204054010 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fb3ac063290 0x7fb3ac065740 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb3c40011e0 tx=0x7fb3c4009040 comp rx=0 tx=0).stop 2023-01-01T17:39:56.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.979+0000 7fb3d05c6700 1 -- 172.21.15.61:0/3204054010 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb3c8069360 msgr2=0x7fb3c80c0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:56.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.979+0000 7fb3d05c6700 1 --2- 172.21.15.61:0/3204054010 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb3c8069360 0x7fb3c80c0630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8009fd0 tx=0x7fb3b8004750 comp rx=0 tx=0).stop 2023-01-01T17:39:56.979 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.980+0000 7fb3d05c6700 1 -- 172.21.15.61:0/3204054010 shutdown_connections 2023-01-01T17:39:56.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.980+0000 7fb3d05c6700 1 --2- 172.21.15.61:0/3204054010 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3c81537e0 0x7fb3c81e8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:56.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.980+0000 7fb3d05c6700 1 --2- 172.21.15.61:0/3204054010 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fb3ac063290 0x7fb3ac065740 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:56.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.980+0000 7fb3d05c6700 1 --2- 172.21.15.61:0/3204054010 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb3c8069360 0x7fb3c80c0630 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:56.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.980+0000 7fb3d05c6700 1 --2- 172.21.15.61:0/3204054010 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb3c8152df0 0x7fb3c81e7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:56.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.980+0000 7fb3d05c6700 1 -- 172.21.15.61:0/3204054010 >> 172.21.15.61:0/3204054010 conn(0x7fb3c80a7670 msgr2=0x7fb3c80c2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:56.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.980+0000 7fb3d05c6700 1 -- 172.21.15.61:0/3204054010 shutdown_connections 2023-01-01T17:39:56.980 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:56.980+0000 7fb3d05c6700 1 -- 172.21.15.61:0/3204054010 wait complete. 2023-01-01T17:39:56.993 INFO:teuthology.orchestra.run.smithi061.stderr:set pool 5 allow_ec_overwrites to true 2023-01-01T17:39:57.007 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-01-01T17:39:57.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.138+0000 7f298fe29700 1 Processor -- start 2023-01-01T17:39:57.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.138+0000 7f298fe29700 1 -- start start 2023-01-01T17:39:57.141 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.139+0000 7f298fe29700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f298806cff0 0x7f2988069360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:57.141 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.139+0000 7f298fe29700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f298806aaa0 con 0x7f298814cf50 2023-01-01T17:39:57.141 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.139+0000 7f298fe29700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29880c0930 con 0x7f29880698a0 2023-01-01T17:39:57.141 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.139+0000 7f298fe29700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2988069e90 con 0x7f298806cff0 2023-01-01T17:39:57.141 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.139+0000 7f298dbc5700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f298814cf50 0x7f29880c0220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39860/0 (socket says 172.21.15.61:39860) 2023-01-01T17:39:57.141 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.139+0000 7f298dbc5700 1 -- 172.21.15.61:0/2818303315 learned_addr learned my addr 172.21.15.61:0/2818303315 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:39:57.142 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.140+0000 7f298d3c4700 1 --2- 172.21.15.61:0/2818303315 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f298806cff0 0x7f2988069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:57.142 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.140+0000 7f298cbc3700 1 -- 172.21.15.61:0/2818303315 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4234155223 0 0) 0x7f298806aaa0 con 0x7f298814cf50 2023-01-01T17:39:57.142 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.140+0000 7f298cbc3700 1 -- 172.21.15.61:0/2818303315 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29740035b0 con 0x7f298814cf50 2023-01-01T17:39:57.142 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.140+0000 7f298cbc3700 1 -- 172.21.15.61:0/2818303315 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3201313531 0 0) 0x7f29740035b0 con 0x7f298814cf50 2023-01-01T17:39:57.142 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.140+0000 7f298cbc3700 1 -- 172.21.15.61:0/2818303315 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f298806cff0 msgr2=0x7f2988069360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:57.142 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.140+0000 7f298cbc3700 1 --2- 172.21.15.61:0/2818303315 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f298806cff0 0x7f2988069360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:57.142 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.140+0000 7f298cbc3700 1 -- 172.21.15.61:0/2818303315 >> v1:172.21.15.149:6789/0 conn(0x7f29880698a0 legacy=0x7f2988152ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:57.142 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.140+0000 7f298cbc3700 1 -- 172.21.15.61:0/2818303315 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298806a170 con 0x7f298814cf50 2023-01-01T17:39:57.142 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.140+0000 7f298cbc3700 1 -- 172.21.15.61:0/2818303315 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586489653 0 0) 0x7f2984001670 con 0x7f298814cf50 2023-01-01T17:39:57.142 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.140+0000 7f298cbc3700 1 -- 172.21.15.61:0/2818303315 >> v1:172.21.15.61:6789/0 conn(0x7f298814cf50 legacy=0x7f29880c0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:57.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.140+0000 7f298cbc3700 1 --2- 172.21.15.61:0/2818303315 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f298806cff0 0x7f2974003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:57.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.140+0000 7f298cbc3700 1 --2- 172.21.15.61:0/2818303315 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2974003f70 0x7f2974004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:57.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.140+0000 7f298cbc3700 1 --2- 172.21.15.61:0/2818303315 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2974004d90 0x7f2974005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:57.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.140+0000 7f298cbc3700 1 -- 172.21.15.61:0/2818303315 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2988069e90 con 0x7f2974003f70 2023-01-01T17:39:57.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.140+0000 7f298cbc3700 1 -- 172.21.15.61:0/2818303315 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297400baf0 con 0x7f2974004d90 2023-01-01T17:39:57.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.140+0000 7f298cbc3700 1 -- 172.21.15.61:0/2818303315 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f297400bcb0 con 0x7f298806cff0 2023-01-01T17:39:57.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.140+0000 7f298d3c4700 1 --2- 172.21.15.61:0/2818303315 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2974003f70 0x7f2974004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:57.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.140+0000 7f298dbc5700 1 --2- 172.21.15.61:0/2818303315 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f298806cff0 0x7f2974003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:57.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.140+0000 7f298e3c6700 1 --2- 172.21.15.61:0/2818303315 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2974004d90 0x7f2974005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:57.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.140+0000 7f298d3c4700 1 -- 172.21.15.61:0/2818303315 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f298806cff0 msgr2=0x7f2974003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:57.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.140+0000 7f298d3c4700 1 --2- 172.21.15.61:0/2818303315 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f298806cff0 0x7f2974003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:57.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.140+0000 7f298d3c4700 1 -- 172.21.15.61:0/2818303315 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2974004d90 msgr2=0x7f2974005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:57.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.140+0000 7f298d3c4700 1 --2- 172.21.15.61:0/2818303315 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2974004d90 0x7f2974005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:57.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.140+0000 7f298d3c4700 1 -- 172.21.15.61:0/2818303315 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29740035b0 con 0x7f2974003f70 2023-01-01T17:39:57.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.141+0000 7f298d3c4700 1 --2- 172.21.15.61:0/2818303315 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2974003f70 0x7f2974004850 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f297c009b30 tx=0x7f2974005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aa75797d634841e server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:57.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.141+0000 7f298cbc3700 1 -- 172.21.15.61:0/2818303315 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c00e6c0 con 0x7f2974003f70 2023-01-01T17:39:57.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.141+0000 7f298cbc3700 1 -- 172.21.15.61:0/2818303315 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297c00e820 con 0x7f2974003f70 2023-01-01T17:39:57.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.141+0000 7f298cbc3700 1 -- 172.21.15.61:0/2818303315 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c00eb90 con 0x7f2974003f70 2023-01-01T17:39:57.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.141+0000 7f298fe29700 1 -- 172.21.15.61:0/2818303315 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2974003f70 msgr2=0x7f2974004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:57.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.141+0000 7f298fe29700 1 --2- 172.21.15.61:0/2818303315 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2974003f70 0x7f2974004850 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f297c009b30 tx=0x7f2974005880 comp rx=0 tx=0).stop 2023-01-01T17:39:57.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.141+0000 7f298e3c6700 1 -- 172.21.15.61:0/2818303315 reap_dead start 2023-01-01T17:39:57.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.141+0000 7f298fe29700 1 -- 172.21.15.61:0/2818303315 shutdown_connections 2023-01-01T17:39:57.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.141+0000 7f298fe29700 1 -- 172.21.15.61:0/2818303315 >> 172.21.15.61:0/2818303315 conn(0x7f29880c1e80 msgr2=0x7f29880c2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:57.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.141+0000 7f298fe29700 1 -- 172.21.15.61:0/2818303315 shutdown_connections 2023-01-01T17:39:57.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.141+0000 7f298fe29700 1 -- 172.21.15.61:0/2818303315 wait complete. 2023-01-01T17:39:57.147 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.143+0000 7f298fe29700 1 Processor -- start 2023-01-01T17:39:57.147 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.143+0000 7f298fe29700 1 -- start start 2023-01-01T17:39:57.147 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.143+0000 7f298fe29700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2974003f70 0x7f29880c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:57.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.143+0000 7f298fe29700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f298806c080 0x7f298806c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:57.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.143+0000 7f298fe29700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29880a8430 0x7f29880a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:57.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.143+0000 7f298fe29700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29880c4410 con 0x7f298806c080 2023-01-01T17:39:57.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.143+0000 7f298fe29700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29881ec480 con 0x7f29880a8430 2023-01-01T17:39:57.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.143+0000 7f298fe29700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2988142610 con 0x7f2974003f70 2023-01-01T17:39:57.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.143+0000 7f298d3c4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f298806c080 0x7f298806c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:57.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.143+0000 7f298d3c4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f298806c080 0x7f298806c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46024/0 (socket says 172.21.15.61:46024) 2023-01-01T17:39:57.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.143+0000 7f298d3c4700 1 -- 172.21.15.61:0/2377456084 learned_addr learned my addr 172.21.15.61:0/2377456084 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:57.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.144+0000 7f298dbc5700 1 --2- 172.21.15.61:0/2377456084 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2974003f70 0x7f29880c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:57.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.144+0000 7f298e3c6700 1 --2- 172.21.15.61:0/2377456084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29880a8430 0x7f29880a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:57.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.144+0000 7f298d3c4700 1 -- 172.21.15.61:0/2377456084 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2974003f70 msgr2=0x7f29880c3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:57.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.144+0000 7f298d3c4700 1 --2- 172.21.15.61:0/2377456084 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2974003f70 0x7f29880c3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:57.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.144+0000 7f298d3c4700 1 -- 172.21.15.61:0/2377456084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29880a8430 msgr2=0x7f29880a88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:57.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.144+0000 7f298d3c4700 1 --2- 172.21.15.61:0/2377456084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29880a8430 0x7f29880a88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:57.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.144+0000 7f298d3c4700 1 -- 172.21.15.61:0/2377456084 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298806a730 con 0x7f298806c080 2023-01-01T17:39:57.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.144+0000 7f298e3c6700 1 --2- 172.21.15.61:0/2377456084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29880a8430 0x7f29880a88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-01T17:39:57.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.144+0000 7f298d3c4700 1 --2- 172.21.15.61:0/2377456084 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f298806c080 0x7f298806c4f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f297c00e4b0 tx=0x7f297c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:57.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.144+0000 7f297a7fc700 1 -- 172.21.15.61:0/2377456084 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c00e6c0 con 0x7f298806c080 2023-01-01T17:39:57.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.144+0000 7f297a7fc700 1 -- 172.21.15.61:0/2377456084 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297c0038c0 con 0x7f298806c080 2023-01-01T17:39:57.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.144+0000 7f298fe29700 1 -- 172.21.15.61:0/2377456084 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f298806a450 con 0x7f298806c080 2023-01-01T17:39:57.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.144+0000 7f297a7fc700 1 -- 172.21.15.61:0/2377456084 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c003c70 con 0x7f298806c080 2023-01-01T17:39:57.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.144+0000 7f298fe29700 1 -- 172.21.15.61:0/2377456084 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2988069360 con 0x7f298806c080 2023-01-01T17:39:57.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.145+0000 7f298fe29700 1 -- 172.21.15.61:0/2377456084 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29880668a0 con 0x7f298806c080 2023-01-01T17:39:57.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.145+0000 7f297a7fc700 1 -- 172.21.15.61:0/2377456084 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f297c019030 con 0x7f298806c080 2023-01-01T17:39:57.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.146+0000 7f297a7fc700 1 --2- 172.21.15.61:0/2377456084 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f296c063290 0x7f296c065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:57.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.146+0000 7f297a7fc700 1 -- 172.21.15.61:0/2377456084 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f297c081370 con 0x7f298806c080 2023-01-01T17:39:57.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.146+0000 7f298dbc5700 1 --2- 172.21.15.61:0/2377456084 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f296c063290 0x7f296c065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:57.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.146+0000 7f298dbc5700 1 --2- 172.21.15.61:0/2377456084 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f296c063290 0x7f296c065740 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2984001eb0 tx=0x7f2984000f80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:57.150 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.150+0000 7f297a7fc700 1 -- 172.21.15.61:0/2377456084 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f297c050150 con 0x7f298806c080 2023-01-01T17:39:57.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.386+0000 7f298fe29700 1 -- 172.21.15.61:0/2377456084 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f298806cd40 con 0x7f298806c080 2023-01-01T17:39:57.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.393+0000 7f297a7fc700 1 -- 172.21.15.61:0/2377456084 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f297c053770 con 0x7f298806c080 2023-01-01T17:39:57.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.395+0000 7f298fe29700 1 -- 172.21.15.61:0/2377456084 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f296c063290 msgr2=0x7f296c065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:57.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.395+0000 7f298fe29700 1 --2- 172.21.15.61:0/2377456084 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f296c063290 0x7f296c065740 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2984001eb0 tx=0x7f2984000f80 comp rx=0 tx=0).stop 2023-01-01T17:39:57.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.395+0000 7f298fe29700 1 -- 172.21.15.61:0/2377456084 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f298806c080 msgr2=0x7f298806c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:57.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.395+0000 7f298fe29700 1 --2- 172.21.15.61:0/2377456084 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f298806c080 0x7f298806c4f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f297c00e4b0 tx=0x7f297c0047c0 comp rx=0 tx=0).stop 2023-01-01T17:39:57.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.395+0000 7f298fe29700 1 -- 172.21.15.61:0/2377456084 shutdown_connections 2023-01-01T17:39:57.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.395+0000 7f298fe29700 1 --2- 172.21.15.61:0/2377456084 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29880a8430 0x7f29880a88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:57.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.395+0000 7f298fe29700 1 --2- 172.21.15.61:0/2377456084 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2974003f70 0x7f29880c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:57.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.395+0000 7f298fe29700 1 --2- 172.21.15.61:0/2377456084 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f296c063290 0x7f296c065740 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:57.396 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.395+0000 7f298fe29700 1 --2- 172.21.15.61:0/2377456084 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f298806c080 0x7f298806c4f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:57.396 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.395+0000 7f298fe29700 1 -- 172.21.15.61:0/2377456084 >> 172.21.15.61:0/2377456084 conn(0x7f29880c1e80 msgr2=0x7f2988145680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:57.396 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.395+0000 7f298fe29700 1 -- 172.21.15.61:0/2377456084 shutdown_connections 2023-01-01T17:39:57.396 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.395+0000 7f298fe29700 1 -- 172.21.15.61:0/2377456084 wait complete. 2023-01-01T17:39:57.396 INFO:teuthology.orchestra.run.smithi061.stderr:added data pool 5 to fsmap 2023-01-01T17:39:57.407 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-01-01T17:39:57.445 INFO:tasks.ceph.mds.a.smithi061.stderr:2023-01-01T17:39:57.446+0000 7fa2cd52e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-01-01T17:39:57.533 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.534+0000 7f44a58e8700 1 Processor -- start 2023-01-01T17:39:57.533 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.534+0000 7f44a58e8700 1 -- start start 2023-01-01T17:39:57.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.534+0000 7f44a58e8700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f44a00c4bf0 0x7f44a0151470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:57.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.534+0000 7f44a58e8700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44a00a5ef0 0x7f44a00c3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:57.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.534+0000 7f44a58e8700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a00c46a0 con 0x7f44a014e170 2023-01-01T17:39:57.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.534+0000 7f44a58e8700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44a01519b0 con 0x7f44a00c4bf0 2023-01-01T17:39:57.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.534+0000 7f44a58e8700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a00c6450 con 0x7f44a00a5ef0 2023-01-01T17:39:57.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.534+0000 7f449e7fc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f44a00c4bf0 0x7f44a0151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:57.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.535+0000 7f449e7fc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f44a00c4bf0 0x7f44a0151470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46032/0 (socket says 172.21.15.61:46032) 2023-01-01T17:39:57.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.535+0000 7f449e7fc700 1 -- 172.21.15.61:0/1776193881 learned_addr learned my addr 172.21.15.61:0/1776193881 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:57.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.535+0000 7f449f7fe700 1 --2- 172.21.15.61:0/1776193881 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44a00a5ef0 0x7f44a00c3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:57.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.535+0000 7f449e7fc700 1 -- 172.21.15.61:0/1776193881 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44a00a5ef0 msgr2=0x7f44a00c3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:57.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.535+0000 7f449e7fc700 1 --2- 172.21.15.61:0/1776193881 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44a00a5ef0 0x7f44a00c3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:57.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.535+0000 7f449e7fc700 1 -- 172.21.15.61:0/1776193881 >> v1:172.21.15.149:6789/0 conn(0x7f44a014e170 legacy=0x7f44a00bd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:57.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.535+0000 7f449e7fc700 1 -- 172.21.15.61:0/1776193881 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a00c6730 con 0x7f44a00c4bf0 2023-01-01T17:39:57.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.535+0000 7f449f7fe700 1 --2- 172.21.15.61:0/1776193881 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44a00a5ef0 0x7f44a00c3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-01T17:39:57.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.535+0000 7f449e7fc700 1 --2- 172.21.15.61:0/1776193881 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f44a00c4bf0 0x7f44a0151470 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f44940098f0 tx=0x7f4494009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44eb7f5a6e3f6cf4 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:57.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.535+0000 7f449dffb700 1 -- 172.21.15.61:0/1776193881 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449400b8a0 con 0x7f44a00c4bf0 2023-01-01T17:39:57.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.535+0000 7f449dffb700 1 -- 172.21.15.61:0/1776193881 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449400ba00 con 0x7f44a00c4bf0 2023-01-01T17:39:57.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.535+0000 7f449dffb700 1 -- 172.21.15.61:0/1776193881 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449400bd90 con 0x7f44a00c4bf0 2023-01-01T17:39:57.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.536+0000 7f44a58e8700 1 -- 172.21.15.61:0/1776193881 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f44a00c4bf0 msgr2=0x7f44a0151470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:57.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.536+0000 7f44a58e8700 1 --2- 172.21.15.61:0/1776193881 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f44a00c4bf0 0x7f44a0151470 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f44940098f0 tx=0x7f4494009c00 comp rx=0 tx=0).stop 2023-01-01T17:39:57.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.536+0000 7f44a58e8700 1 -- 172.21.15.61:0/1776193881 shutdown_connections 2023-01-01T17:39:57.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.536+0000 7f44a58e8700 1 --2- 172.21.15.61:0/1776193881 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44a00a5ef0 0x7f44a00c3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:57.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.536+0000 7f44a58e8700 1 --2- 172.21.15.61:0/1776193881 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f44a00c4bf0 0x7f44a0151470 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:57.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.536+0000 7f44a58e8700 1 -- 172.21.15.61:0/1776193881 >> 172.21.15.61:0/1776193881 conn(0x7f44a00a8900 msgr2=0x7f44a00a8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:57.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.536+0000 7f44a58e8700 1 -- 172.21.15.61:0/1776193881 shutdown_connections 2023-01-01T17:39:57.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.536+0000 7f44a58e8700 1 -- 172.21.15.61:0/1776193881 wait complete. 2023-01-01T17:39:57.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.537+0000 7f44a58e8700 1 Processor -- start 2023-01-01T17:39:57.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.537+0000 7f44a58e8700 1 -- start start 2023-01-01T17:39:57.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.538+0000 7f44a58e8700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f44a00a5ef0 0x7f44a006b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:57.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.538+0000 7f44a58e8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44a00c4bf0 0x7f44a01eb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:57.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.538+0000 7f44a58e8700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44a014e170 0x7f44a01ebf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:57.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.538+0000 7f44a58e8700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a00a5be0 con 0x7f44a00a5ef0 2023-01-01T17:39:57.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.538+0000 7f44a58e8700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a00aa090 con 0x7f44a00c4bf0 2023-01-01T17:39:57.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.538+0000 7f44a58e8700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a01ec500 con 0x7f44a014e170 2023-01-01T17:39:57.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.538+0000 7f449effd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f44a00a5ef0 0x7f44a006b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:57.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.538+0000 7f449effd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f44a00a5ef0 0x7f44a006b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46036/0 (socket says 172.21.15.61:46036) 2023-01-01T17:39:57.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.538+0000 7f449effd700 1 -- 172.21.15.61:0/858503147 learned_addr learned my addr 172.21.15.61:0/858503147 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:57.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.538+0000 7f449f7fe700 1 --2- 172.21.15.61:0/858503147 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44a014e170 0x7f44a01ebf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:57.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.538+0000 7f449e7fc700 1 --2- 172.21.15.61:0/858503147 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44a00c4bf0 0x7f44a01eb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:57.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.538+0000 7f449effd700 1 -- 172.21.15.61:0/858503147 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44a014e170 msgr2=0x7f44a01ebf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:57.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.538+0000 7f449effd700 1 --2- 172.21.15.61:0/858503147 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44a014e170 0x7f44a01ebf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:57.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.538+0000 7f449effd700 1 -- 172.21.15.61:0/858503147 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44a00c4bf0 msgr2=0x7f44a01eb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:57.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.538+0000 7f449effd700 1 --2- 172.21.15.61:0/858503147 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44a00c4bf0 0x7f44a01eb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:57.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.538+0000 7f449effd700 1 -- 172.21.15.61:0/858503147 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4494009550 con 0x7f44a00a5ef0 2023-01-01T17:39:57.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.538+0000 7f449e7fc700 1 --2- 172.21.15.61:0/858503147 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44a00c4bf0 0x7f44a01eb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-01T17:39:57.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.539+0000 7f449effd700 1 --2- 172.21.15.61:0/858503147 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f44a00a5ef0 0x7f44a006b720 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f449000c450 tx=0x7f449000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:57.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.539+0000 7f4487fff700 1 -- 172.21.15.61:0/858503147 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44900052d0 con 0x7f44a00a5ef0 2023-01-01T17:39:57.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.539+0000 7f4487fff700 1 -- 172.21.15.61:0/858503147 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4490005430 con 0x7f44a00a5ef0 2023-01-01T17:39:57.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.539+0000 7f44a58e8700 1 -- 172.21.15.61:0/858503147 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a00bcb80 con 0x7f44a00a5ef0 2023-01-01T17:39:57.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.539+0000 7f4487fff700 1 -- 172.21.15.61:0/858503147 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44900038c0 con 0x7f44a00a5ef0 2023-01-01T17:39:57.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.539+0000 7f44a58e8700 1 -- 172.21.15.61:0/858503147 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a00c6a10 con 0x7f44a00a5ef0 2023-01-01T17:39:57.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.540+0000 7f44a58e8700 1 -- 172.21.15.61:0/858503147 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44a00bce60 con 0x7f44a00a5ef0 2023-01-01T17:39:57.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.540+0000 7f4487fff700 1 -- 172.21.15.61:0/858503147 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f4490019030 con 0x7f44a00a5ef0 2023-01-01T17:39:57.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.540+0000 7f4487fff700 1 --2- 172.21.15.61:0/858503147 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f448c0632c0 0x7f448c065770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:57.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.541+0000 7f4487fff700 1 -- 172.21.15.61:0/858503147 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f449007f000 con 0x7f44a00a5ef0 2023-01-01T17:39:57.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.541+0000 7f449e7fc700 1 --2- 172.21.15.61:0/858503147 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f448c0632c0 0x7f448c065770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:57.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.541+0000 7f449e7fc700 1 --2- 172.21.15.61:0/858503147 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f448c0632c0 0x7f448c065770 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4494009c40 tx=0x7f4494008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:57.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.545+0000 7f4487fff700 1 -- 172.21.15.61:0/858503147 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f449004ddc0 con 0x7f44a00a5ef0 2023-01-01T17:39:57.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.776+0000 7f44a58e8700 1 -- 172.21.15.61:0/858503147 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44a0066190 con 0x7f44a00a5ef0 2023-01-01T17:39:57.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.776+0000 7f4487fff700 1 -- 172.21.15.61:0/858503147 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4634 (secure 0 0 0) 0x7f44900513e0 con 0x7f44a00a5ef0 2023-01-01T17:39:57.776 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:57.776 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/671276443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":671276443},{"type":"v1","addr":"172.21.15.149:6835","nonce":671276443}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6836/1287782466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6834","nonce":1287782466},{"type":"v1","addr":"172.21.15.61:6836","nonce":1287782466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/594691675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":594691675},{"type":"v1","addr":"172.21.15.149:6833","nonce":594691675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-01-01T17:39:52.938920+0000","modified":"2023-01-01T17:39:57.387114+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6837/426398173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6835","nonce":426398173},{"type":"v1","addr":"172.21.15.61:6837","nonce":426398173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-01-01T17:39:57.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.778+0000 7f44a58e8700 1 -- 172.21.15.61:0/858503147 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f448c0632c0 msgr2=0x7f448c065770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:57.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.778+0000 7f44a58e8700 1 --2- 172.21.15.61:0/858503147 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f448c0632c0 0x7f448c065770 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4494009c40 tx=0x7f4494008030 comp rx=0 tx=0).stop 2023-01-01T17:39:57.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.778+0000 7f44a58e8700 1 -- 172.21.15.61:0/858503147 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f44a00a5ef0 msgr2=0x7f44a006b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:57.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.778+0000 7f44a58e8700 1 --2- 172.21.15.61:0/858503147 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f44a00a5ef0 0x7f44a006b720 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f449000c450 tx=0x7f449000c760 comp rx=0 tx=0).stop 2023-01-01T17:39:57.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.778+0000 7f44a58e8700 1 -- 172.21.15.61:0/858503147 shutdown_connections 2023-01-01T17:39:57.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.778+0000 7f44a58e8700 1 --2- 172.21.15.61:0/858503147 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44a014e170 0x7f44a01ebf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:57.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.778+0000 7f44a58e8700 1 --2- 172.21.15.61:0/858503147 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f448c0632c0 0x7f448c065770 secure :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4494009c40 tx=0x7f4494008030 comp rx=0 tx=0).stop 2023-01-01T17:39:57.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.778+0000 7f44a58e8700 1 --2- 172.21.15.61:0/858503147 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f44a00a5ef0 0x7f44a006b720 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:57.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.778+0000 7f44a58e8700 1 --2- 172.21.15.61:0/858503147 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44a00c4bf0 0x7f44a01eb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:57.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.778+0000 7f44a58e8700 1 -- 172.21.15.61:0/858503147 >> 172.21.15.61:0/858503147 conn(0x7f44a00a8900 msgr2=0x7f44a00c5030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:57.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.778+0000 7f44a58e8700 1 -- 172.21.15.61:0/858503147 shutdown_connections 2023-01-01T17:39:57.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.778+0000 7f44a58e8700 1 -- 172.21.15.61:0/858503147 wait complete. 2023-01-01T17:39:57.779 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 7 2023-01-01T17:39:57.791 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-01T17:39:57.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.956+0000 7fc7b6501700 1 Processor -- start 2023-01-01T17:39:57.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.956+0000 7fc7b6501700 1 -- start start 2023-01-01T17:39:57.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.956+0000 7fc7b6501700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc7b00c3c80 0x7fc7b00c10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:57.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.956+0000 7fc7b6501700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fc7b0070390 0x7fc7b0069360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:57.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.956+0000 7fc7b6501700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b00709b0 con 0x7fc7b0153db0 2023-01-01T17:39:57.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.956+0000 7fc7b6501700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b0071250 con 0x7fc7b0070390 2023-01-01T17:39:57.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.956+0000 7fc7b6501700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b0156800 con 0x7fc7b00c3c80 2023-01-01T17:39:57.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.956+0000 7fc7b4a9e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fc7b0070390 0x7fc7b0069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:57.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.957+0000 7fc7b4a9e700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fc7b0070390 0x7fc7b0069360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46048/0 (socket says 172.21.15.61:46048) 2023-01-01T17:39:57.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.957+0000 7fc7b4a9e700 1 -- 172.21.15.61:0/1998060385 learned_addr learned my addr 172.21.15.61:0/1998060385 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:57.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.957+0000 7fc7af7fe700 1 --2- 172.21.15.61:0/1998060385 >> v2:172.21.15.149:3300/0 conn(0x7fc7b00c3c80 0x7fc7b00c10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:57.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.957+0000 7fc7b4a9e700 1 -- 172.21.15.61:0/1998060385 >> v2:172.21.15.149:3300/0 conn(0x7fc7b00c3c80 msgr2=0x7fc7b00c10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:57.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.957+0000 7fc7b4a9e700 1 --2- 172.21.15.61:0/1998060385 >> v2:172.21.15.149:3300/0 conn(0x7fc7b00c3c80 0x7fc7b00c10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:57.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.957+0000 7fc7b4a9e700 1 -- 172.21.15.61:0/1998060385 >> v1:172.21.15.149:6789/0 conn(0x7fc7b0153db0 legacy=0x7fc7b0156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:57.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.957+0000 7fc7b4a9e700 1 -- 172.21.15.61:0/1998060385 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b0070c90 con 0x7fc7b0070390 2023-01-01T17:39:57.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.957+0000 7fc7b4a9e700 1 --2- 172.21.15.61:0/1998060385 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc7b0070390 0x7fc7b0069360 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc7b00c3830 tx=0x7fc7a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c16626092d27eb1 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:57.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.957+0000 7fc7aeffd700 1 -- 172.21.15.61:0/1998060385 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a800e070 con 0x7fc7b0070390 2023-01-01T17:39:57.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.957+0000 7fc7aeffd700 1 -- 172.21.15.61:0/1998060385 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a800b910 con 0x7fc7b0070390 2023-01-01T17:39:57.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.957+0000 7fc7aeffd700 1 -- 172.21.15.61:0/1998060385 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a800bcc0 con 0x7fc7b0070390 2023-01-01T17:39:57.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.958+0000 7fc7b6501700 1 -- 172.21.15.61:0/1998060385 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc7b0070390 msgr2=0x7fc7b0069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:57.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.958+0000 7fc7b6501700 1 --2- 172.21.15.61:0/1998060385 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc7b0070390 0x7fc7b0069360 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc7b00c3830 tx=0x7fc7a800b330 comp rx=0 tx=0).stop 2023-01-01T17:39:57.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.958+0000 7fc7b6501700 1 -- 172.21.15.61:0/1998060385 shutdown_connections 2023-01-01T17:39:57.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.958+0000 7fc7b6501700 1 --2- 172.21.15.61:0/1998060385 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc7b0070390 0x7fc7b0069360 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:57.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.958+0000 7fc7b6501700 1 --2- 172.21.15.61:0/1998060385 >> v2:172.21.15.149:3300/0 conn(0x7fc7b00c3c80 0x7fc7b00c10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:57.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.958+0000 7fc7b6501700 1 -- 172.21.15.61:0/1998060385 >> 172.21.15.61:0/1998060385 conn(0x7fc7b006b100 msgr2=0x7fc7b00c5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:57.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.958+0000 7fc7b6501700 1 -- 172.21.15.61:0/1998060385 shutdown_connections 2023-01-01T17:39:57.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.958+0000 7fc7b6501700 1 -- 172.21.15.61:0/1998060385 wait complete. 2023-01-01T17:39:57.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.959+0000 7fc7b6501700 1 Processor -- start 2023-01-01T17:39:57.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.959+0000 7fc7b6501700 1 -- start start 2023-01-01T17:39:57.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.960+0000 7fc7b6501700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7b0070390 0x7fc7b00bf560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:57.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.960+0000 7fc7b6501700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc7b00c3c80 0x7fc7b0152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:57.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.960+0000 7fc7b6501700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc7b0153db0 0x7fc7b00a6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:57.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.960+0000 7fc7b6501700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b00a86c0 con 0x7fc7b0153db0 2023-01-01T17:39:57.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.960+0000 7fc7b6501700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b00bfaa0 con 0x7fc7b0070390 2023-01-01T17:39:57.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.960+0000 7fc7b6501700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b00a8120 con 0x7fc7b00c3c80 2023-01-01T17:39:57.962 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.960+0000 7fc7b4a9e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc7b0153db0 0x7fc7b00a6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:57.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.960+0000 7fc7b4a9e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc7b0153db0 0x7fc7b00a6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46054/0 (socket says 172.21.15.61:46054) 2023-01-01T17:39:57.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.960+0000 7fc7b4a9e700 1 -- 172.21.15.61:0/3664125017 learned_addr learned my addr 172.21.15.61:0/3664125017 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:57.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.960+0000 7fc7af7fe700 1 --2- 172.21.15.61:0/3664125017 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc7b00c3c80 0x7fc7b0152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:57.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.960+0000 7fc7affff700 1 --2- 172.21.15.61:0/3664125017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7b0070390 0x7fc7b00bf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:57.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.960+0000 7fc7b4a9e700 1 -- 172.21.15.61:0/3664125017 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc7b00c3c80 msgr2=0x7fc7b0152730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:57.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.960+0000 7fc7b4a9e700 1 --2- 172.21.15.61:0/3664125017 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc7b00c3c80 0x7fc7b0152730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:57.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.960+0000 7fc7b4a9e700 1 -- 172.21.15.61:0/3664125017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7b0070390 msgr2=0x7fc7b00bf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:57.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.960+0000 7fc7b4a9e700 1 --2- 172.21.15.61:0/3664125017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7b0070390 0x7fc7b00bf560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:57.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.960+0000 7fc7b4a9e700 1 -- 172.21.15.61:0/3664125017 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a8009b30 con 0x7fc7b0153db0 2023-01-01T17:39:57.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.960+0000 7fc7b4a9e700 1 --2- 172.21.15.61:0/3664125017 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc7b0153db0 0x7fc7b00a6cc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc7b006a0c0 tx=0x7fc7a8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:57.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.960+0000 7fc7acff9700 1 -- 172.21.15.61:0/3664125017 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a8004880 con 0x7fc7b0153db0 2023-01-01T17:39:57.963 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.960+0000 7fc7acff9700 1 -- 172.21.15.61:0/3664125017 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a80099b0 con 0x7fc7b0153db0 2023-01-01T17:39:57.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.960+0000 7fc7b6501700 1 -- 172.21.15.61:0/3664125017 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b01569f0 con 0x7fc7b0153db0 2023-01-01T17:39:57.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.960+0000 7fc7acff9700 1 -- 172.21.15.61:0/3664125017 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a801c680 con 0x7fc7b0153db0 2023-01-01T17:39:57.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.961+0000 7fc7b6501700 1 -- 172.21.15.61:0/3664125017 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b0070f70 con 0x7fc7b0153db0 2023-01-01T17:39:57.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.961+0000 7fc7b6501700 1 -- 172.21.15.61:0/3664125017 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b00b95a0 con 0x7fc7b0153db0 2023-01-01T17:39:57.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.962+0000 7fc7acff9700 1 -- 172.21.15.61:0/3664125017 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7fc7a8022030 con 0x7fc7b0153db0 2023-01-01T17:39:57.964 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.962+0000 7fc7acff9700 1 --2- 172.21.15.61:0/3664125017 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fc79c063290 0x7fc79c065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:57.965 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.962+0000 7fc7acff9700 1 -- 172.21.15.61:0/3664125017 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc7a80814e0 con 0x7fc7b0153db0 2023-01-01T17:39:57.965 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.962+0000 7fc7affff700 1 --2- 172.21.15.61:0/3664125017 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fc79c063290 0x7fc79c065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:57.965 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.963+0000 7fc7affff700 1 --2- 172.21.15.61:0/3664125017 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fc79c063290 0x7fc79c065740 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0007fd0 tx=0x7fc7a0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:57.966 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:57.966+0000 7fc7acff9700 1 -- 172.21.15.61:0/3664125017 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7fc7a80502a0 con 0x7fc7b0153db0 2023-01-01T17:39:58.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.159+0000 7fc7b6501700 1 -- 172.21.15.61:0/3664125017 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7b00668a0 con 0x7fc7b0153db0 2023-01-01T17:39:58.160 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.160+0000 7fc7acff9700 1 -- 172.21.15.61:0/3664125017 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18729 (secure 0 0 0) 0x7fc7a80538c0 con 0x7fc7b0153db0 2023-01-01T17:39:58.161 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:58.161 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":24,"fsid":"fe0d3d8e-46ee-4ed9-92f8-749741721d01","created":"2023-01-01T17:39:34.752404+0000","modified":"2023-01-01T17:39:57.386830+0000","last_up_change":"2023-01-01T17:39:45.159720+0000","last_in_change":"2023-01-01T17:39:37.293057+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-01-01T17:39:46.110776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-01-01T17:39:46.276625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-01-01T17:39:50.568073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-01-01T17:39:51.915351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-01-01T17:39:54.992107+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5ba13bcd-4407-4cfd-8487-80917501e525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":94349},{"type":"v1","addr":"172.21.15.61:6825","nonce":94349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":94349},{"type":"v1","addr":"172.21.15.61:6827","nonce":94349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":94349},{"type":"v1","addr":"172.21.15.61:6831","nonce":94349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":94349},{"type":"v1","addr":"172.21.15.61:6829","nonce":94349}]},"public_addr":"172.21.15.61:6825/94349","cluster_addr":"172.21.15.61:6827/94349","heartbeat_back_addr":"172.21.15.61:6831/94349","heartbeat_front_addr":"172.21.15.61:6829/94349","state":["exists","up"]},{"osd":1,"uuid":"7dca9f34-ea22-4894-b238-5606b16b9c74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6811","nonce":94348},{"type":"v1","addr":"172.21.15.61:6813","nonce":94348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":94348},{"type":"v1","addr":"172.21.15.61:6816","nonce":94348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6821","nonce":94348},{"type":"v1","addr":"172.21.15.61:6823","nonce":94348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":94348},{"type":"v1","addr":"172.21.15.61:6819","nonce":94348}]},"public_addr":"172.21.15.61:6813/94348","cluster_addr":"172.21.15.61:6816/94348","heartbeat_back_addr":"172.21.15.61:6823/94348","heartbeat_front_addr":"172.21.15.61:6819/94348","state":["exists","up"]},{"osd":2,"uuid":"7b43ea06-a7b6-49f4-a390-18ad14dfe4fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":94350},{"type":"v1","addr":"172.21.15.61:6809","nonce":94350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":94350},{"type":"v1","addr":"172.21.15.61:6812","nonce":94350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":94350},{"type":"v1","addr":"172.21.15.61:6822","nonce":94350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6815","nonce":94350},{"type":"v1","addr":"172.21.15.61:6817","nonce":94350}]},"public_addr":"172.21.15.61:6809/94350","cluster_addr":"172.21.15.61:6812/94350","heartbeat_back_addr":"172.21.15.61:6822/94350","heartbeat_front_addr":"172.21.15.61:6817/94350","state":["exists","up"]},{"osd":3,"uuid":"117c41d8-d40c-4cc0-b0e1-70bca058fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":94347},{"type":"v1","addr":"172.21.15.61:6801","nonce":94347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":94347},{"type":"v1","addr":"172.21.15.61:6803","nonce":94347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":94347},{"type":"v1","addr":"172.21.15.61:6807","nonce":94347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":94347},{"type":"v1","addr":"172.21.15.61:6805","nonce":94347}]},"public_addr":"172.21.15.61:6801/94347","cluster_addr":"172.21.15.61:6803/94347","heartbeat_back_addr":"172.21.15.61:6807/94347","heartbeat_front_addr":"172.21.15.61:6805/94347","state":["exists","up"]},{"osd":4,"uuid":"4073e0e8-c5dd-463f-aa1c-c9515ef09976","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":94711},{"type":"v1","addr":"172.21.15.149:6818","nonce":94711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":94711},{"type":"v1","addr":"172.21.15.149:6822","nonce":94711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":94711},{"type":"v1","addr":"172.21.15.149:6830","nonce":94711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":94711},{"type":"v1","addr":"172.21.15.149:6826","nonce":94711}]},"public_addr":"172.21.15.149:6818/94711","cluster_addr":"172.21.15.149:6822/94711","heartbeat_back_addr":"172.21.15.149:6830/94711","heartbeat_front_addr":"172.21.15.149:6826/94711","state":["exists","up"]},{"osd":5,"uuid":"88aa0c0f-e3c1-4dd3-af8c-61f4bc28504e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":94709},{"type":"v1","addr":"172.21.15.149:6809","nonce":94709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":94709},{"type":"v1","addr":"172.21.15.149:6811","nonce":94709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":94709},{"type":"v1","addr":"172.21.15.149:6815","nonce":94709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":94709},{"type":"v1","addr":"172.21.15.149:6813","nonce":94709}]},"public_addr":"172.21.15.149:6809/94709","cluster_addr":"172.21.15.149:6811/94709","heartbeat_back_addr":"172.21.15.149:6815/94709","heartbeat_front_addr":"172.21.15.149:6813/94709","state":["exists","up"]},{"osd":6,"uuid":"8b13fc0c-5f00-41c7-8923-c4570da77afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":94710},{"type":"v1","addr":"172.21.15.149:6801","nonce":94710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":94710},{"type":"v1","addr":"172.21.15.149:6803","nonce":94710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":94710},{"type":"v1","addr":"172.21.15.149:6807","nonce":94710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":94710},{"type":"v1","addr":"172.21.15.149:6805","nonce":94710}]},"public_addr":"172.21.15.149:6801/94710","cluster_addr":"172.21.15.149:6803/94710","heartbeat_back_addr":"172.21.15.149:6807/94710","heartbeat_front_addr":"172.21.15.149:6805/94710","state":["exists","up"]},{"osd":7,"uuid":"5390c6e5-39e7-4aa6-b73c-642458b2acf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":94734},{"type":"v1","addr":"172.21.15.149:6819","nonce":94734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":94734},{"type":"v1","addr":"172.21.15.149:6823","nonce":94734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":94734},{"type":"v1","addr":"172.21.15.149:6831","nonce":94734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":94734},{"type":"v1","addr":"172.21.15.149:6827","nonce":94734}]},"public_addr":"172.21.15.149:6819/94734","cluster_addr":"172.21.15.149:6823/94734","heartbeat_back_addr":"172.21.15.149:6831/94734","heartbeat_front_addr":"172.21.15.149:6827/94734","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.555826+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.508739+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.515601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.472067+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.535257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.493397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.554910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.552343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-01T17:39:58.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.162+0000 7fc7b6501700 1 -- 172.21.15.61:0/3664125017 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fc79c063290 msgr2=0x7fc79c065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:58.163 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.162+0000 7fc7b6501700 1 --2- 172.21.15.61:0/3664125017 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fc79c063290 0x7fc79c065740 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0007fd0 tx=0x7fc7a0009040 comp rx=0 tx=0).stop 2023-01-01T17:39:58.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.162+0000 7fc7b6501700 1 -- 172.21.15.61:0/3664125017 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc7b0153db0 msgr2=0x7fc7b00a6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:58.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.162+0000 7fc7b6501700 1 --2- 172.21.15.61:0/3664125017 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc7b0153db0 0x7fc7b00a6cc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc7b006a0c0 tx=0x7fc7a8004ad0 comp rx=0 tx=0).stop 2023-01-01T17:39:58.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.162+0000 7fc7b6501700 1 -- 172.21.15.61:0/3664125017 shutdown_connections 2023-01-01T17:39:58.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.162+0000 7fc7b6501700 1 --2- 172.21.15.61:0/3664125017 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fc79c063290 0x7fc79c065740 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:58.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.162+0000 7fc7b6501700 1 --2- 172.21.15.61:0/3664125017 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc7b0153db0 0x7fc7b00a6cc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:58.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.162+0000 7fc7b6501700 1 --2- 172.21.15.61:0/3664125017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7b0070390 0x7fc7b00bf560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:58.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.162+0000 7fc7b6501700 1 --2- 172.21.15.61:0/3664125017 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc7b00c3c80 0x7fc7b0152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:58.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.162+0000 7fc7b6501700 1 -- 172.21.15.61:0/3664125017 >> 172.21.15.61:0/3664125017 conn(0x7fc7b006b100 msgr2=0x7fc7b006d590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:58.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.162+0000 7fc7b6501700 1 -- 172.21.15.61:0/3664125017 shutdown_connections 2023-01-01T17:39:58.164 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.162+0000 7fc7b6501700 1 -- 172.21.15.61:0/3664125017 wait complete. 2023-01-01T17:39:58.174 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-01T17:39:58.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.299+0000 7f21cbc3d700 1 Processor -- start 2023-01-01T17:39:58.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.299+0000 7f21cbc3d700 1 -- start start 2023-01-01T17:39:58.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.300+0000 7f21cbc3d700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21c40c15c0 0x7f21c41515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:58.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.300+0000 7f21cbc3d700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c4147ab0 con 0x7f21c4071440 2023-01-01T17:39:58.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.300+0000 7f21cbc3d700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c406d510 con 0x7f21c406c980 2023-01-01T17:39:58.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.300+0000 7f21cbc3d700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c4151b90 con 0x7f21c40c15c0 2023-01-01T17:39:58.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.300+0000 7f21c99d9700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f21c4071440 0x7f21c406a370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39908/0 (socket says 172.21.15.61:39908) 2023-01-01T17:39:58.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.300+0000 7f21c99d9700 1 -- 172.21.15.61:0/2389074324 learned_addr learned my addr 172.21.15.61:0/2389074324 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:39:58.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.301+0000 7f21c91d8700 1 --2- 172.21.15.61:0/2389074324 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21c40c15c0 0x7f21c41515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:58.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.301+0000 7f21c89d7700 1 -- 172.21.15.61:0/2389074324 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 976276646 0 0) 0x7f21b4001110 con 0x7f21c4071440 2023-01-01T17:39:58.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.301+0000 7f21c89d7700 1 -- 172.21.15.61:0/2389074324 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21b00035b0 con 0x7f21c4071440 2023-01-01T17:39:58.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.301+0000 7f21c89d7700 1 -- 172.21.15.61:0/2389074324 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1470196009 0 0) 0x7f21c406d510 con 0x7f21c406c980 2023-01-01T17:39:58.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.301+0000 7f21c89d7700 1 -- 172.21.15.61:0/2389074324 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21b4001110 con 0x7f21c406c980 2023-01-01T17:39:58.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.301+0000 7f21c89d7700 1 -- 172.21.15.61:0/2389074324 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1587297480 0 0) 0x7f21b00035b0 con 0x7f21c4071440 2023-01-01T17:39:58.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.301+0000 7f21c89d7700 1 -- 172.21.15.61:0/2389074324 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21c40c15c0 msgr2=0x7f21c41515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:58.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.301+0000 7f21c89d7700 1 --2- 172.21.15.61:0/2389074324 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21c40c15c0 0x7f21c41515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:58.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.301+0000 7f21c89d7700 1 -- 172.21.15.61:0/2389074324 >> v1:172.21.15.149:6789/0 conn(0x7f21c406c980 legacy=0x7f21c406ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:58.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.301+0000 7f21c89d7700 1 -- 172.21.15.61:0/2389074324 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c4155080 con 0x7f21c4071440 2023-01-01T17:39:58.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.301+0000 7f21c89d7700 1 -- 172.21.15.61:0/2389074324 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586489653 0 0) 0x7f21b4001800 con 0x7f21c4071440 2023-01-01T17:39:58.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.301+0000 7f21c89d7700 1 -- 172.21.15.61:0/2389074324 >> v1:172.21.15.61:6789/0 conn(0x7f21c4071440 legacy=0x7f21c406a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:58.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.301+0000 7f21c89d7700 1 --2- 172.21.15.61:0/2389074324 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21c40c15c0 0x7f21b0003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:58.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.301+0000 7f21c89d7700 1 --2- 172.21.15.61:0/2389074324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21b0004170 0x7f21b0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:58.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.301+0000 7f21c89d7700 1 --2- 172.21.15.61:0/2389074324 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21b0004d90 0x7f21b0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:58.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.301+0000 7f21c89d7700 1 -- 172.21.15.61:0/2389074324 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c4151b90 con 0x7f21b0004d90 2023-01-01T17:39:58.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.301+0000 7f21c89d7700 1 -- 172.21.15.61:0/2389074324 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b000bb20 con 0x7f21b0004170 2023-01-01T17:39:58.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.301+0000 7f21c89d7700 1 -- 172.21.15.61:0/2389074324 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b000bce0 con 0x7f21c40c15c0 2023-01-01T17:39:58.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.301+0000 7f21ca1da700 1 --2- 172.21.15.61:0/2389074324 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21b0004d90 0x7f21b0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:58.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.301+0000 7f21c91d8700 1 --2- 172.21.15.61:0/2389074324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21b0004170 0x7f21b0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:58.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.301+0000 7f21c99d9700 1 --2- 172.21.15.61:0/2389074324 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21c40c15c0 0x7f21b0003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:58.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.301+0000 7f21ca1da700 1 -- 172.21.15.61:0/2389074324 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21c40c15c0 msgr2=0x7f21b0003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:58.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.301+0000 7f21ca1da700 1 --2- 172.21.15.61:0/2389074324 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21c40c15c0 0x7f21b0003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:58.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.301+0000 7f21ca1da700 1 -- 172.21.15.61:0/2389074324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21b0004170 msgr2=0x7f21b0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:58.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.301+0000 7f21ca1da700 1 --2- 172.21.15.61:0/2389074324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21b0004170 0x7f21b0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:58.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.301+0000 7f21ca1da700 1 -- 172.21.15.61:0/2389074324 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b00035b0 con 0x7f21b0004d90 2023-01-01T17:39:58.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.302+0000 7f21ca1da700 1 --2- 172.21.15.61:0/2389074324 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21b0004d90 0x7f21b0005200 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00c2f0 tx=0x7f21b0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c954ed0327d86adf server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:58.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.302+0000 7f21c89d7700 1 -- 172.21.15.61:0/2389074324 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc001f30 con 0x7f21b0004d90 2023-01-01T17:39:58.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.302+0000 7f21c89d7700 1 -- 172.21.15.61:0/2389074324 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21bc00ce90 con 0x7f21b0004d90 2023-01-01T17:39:58.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.302+0000 7f21c89d7700 1 -- 172.21.15.61:0/2389074324 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc003c40 con 0x7f21b0004d90 2023-01-01T17:39:58.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.302+0000 7f21cbc3d700 1 -- 172.21.15.61:0/2389074324 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21b0004d90 msgr2=0x7f21b0005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:58.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.302+0000 7f21cbc3d700 1 --2- 172.21.15.61:0/2389074324 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21b0004d90 0x7f21b0005200 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00c2f0 tx=0x7f21b0005880 comp rx=0 tx=0).stop 2023-01-01T17:39:58.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.302+0000 7f21ca1da700 1 -- 172.21.15.61:0/2389074324 reap_dead start 2023-01-01T17:39:58.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.302+0000 7f21cbc3d700 1 -- 172.21.15.61:0/2389074324 shutdown_connections 2023-01-01T17:39:58.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.302+0000 7f21cbc3d700 1 -- 172.21.15.61:0/2389074324 >> 172.21.15.61:0/2389074324 conn(0x7f21c40c1f30 msgr2=0x7f21c40c2330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:58.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.302+0000 7f21cbc3d700 1 -- 172.21.15.61:0/2389074324 shutdown_connections 2023-01-01T17:39:58.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.303+0000 7f21cbc3d700 1 -- 172.21.15.61:0/2389074324 wait complete. 2023-01-01T17:39:58.308 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.304+0000 7f21cbc3d700 1 Processor -- start 2023-01-01T17:39:58.308 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.304+0000 7f21cbc3d700 1 -- start start 2023-01-01T17:39:58.308 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.305+0000 7f21cbc3d700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21c40c4b00 0x7f21c41e6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:58.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.305+0000 7f21cbc3d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21c40c4ed0 0x7f21c414e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:58.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.305+0000 7f21cbc3d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21c414ec40 0x7f21c40bd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:58.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.305+0000 7f21cbc3d700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c4152b10 con 0x7f21c414ec40 2023-01-01T17:39:58.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.305+0000 7f21cbc3d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c4151f20 con 0x7f21c40c4ed0 2023-01-01T17:39:58.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.305+0000 7f21cbc3d700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c4152170 con 0x7f21c40c4b00 2023-01-01T17:39:58.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.305+0000 7f21ca1da700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21c414ec40 0x7f21c40bd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:58.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.305+0000 7f21ca1da700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21c414ec40 0x7f21c40bd3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46074/0 (socket says 172.21.15.61:46074) 2023-01-01T17:39:58.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.305+0000 7f21ca1da700 1 -- 172.21.15.61:0/2147100050 learned_addr learned my addr 172.21.15.61:0/2147100050 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:58.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.305+0000 7f21c91d8700 1 --2- 172.21.15.61:0/2147100050 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21c40c4ed0 0x7f21c414e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:58.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.305+0000 7f21c99d9700 1 --2- 172.21.15.61:0/2147100050 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21c40c4b00 0x7f21c41e6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:58.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.305+0000 7f21ca1da700 1 -- 172.21.15.61:0/2147100050 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21c40c4b00 msgr2=0x7f21c41e6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:58.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.305+0000 7f21ca1da700 1 --2- 172.21.15.61:0/2147100050 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21c40c4b00 0x7f21c41e6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:58.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.305+0000 7f21ca1da700 1 -- 172.21.15.61:0/2147100050 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21c40c4ed0 msgr2=0x7f21c414e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:58.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.305+0000 7f21ca1da700 1 --2- 172.21.15.61:0/2147100050 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21c40c4ed0 0x7f21c414e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:58.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.305+0000 7f21ca1da700 1 -- 172.21.15.61:0/2147100050 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c41545a0 con 0x7f21c414ec40 2023-01-01T17:39:58.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.306+0000 7f21ca1da700 1 --2- 172.21.15.61:0/2147100050 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21c414ec40 0x7f21c40bd3a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f21bc015040 tx=0x7f21bc001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:58.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.306+0000 7f21ba7fc700 1 -- 172.21.15.61:0/2147100050 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc0050d0 con 0x7f21c414ec40 2023-01-01T17:39:58.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.306+0000 7f21ba7fc700 1 -- 172.21.15.61:0/2147100050 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21bc005250 con 0x7f21c414ec40 2023-01-01T17:39:58.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.306+0000 7f21cbc3d700 1 -- 172.21.15.61:0/2147100050 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c41542c0 con 0x7f21c414ec40 2023-01-01T17:39:58.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.306+0000 7f21ba7fc700 1 -- 172.21.15.61:0/2147100050 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc005600 con 0x7f21c414ec40 2023-01-01T17:39:58.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.306+0000 7f21cbc3d700 1 -- 172.21.15.61:0/2147100050 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c4154880 con 0x7f21c414ec40 2023-01-01T17:39:58.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.307+0000 7f21cbc3d700 1 -- 172.21.15.61:0/2147100050 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c40668a0 con 0x7f21c414ec40 2023-01-01T17:39:58.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.308+0000 7f21ba7fc700 1 -- 172.21.15.61:0/2147100050 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f21bc02f070 con 0x7f21c414ec40 2023-01-01T17:39:58.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.308+0000 7f21ba7fc700 1 --2- 172.21.15.61:0/2147100050 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f21a8063290 0x7f21a8065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:58.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.308+0000 7f21ba7fc700 1 -- 172.21.15.61:0/2147100050 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f21bc0815d0 con 0x7f21c414ec40 2023-01-01T17:39:58.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.308+0000 7f21c99d9700 1 --2- 172.21.15.61:0/2147100050 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f21a8063290 0x7f21a8065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:58.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.308+0000 7f21c99d9700 1 --2- 172.21.15.61:0/2147100050 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f21a8063290 0x7f21a8065740 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f21b4000c00 tx=0x7f21b4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:58.311 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.312+0000 7f21ba7fc700 1 -- 172.21.15.61:0/2147100050 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f21bc050430 con 0x7f21c414ec40 2023-01-01T17:39:58.392 DEBUG:teuthology.orchestra.run.smithi061:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-01-01T17:39:58.394 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-01-01T17:39:58.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.508+0000 7f21cbc3d700 1 -- 172.21.15.61:0/2147100050 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21c40c1ca0 con 0x7f21c414ec40 2023-01-01T17:39:58.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.509+0000 7f21ba7fc700 1 -- 172.21.15.61:0/2147100050 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18729 (secure 0 0 0) 0x7f21bc002090 con 0x7f21c414ec40 2023-01-01T17:39:58.509 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:58.509 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":24,"fsid":"fe0d3d8e-46ee-4ed9-92f8-749741721d01","created":"2023-01-01T17:39:34.752404+0000","modified":"2023-01-01T17:39:57.386830+0000","last_up_change":"2023-01-01T17:39:45.159720+0000","last_in_change":"2023-01-01T17:39:37.293057+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-01-01T17:39:46.110776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-01-01T17:39:46.276625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-01-01T17:39:50.568073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-01-01T17:39:51.915351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-01-01T17:39:54.992107+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5ba13bcd-4407-4cfd-8487-80917501e525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":94349},{"type":"v1","addr":"172.21.15.61:6825","nonce":94349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":94349},{"type":"v1","addr":"172.21.15.61:6827","nonce":94349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":94349},{"type":"v1","addr":"172.21.15.61:6831","nonce":94349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":94349},{"type":"v1","addr":"172.21.15.61:6829","nonce":94349}]},"public_addr":"172.21.15.61:6825/94349","cluster_addr":"172.21.15.61:6827/94349","heartbeat_back_addr":"172.21.15.61:6831/94349","heartbeat_front_addr":"172.21.15.61:6829/94349","state":["exists","up"]},{"osd":1,"uuid":"7dca9f34-ea22-4894-b238-5606b16b9c74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6811","nonce":94348},{"type":"v1","addr":"172.21.15.61:6813","nonce":94348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":94348},{"type":"v1","addr":"172.21.15.61:6816","nonce":94348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6821","nonce":94348},{"type":"v1","addr":"172.21.15.61:6823","nonce":94348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":94348},{"type":"v1","addr":"172.21.15.61:6819","nonce":94348}]},"public_addr":"172.21.15.61:6813/94348","cluster_addr":"172.21.15.61:6816/94348","heartbeat_back_addr":"172.21.15.61:6823/94348","heartbeat_front_addr":"172.21.15.61:6819/94348","state":["exists","up"]},{"osd":2,"uuid":"7b43ea06-a7b6-49f4-a390-18ad14dfe4fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":94350},{"type":"v1","addr":"172.21.15.61:6809","nonce":94350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":94350},{"type":"v1","addr":"172.21.15.61:6812","nonce":94350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":94350},{"type":"v1","addr":"172.21.15.61:6822","nonce":94350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6815","nonce":94350},{"type":"v1","addr":"172.21.15.61:6817","nonce":94350}]},"public_addr":"172.21.15.61:6809/94350","cluster_addr":"172.21.15.61:6812/94350","heartbeat_back_addr":"172.21.15.61:6822/94350","heartbeat_front_addr":"172.21.15.61:6817/94350","state":["exists","up"]},{"osd":3,"uuid":"117c41d8-d40c-4cc0-b0e1-70bca058fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":94347},{"type":"v1","addr":"172.21.15.61:6801","nonce":94347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":94347},{"type":"v1","addr":"172.21.15.61:6803","nonce":94347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":94347},{"type":"v1","addr":"172.21.15.61:6807","nonce":94347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":94347},{"type":"v1","addr":"172.21.15.61:6805","nonce":94347}]},"public_addr":"172.21.15.61:6801/94347","cluster_addr":"172.21.15.61:6803/94347","heartbeat_back_addr":"172.21.15.61:6807/94347","heartbeat_front_addr":"172.21.15.61:6805/94347","state":["exists","up"]},{"osd":4,"uuid":"4073e0e8-c5dd-463f-aa1c-c9515ef09976","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":94711},{"type":"v1","addr":"172.21.15.149:6818","nonce":94711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":94711},{"type":"v1","addr":"172.21.15.149:6822","nonce":94711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":94711},{"type":"v1","addr":"172.21.15.149:6830","nonce":94711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":94711},{"type":"v1","addr":"172.21.15.149:6826","nonce":94711}]},"public_addr":"172.21.15.149:6818/94711","cluster_addr":"172.21.15.149:6822/94711","heartbeat_back_addr":"172.21.15.149:6830/94711","heartbeat_front_addr":"172.21.15.149:6826/94711","state":["exists","up"]},{"osd":5,"uuid":"88aa0c0f-e3c1-4dd3-af8c-61f4bc28504e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":94709},{"type":"v1","addr":"172.21.15.149:6809","nonce":94709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":94709},{"type":"v1","addr":"172.21.15.149:6811","nonce":94709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":94709},{"type":"v1","addr":"172.21.15.149:6815","nonce":94709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":94709},{"type":"v1","addr":"172.21.15.149:6813","nonce":94709}]},"public_addr":"172.21.15.149:6809/94709","cluster_addr":"172.21.15.149:6811/94709","heartbeat_back_addr":"172.21.15.149:6815/94709","heartbeat_front_addr":"172.21.15.149:6813/94709","state":["exists","up"]},{"osd":6,"uuid":"8b13fc0c-5f00-41c7-8923-c4570da77afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":94710},{"type":"v1","addr":"172.21.15.149:6801","nonce":94710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":94710},{"type":"v1","addr":"172.21.15.149:6803","nonce":94710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":94710},{"type":"v1","addr":"172.21.15.149:6807","nonce":94710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":94710},{"type":"v1","addr":"172.21.15.149:6805","nonce":94710}]},"public_addr":"172.21.15.149:6801/94710","cluster_addr":"172.21.15.149:6803/94710","heartbeat_back_addr":"172.21.15.149:6807/94710","heartbeat_front_addr":"172.21.15.149:6805/94710","state":["exists","up"]},{"osd":7,"uuid":"5390c6e5-39e7-4aa6-b73c-642458b2acf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":94734},{"type":"v1","addr":"172.21.15.149:6819","nonce":94734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":94734},{"type":"v1","addr":"172.21.15.149:6823","nonce":94734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":94734},{"type":"v1","addr":"172.21.15.149:6831","nonce":94734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":94734},{"type":"v1","addr":"172.21.15.149:6827","nonce":94734}]},"public_addr":"172.21.15.149:6819/94734","cluster_addr":"172.21.15.149:6823/94734","heartbeat_back_addr":"172.21.15.149:6831/94734","heartbeat_front_addr":"172.21.15.149:6827/94734","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.555826+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.508739+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.515601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.472067+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.535257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.493397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.554910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.552343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-01T17:39:58.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.511+0000 7f21cbc3d700 1 -- 172.21.15.61:0/2147100050 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f21a8063290 msgr2=0x7f21a8065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:58.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.511+0000 7f21cbc3d700 1 --2- 172.21.15.61:0/2147100050 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f21a8063290 0x7f21a8065740 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f21b4000c00 tx=0x7f21b4009040 comp rx=0 tx=0).stop 2023-01-01T17:39:58.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.511+0000 7f21cbc3d700 1 -- 172.21.15.61:0/2147100050 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21c414ec40 msgr2=0x7f21c40bd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:58.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.511+0000 7f21cbc3d700 1 --2- 172.21.15.61:0/2147100050 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21c414ec40 0x7f21c40bd3a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f21bc015040 tx=0x7f21bc001650 comp rx=0 tx=0).stop 2023-01-01T17:39:58.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.511+0000 7f21cbc3d700 1 -- 172.21.15.61:0/2147100050 shutdown_connections 2023-01-01T17:39:58.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.511+0000 7f21cbc3d700 1 --2- 172.21.15.61:0/2147100050 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f21a8063290 0x7f21a8065740 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:58.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.511+0000 7f21cbc3d700 1 --2- 172.21.15.61:0/2147100050 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f21c414ec40 0x7f21c40bd3a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:58.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.511+0000 7f21cbc3d700 1 --2- 172.21.15.61:0/2147100050 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f21c40c4b00 0x7f21c41e6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:58.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.511+0000 7f21cbc3d700 1 --2- 172.21.15.61:0/2147100050 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21c40c4ed0 0x7f21c414e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:58.512 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.511+0000 7f21cbc3d700 1 -- 172.21.15.61:0/2147100050 >> 172.21.15.61:0/2147100050 conn(0x7f21c40c1f30 msgr2=0x7f21c414fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:58.512 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.511+0000 7f21cbc3d700 1 -- 172.21.15.61:0/2147100050 shutdown_connections 2023-01-01T17:39:58.512 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.511+0000 7f21cbc3d700 1 -- 172.21.15.61:0/2147100050 wait complete. 2023-01-01T17:39:58.535 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-01-01T17:39:58.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.660+0000 7fcacfab5700 1 Processor -- start 2023-01-01T17:39:58.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.660+0000 7fcacfab5700 1 -- start start 2023-01-01T17:39:58.662 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.661+0000 7fcacfab5700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcac80c1a70 0x7fcac80bfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:58.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.661+0000 7fcacfab5700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcac806f1e0 con 0x7fcac80c0370 2023-01-01T17:39:58.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.661+0000 7fcacfab5700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcac806f710 con 0x7fcac8150280 2023-01-01T17:39:58.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.661+0000 7fcacfab5700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac8152d40 con 0x7fcac80c1a70 2023-01-01T17:39:58.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.661+0000 7fcace052700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fcac80c0370 0x7fcac815d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:39932/0 (socket says 172.21.15.61:39932) 2023-01-01T17:39:58.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.661+0000 7fcace052700 1 -- 172.21.15.61:0/3787171935 learned_addr learned my addr 172.21.15.61:0/3787171935 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:39:58.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.661+0000 7fcacd050700 1 --2- 172.21.15.61:0/3787171935 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcac80c1a70 0x7fcac80bfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:58.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.661+0000 7fcacc84f700 1 -- 172.21.15.61:0/3787171935 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4202574782 0 0) 0x7fcac806f1e0 con 0x7fcac80c0370 2023-01-01T17:39:58.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.661+0000 7fcacc84f700 1 -- 172.21.15.61:0/3787171935 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcab40035b0 con 0x7fcac80c0370 2023-01-01T17:39:58.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.661+0000 7fcacc84f700 1 -- 172.21.15.61:0/3787171935 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1137762216 0 0) 0x7fcab40035b0 con 0x7fcac80c0370 2023-01-01T17:39:58.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.661+0000 7fcacc84f700 1 -- 172.21.15.61:0/3787171935 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcac80c1a70 msgr2=0x7fcac80bfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:58.663 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.661+0000 7fcacc84f700 1 --2- 172.21.15.61:0/3787171935 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcac80c1a70 0x7fcac80bfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:58.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.661+0000 7fcacc84f700 1 -- 172.21.15.61:0/3787171935 >> v1:172.21.15.149:6789/0 conn(0x7fcac8150280 legacy=0x7fcac806a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:58.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.661+0000 7fcacc84f700 1 -- 172.21.15.61:0/3787171935 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac806f430 con 0x7fcac80c0370 2023-01-01T17:39:58.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.661+0000 7fcacc84f700 1 -- 172.21.15.61:0/3787171935 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586489653 0 0) 0x7fcac00019f0 con 0x7fcac80c0370 2023-01-01T17:39:58.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.661+0000 7fcacc84f700 1 -- 172.21.15.61:0/3787171935 >> v1:172.21.15.61:6789/0 conn(0x7fcac80c0370 legacy=0x7fcac815d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:58.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.661+0000 7fcacc84f700 1 --2- 172.21.15.61:0/3787171935 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcab4003a30 0x7fcab4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:58.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.661+0000 7fcacc84f700 1 --2- 172.21.15.61:0/3787171935 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcac80c1a70 0x7fcab4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:58.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.661+0000 7fcacc84f700 1 --2- 172.21.15.61:0/3787171935 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcab4004d90 0x7fcab4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:58.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.661+0000 7fcacc84f700 1 -- 172.21.15.61:0/3787171935 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab400bb20 con 0x7fcab4004d90 2023-01-01T17:39:58.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.661+0000 7fcacc84f700 1 -- 172.21.15.61:0/3787171935 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab400bc90 con 0x7fcab4003a30 2023-01-01T17:39:58.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.661+0000 7fcacc84f700 1 -- 172.21.15.61:0/3787171935 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcab400be50 con 0x7fcac80c1a70 2023-01-01T17:39:58.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.661+0000 7fcace052700 1 --2- 172.21.15.61:0/3787171935 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcab4004d90 0x7fcab4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:58.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.661+0000 7fcacd050700 1 --2- 172.21.15.61:0/3787171935 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcac80c1a70 0x7fcab4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:58.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.661+0000 7fcacd851700 1 --2- 172.21.15.61:0/3787171935 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcab4003a30 0x7fcab4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:58.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.662+0000 7fcace052700 1 -- 172.21.15.61:0/3787171935 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcac80c1a70 msgr2=0x7fcab4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:58.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.662+0000 7fcace052700 1 --2- 172.21.15.61:0/3787171935 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcac80c1a70 0x7fcab4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:58.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.662+0000 7fcace052700 1 -- 172.21.15.61:0/3787171935 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcab4003a30 msgr2=0x7fcab4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:58.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.662+0000 7fcace052700 1 --2- 172.21.15.61:0/3787171935 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcab4003a30 0x7fcab4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:58.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.662+0000 7fcace052700 1 -- 172.21.15.61:0/3787171935 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab40035b0 con 0x7fcab4004d90 2023-01-01T17:39:58.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.662+0000 7fcace052700 1 --2- 172.21.15.61:0/3787171935 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcab4004d90 0x7fcab4005200 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcac000a830 tx=0x7fcab4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b6f9cb3ebad26b server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:58.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.662+0000 7fcacc84f700 1 -- 172.21.15.61:0/3787171935 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac0012600 con 0x7fcab4004d90 2023-01-01T17:39:58.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.662+0000 7fcacc84f700 1 -- 172.21.15.61:0/3787171935 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac0012780 con 0x7fcab4004d90 2023-01-01T17:39:58.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.662+0000 7fcacc84f700 1 -- 172.21.15.61:0/3787171935 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac0012b30 con 0x7fcab4004d90 2023-01-01T17:39:58.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.662+0000 7fcacfab5700 1 -- 172.21.15.61:0/3787171935 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcab4004d90 msgr2=0x7fcab4005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:58.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.662+0000 7fcacfab5700 1 --2- 172.21.15.61:0/3787171935 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcab4004d90 0x7fcab4005200 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcac000a830 tx=0x7fcab4005880 comp rx=0 tx=0).stop 2023-01-01T17:39:58.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.662+0000 7fcace052700 1 -- 172.21.15.61:0/3787171935 reap_dead start 2023-01-01T17:39:58.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.662+0000 7fcacfab5700 1 -- 172.21.15.61:0/3787171935 shutdown_connections 2023-01-01T17:39:58.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.662+0000 7fcacfab5700 1 -- 172.21.15.61:0/3787171935 >> 172.21.15.61:0/3787171935 conn(0x7fcac80c1f30 msgr2=0x7fcac80c2330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:58.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.663+0000 7fcacfab5700 1 -- 172.21.15.61:0/3787171935 shutdown_connections 2023-01-01T17:39:58.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.663+0000 7fcacfab5700 1 -- 172.21.15.61:0/3787171935 wait complete. 2023-01-01T17:39:58.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.664+0000 7fcacfab5700 1 Processor -- start 2023-01-01T17:39:58.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.664+0000 7fcacfab5700 1 -- start start 2023-01-01T17:39:58.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.664+0000 7fcacfab5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcac81eb890 0x7fcac80a83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:58.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.664+0000 7fcacfab5700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcac8149480 0x7fcac8152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:58.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.664+0000 7fcacfab5700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcac81ebc60 0x7fcac8148570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:58.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.664+0000 7fcacfab5700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac80c5090 con 0x7fcac81ebc60 2023-01-01T17:39:58.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.664+0000 7fcacfab5700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac80a8e50 con 0x7fcac81eb890 2023-01-01T17:39:58.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.664+0000 7fcacfab5700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac8150e20 con 0x7fcac8149480 2023-01-01T17:39:58.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.665+0000 7fcace052700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcac81ebc60 0x7fcac8148570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:58.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.665+0000 7fcace052700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcac81ebc60 0x7fcac8148570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46094/0 (socket says 172.21.15.61:46094) 2023-01-01T17:39:58.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.665+0000 7fcace052700 1 -- 172.21.15.61:0/3901006246 learned_addr learned my addr 172.21.15.61:0/3901006246 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:58.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.665+0000 7fcacd851700 1 --2- 172.21.15.61:0/3901006246 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcac81eb890 0x7fcac80a83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:58.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.665+0000 7fcacd050700 1 --2- 172.21.15.61:0/3901006246 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcac8149480 0x7fcac8152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:58.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.665+0000 7fcace052700 1 -- 172.21.15.61:0/3901006246 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcac8149480 msgr2=0x7fcac8152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:58.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.665+0000 7fcace052700 1 --2- 172.21.15.61:0/3901006246 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcac8149480 0x7fcac8152110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:58.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.665+0000 7fcace052700 1 -- 172.21.15.61:0/3901006246 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcac81eb890 msgr2=0x7fcac80a83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:58.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.665+0000 7fcace052700 1 --2- 172.21.15.61:0/3901006246 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcac81eb890 0x7fcac80a83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:58.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.665+0000 7fcace052700 1 -- 172.21.15.61:0/3901006246 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac8153210 con 0x7fcac81ebc60 2023-01-01T17:39:58.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.665+0000 7fcace052700 1 --2- 172.21.15.61:0/3901006246 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcac81ebc60 0x7fcac8148570 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcac000ae20 tx=0x7fcac0001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:58.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.665+0000 7fcaba7fc700 1 -- 172.21.15.61:0/3901006246 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac00011c0 con 0x7fcac81ebc60 2023-01-01T17:39:58.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.665+0000 7fcaba7fc700 1 -- 172.21.15.61:0/3901006246 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac001e430 con 0x7fcac81ebc60 2023-01-01T17:39:58.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.665+0000 7fcacfab5700 1 -- 172.21.15.61:0/3901006246 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac8152f30 con 0x7fcac81ebc60 2023-01-01T17:39:58.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.665+0000 7fcaba7fc700 1 -- 172.21.15.61:0/3901006246 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac001e7e0 con 0x7fcac81ebc60 2023-01-01T17:39:58.672 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.665+0000 7fcacfab5700 1 -- 172.21.15.61:0/3901006246 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac81534f0 con 0x7fcac81ebc60 2023-01-01T17:39:58.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.666+0000 7fcacfab5700 1 -- 172.21.15.61:0/3901006246 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac80668a0 con 0x7fcac81ebc60 2023-01-01T17:39:58.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.666+0000 7fcaba7fc700 1 -- 172.21.15.61:0/3901006246 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7fcac0010070 con 0x7fcac81ebc60 2023-01-01T17:39:58.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.667+0000 7fcaba7fc700 1 --2- 172.21.15.61:0/3901006246 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fcaac063290 0x7fcaac065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:58.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.667+0000 7fcaba7fc700 1 -- 172.21.15.61:0/3901006246 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcac0081930 con 0x7fcac81ebc60 2023-01-01T17:39:58.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.667+0000 7fcacd851700 1 --2- 172.21.15.61:0/3901006246 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fcaac063290 0x7fcaac065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:58.673 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.667+0000 7fcacd851700 1 --2- 172.21.15.61:0/3901006246 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fcaac063290 0x7fcaac065740 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcac4000c00 tx=0x7fcac4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:58.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.671+0000 7fcaba7fc700 1 -- 172.21.15.61:0/3901006246 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7fcac00507b0 con 0x7fcac81ebc60 2023-01-01T17:39:58.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.905+0000 7fcacfab5700 1 -- 172.21.15.61:0/3901006246 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcac80c10c0 con 0x7fcac81ebc60 2023-01-01T17:39:58.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.906+0000 7fcaba7fc700 1 -- 172.21.15.61:0/3901006246 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4634 (secure 0 0 0) 0x7fcac0053dd0 con 0x7fcac81ebc60 2023-01-01T17:39:58.906 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:39:58.906 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/671276443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":671276443},{"type":"v1","addr":"172.21.15.149:6835","nonce":671276443}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6836/1287782466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6834","nonce":1287782466},{"type":"v1","addr":"172.21.15.61:6836","nonce":1287782466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/594691675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":594691675},{"type":"v1","addr":"172.21.15.149:6833","nonce":594691675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-01-01T17:39:52.938920+0000","modified":"2023-01-01T17:39:57.387114+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6837/426398173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6835","nonce":426398173},{"type":"v1","addr":"172.21.15.61:6837","nonce":426398173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-01-01T17:39:58.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.908+0000 7fcacfab5700 1 -- 172.21.15.61:0/3901006246 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fcaac063290 msgr2=0x7fcaac065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:58.909 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.908+0000 7fcacfab5700 1 --2- 172.21.15.61:0/3901006246 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fcaac063290 0x7fcaac065740 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcac4000c00 tx=0x7fcac4009040 comp rx=0 tx=0).stop 2023-01-01T17:39:58.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.908+0000 7fcacfab5700 1 -- 172.21.15.61:0/3901006246 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcac81ebc60 msgr2=0x7fcac8148570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:58.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.908+0000 7fcacfab5700 1 --2- 172.21.15.61:0/3901006246 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcac81ebc60 0x7fcac8148570 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcac000ae20 tx=0x7fcac0001d80 comp rx=0 tx=0).stop 2023-01-01T17:39:58.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.908+0000 7fcacfab5700 1 -- 172.21.15.61:0/3901006246 shutdown_connections 2023-01-01T17:39:58.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.908+0000 7fcacfab5700 1 --2- 172.21.15.61:0/3901006246 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fcaac063290 0x7fcaac065740 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:58.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.908+0000 7fcacfab5700 1 --2- 172.21.15.61:0/3901006246 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcac81ebc60 0x7fcac8148570 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:58.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.908+0000 7fcacfab5700 1 --2- 172.21.15.61:0/3901006246 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcac81eb890 0x7fcac80a83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:58.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.908+0000 7fcacfab5700 1 --2- 172.21.15.61:0/3901006246 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcac8149480 0x7fcac8152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:58.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.908+0000 7fcacfab5700 1 -- 172.21.15.61:0/3901006246 >> 172.21.15.61:0/3901006246 conn(0x7fcac80c1f30 msgr2=0x7fcac80c3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:58.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.908+0000 7fcacfab5700 1 -- 172.21.15.61:0/3901006246 shutdown_connections 2023-01-01T17:39:58.910 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:58.908+0000 7fcacfab5700 1 -- 172.21.15.61:0/3901006246 wait complete. 2023-01-01T17:39:58.910 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 7 2023-01-01T17:39:59.323 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-01-01T17:39:52.938920+0000', 'modified': '2023-01-01T17:39:57.387114+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4291}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4291': {'gid': 4291, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.61:6837/426398173', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.61:6835', 'nonce': 426398173}, {'type': 'v1', 'addr': '172.21.15.61:6837', 'nonce': 426398173}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-01-01T17:39:59.323 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-01-01T17:39:59.323 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-01-01T17:39:59.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.454+0000 7f6f5f7e3700 1 Processor -- start 2023-01-01T17:39:59.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.455+0000 7f6f5f7e3700 1 -- start start 2023-01-01T17:39:59.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.455+0000 7f6f5f7e3700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f5806a640 0x7f6f5814ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:59.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.455+0000 7f6f5f7e3700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f6f58157030 0x7f6f581504e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:59.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.455+0000 7f6f5f7e3700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5806dc10 con 0x7f6f580c1ad0 2023-01-01T17:39:59.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.455+0000 7f6f5f7e3700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f58071770 con 0x7f6f58157030 2023-01-01T17:39:59.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.455+0000 7f6f5f7e3700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f58156ba0 con 0x7f6f5806a640 2023-01-01T17:39:59.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.456+0000 7f6f5dd80700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f6f58157030 0x7f6f581504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:59.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.456+0000 7f6f5dd80700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f6f58157030 0x7f6f581504e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46102/0 (socket says 172.21.15.61:46102) 2023-01-01T17:39:59.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.456+0000 7f6f5dd80700 1 -- 172.21.15.61:0/3732749 learned_addr learned my addr 172.21.15.61:0/3732749 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:59.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.456+0000 7f6f5d57f700 1 --2- 172.21.15.61:0/3732749 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f5806a640 0x7f6f5814ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:59.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.456+0000 7f6f5dd80700 1 -- 172.21.15.61:0/3732749 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f5806a640 msgr2=0x7f6f5814ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:59.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.456+0000 7f6f5dd80700 1 --2- 172.21.15.61:0/3732749 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f5806a640 0x7f6f5814ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.456+0000 7f6f5dd80700 1 -- 172.21.15.61:0/3732749 >> v1:172.21.15.149:6789/0 conn(0x7f6f580c1ad0 legacy=0x7f6f58152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:59.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.456+0000 7f6f5dd80700 1 -- 172.21.15.61:0/3732749 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5806f7a0 con 0x7f6f58157030 2023-01-01T17:39:59.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.456+0000 7f6f5d57f700 1 --2- 172.21.15.61:0/3732749 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f5806a640 0x7f6f5814ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-01-01T17:39:59.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.456+0000 7f6f5dd80700 1 --2- 172.21.15.61:0/3732749 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f58157030 0x7f6f581504e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6f50009e50 tx=0x7f6f5000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c85eacfc6154e3 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:59.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.456+0000 7f6f4bfff700 1 -- 172.21.15.61:0/3732749 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5000e070 con 0x7f6f58157030 2023-01-01T17:39:59.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.456+0000 7f6f4bfff700 1 -- 172.21.15.61:0/3732749 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f50003a20 con 0x7f6f58157030 2023-01-01T17:39:59.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.456+0000 7f6f4bfff700 1 -- 172.21.15.61:0/3732749 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f50003dd0 con 0x7f6f58157030 2023-01-01T17:39:59.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.457+0000 7f6f5f7e3700 1 -- 172.21.15.61:0/3732749 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f58157030 msgr2=0x7f6f581504e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:59.459 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.457+0000 7f6f5f7e3700 1 --2- 172.21.15.61:0/3732749 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f58157030 0x7f6f581504e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6f50009e50 tx=0x7f6f5000b330 comp rx=0 tx=0).stop 2023-01-01T17:39:59.459 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.457+0000 7f6f5f7e3700 1 -- 172.21.15.61:0/3732749 shutdown_connections 2023-01-01T17:39:59.459 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.457+0000 7f6f5f7e3700 1 --2- 172.21.15.61:0/3732749 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f58157030 0x7f6f581504e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.459 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.457+0000 7f6f5f7e3700 1 --2- 172.21.15.61:0/3732749 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f5806a640 0x7f6f5814ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.459 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.457+0000 7f6f5f7e3700 1 -- 172.21.15.61:0/3732749 >> 172.21.15.61:0/3732749 conn(0x7f6f580c1f30 msgr2=0x7f6f580c2330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:59.459 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.457+0000 7f6f5f7e3700 1 -- 172.21.15.61:0/3732749 shutdown_connections 2023-01-01T17:39:59.459 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.457+0000 7f6f5f7e3700 1 -- 172.21.15.61:0/3732749 wait complete. 2023-01-01T17:39:59.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.458+0000 7f6f5f7e3700 1 Processor -- start 2023-01-01T17:39:59.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.458+0000 7f6f5f7e3700 1 -- start start 2023-01-01T17:39:59.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.459+0000 7f6f5f7e3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f5806a640 0x7f6f580bee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:59.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.459+0000 7f6f5f7e3700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f580c1ad0 0x7f6f580a9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:59.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.459+0000 7f6f5f7e3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f58157030 0x7f6f58152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:59.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.459+0000 7f6f5f7e3700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f581e8110 con 0x7f6f5806a640 2023-01-01T17:39:59.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.459+0000 7f6f5f7e3700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5806d990 con 0x7f6f58157030 2023-01-01T17:39:59.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.459+0000 7f6f5f7e3700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f580bf510 con 0x7f6f580c1ad0 2023-01-01T17:39:59.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.459+0000 7f6f5d57f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f5806a640 0x7f6f580bee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:59.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.459+0000 7f6f5d57f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f5806a640 0x7f6f580bee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46104/0 (socket says 172.21.15.61:46104) 2023-01-01T17:39:59.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.459+0000 7f6f5d57f700 1 -- 172.21.15.61:0/499916110 learned_addr learned my addr 172.21.15.61:0/499916110 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:59.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.459+0000 7f6f5dd80700 1 --2- 172.21.15.61:0/499916110 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f58157030 0x7f6f58152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:59.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.459+0000 7f6f5cd7e700 1 --2- 172.21.15.61:0/499916110 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f580c1ad0 0x7f6f580a9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:59.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.459+0000 7f6f5d57f700 1 -- 172.21.15.61:0/499916110 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f580c1ad0 msgr2=0x7f6f580a9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:59.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.459+0000 7f6f5d57f700 1 --2- 172.21.15.61:0/499916110 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f580c1ad0 0x7f6f580a9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.459+0000 7f6f5d57f700 1 -- 172.21.15.61:0/499916110 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f58157030 msgr2=0x7f6f58152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:59.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.459+0000 7f6f5d57f700 1 --2- 172.21.15.61:0/499916110 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f58157030 0x7f6f58152e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.459+0000 7f6f5d57f700 1 -- 172.21.15.61:0/499916110 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f50009b30 con 0x7f6f5806a640 2023-01-01T17:39:59.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.459+0000 7f6f5dd80700 1 --2- 172.21.15.61:0/499916110 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f58157030 0x7f6f58152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-01-01T17:39:59.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.459+0000 7f6f5cd7e700 1 --2- 172.21.15.61:0/499916110 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f580c1ad0 0x7f6f580a9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-01-01T17:39:59.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.459+0000 7f6f5d57f700 1 --2- 172.21.15.61:0/499916110 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f5806a640 0x7f6f580bee80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6f5400c750 tx=0x7f6f5400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:59.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.459+0000 7f6f49ffb700 1 -- 172.21.15.61:0/499916110 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f54011800 con 0x7f6f5806a640 2023-01-01T17:39:59.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.459+0000 7f6f49ffb700 1 -- 172.21.15.61:0/499916110 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f54011960 con 0x7f6f5806a640 2023-01-01T17:39:59.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.459+0000 7f6f5f7e3700 1 -- 172.21.15.61:0/499916110 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f5806f4c0 con 0x7f6f5806a640 2023-01-01T17:39:59.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.459+0000 7f6f49ffb700 1 -- 172.21.15.61:0/499916110 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f54011cd0 con 0x7f6f5806a640 2023-01-01T17:39:59.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.460+0000 7f6f5f7e3700 1 -- 172.21.15.61:0/499916110 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f5806f1e0 con 0x7f6f5806a640 2023-01-01T17:39:59.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.461+0000 7f6f49ffb700 1 -- 172.21.15.61:0/499916110 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f6f54020070 con 0x7f6f5806a640 2023-01-01T17:39:59.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.461+0000 7f6f49ffb700 1 --2- 172.21.15.61:0/499916110 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f6f3c063290 0x7f6f3c065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:59.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.461+0000 7f6f49ffb700 1 -- 172.21.15.61:0/499916110 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6f5407fc10 con 0x7f6f5806a640 2023-01-01T17:39:59.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.461+0000 7f6f5cd7e700 1 --2- 172.21.15.61:0/499916110 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f6f3c063290 0x7f6f3c065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:59.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.462+0000 7f6f5cd7e700 1 --2- 172.21.15.61:0/499916110 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f6f3c063290 0x7f6f3c065740 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6f58153bc0 tx=0x7f6f4c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:59.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.463+0000 7f6f6b95db80 1 Processor -- start 2023-01-01T17:39:59.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.464+0000 7f6f6b95db80 1 -- start start 2023-01-01T17:39:59.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.464+0000 7f6f6b95db80 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a13680a970 0x55a136815670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:59.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.464+0000 7f6f6b95db80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a1367d1710 0x55a13680ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:59.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.464+0000 7f6f6b95db80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55a1367ce460 0x55a13680c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:59.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.464+0000 7f6f6b95db80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a13673a240 con 0x55a1367ce460 2023-01-01T17:39:59.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.464+0000 7f6f6b95db80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1366ba170 con 0x55a1367d1710 2023-01-01T17:39:59.470 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.464+0000 7f6f6b95db80 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a136727950 con 0x55a13680a970 2023-01-01T17:39:59.470 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.465+0000 7f6f5dd80700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55a1367ce460 0x55a13680c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:59.470 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.465+0000 7f6f5dd80700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55a1367ce460 0x55a13680c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46116/0 (socket says 172.21.15.61:46116) 2023-01-01T17:39:59.470 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.465+0000 7f6f5dd80700 1 -- 172.21.15.61:0/1235431870 learned_addr learned my addr 172.21.15.61:0/1235431870 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:59.470 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.465+0000 7f6f5d57f700 1 --2- 172.21.15.61:0/1235431870 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a13680a970 0x55a136815670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:59.470 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.465+0000 7f6f5cd7e700 1 --2- 172.21.15.61:0/1235431870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a1367d1710 0x55a13680ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:59.470 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.465+0000 7f6f5dd80700 1 -- 172.21.15.61:0/1235431870 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a13680a970 msgr2=0x55a136815670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:59.470 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.465+0000 7f6f5dd80700 1 --2- 172.21.15.61:0/1235431870 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a13680a970 0x55a136815670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.470 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.465+0000 7f6f5dd80700 1 -- 172.21.15.61:0/1235431870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a1367d1710 msgr2=0x55a13680ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:59.470 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.465+0000 7f6f5dd80700 1 --2- 172.21.15.61:0/1235431870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a1367d1710 0x55a13680ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.470 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.465+0000 7f6f5dd80700 1 -- 172.21.15.61:0/1235431870 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a136746510 con 0x55a1367ce460 2023-01-01T17:39:59.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.465+0000 7f6f5dd80700 1 --2- 172.21.15.61:0/1235431870 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55a1367ce460 0x55a13680c580 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000b370 tx=0x7f6f50010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5090d62567ac165 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:59.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.465+0000 7f6f42ffd700 1 -- 172.21.15.61:0/1235431870 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5000b980 con 0x55a1367ce460 2023-01-01T17:39:59.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.465+0000 7f6f42ffd700 1 -- 172.21.15.61:0/1235431870 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5000bae0 con 0x55a1367ce460 2023-01-01T17:39:59.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.465+0000 7f6f42ffd700 1 -- 172.21.15.61:0/1235431870 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f50004030 con 0x55a1367ce460 2023-01-01T17:39:59.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.466+0000 7f6f6b95db80 1 -- 172.21.15.61:0/1235431870 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55a1367ce460 msgr2=0x55a13680c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:59.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.466+0000 7f6f6b95db80 1 --2- 172.21.15.61:0/1235431870 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55a1367ce460 0x55a13680c580 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000b370 tx=0x7f6f50010000 comp rx=0 tx=0).stop 2023-01-01T17:39:59.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.466+0000 7f6f6b95db80 1 -- 172.21.15.61:0/1235431870 shutdown_connections 2023-01-01T17:39:59.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.466+0000 7f6f6b95db80 1 --2- 172.21.15.61:0/1235431870 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55a1367ce460 0x55a13680c580 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.466+0000 7f6f6b95db80 1 --2- 172.21.15.61:0/1235431870 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a13680a970 0x55a136815670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.466+0000 7f6f6b95db80 1 --2- 172.21.15.61:0/1235431870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a1367d1710 0x55a13680ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.466+0000 7f6f6b95db80 1 -- 172.21.15.61:0/1235431870 >> 172.21.15.61:0/1235431870 conn(0x55a1367ccb60 msgr2=0x55a1367cdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:59.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.466+0000 7f6f6b95db80 1 -- 172.21.15.61:0/1235431870 shutdown_connections 2023-01-01T17:39:59.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.466+0000 7f6f6b95db80 1 -- 172.21.15.61:0/1235431870 wait complete. 2023-01-01T17:39:59.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.466+0000 7f6f6b95db80 1 -- start start 2023-01-01T17:39:59.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.466+0000 7f6f6b95db80 1 Processor -- start 2023-01-01T17:39:59.476 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.467+0000 7f6f6b95db80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a1367ce460 0x55a13680c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:59.476 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.467+0000 7f6f6b95db80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55a1367d1710 0x55a13681f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:59.476 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.467+0000 7f6f6b95db80 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a13680a970 0x55a1367ead00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:59.476 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.467+0000 7f6f6b95db80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a136721030 con 0x55a1367d1710 2023-01-01T17:39:59.476 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.467+0000 7f6f6b95db80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1365a68d0 con 0x55a1367ce460 2023-01-01T17:39:59.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.467+0000 7f6f6b95db80 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a13681ca20 con 0x55a13680a970 2023-01-01T17:39:59.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.467+0000 7f6f6b95db80 10 client.0 _ll_register_callbacks cb 0x55a1366c8160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-01-01T17:39:59.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.467+0000 7f6f5cd7e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55a1367d1710 0x55a13681f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:59.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.467+0000 7f6f5cd7e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55a1367d1710 0x55a13681f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46120/0 (socket says 172.21.15.61:46120) 2023-01-01T17:39:59.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.467+0000 7f6f5cd7e700 1 -- 172.21.15.61:0/1867674832 learned_addr learned my addr 172.21.15.61:0/1867674832 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:59.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.468+0000 7f6f5d57f700 1 --2- 172.21.15.61:0/1867674832 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a1367ce460 0x55a13680c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:59.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.468+0000 7f6f5dd80700 1 --2- 172.21.15.61:0/1867674832 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a13680a970 0x55a1367ead00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:59.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.468+0000 7f6f5cd7e700 1 -- 172.21.15.61:0/1867674832 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a13680a970 msgr2=0x55a1367ead00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:59.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.468+0000 7f6f5cd7e700 1 --2- 172.21.15.61:0/1867674832 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a13680a970 0x55a1367ead00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.468+0000 7f6f5cd7e700 1 -- 172.21.15.61:0/1867674832 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a1367ce460 msgr2=0x55a13680c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:59.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.468+0000 7f6f5cd7e700 1 --2- 172.21.15.61:0/1867674832 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a1367ce460 0x55a13680c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.468+0000 7f6f5cd7e700 1 -- 172.21.15.61:0/1867674832 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f5806f7a0 con 0x55a1367d1710 2023-01-01T17:39:59.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.468+0000 7f6f5dd80700 1 --2- 172.21.15.61:0/1867674832 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a13680a970 0x55a1367ead00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-01T17:39:59.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.468+0000 7f6f5cd7e700 1 --2- 172.21.15.61:0/1867674832 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55a1367d1710 0x55a13681f340 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c003d20 tx=0x7f6f4c003780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24cfea7f8919b06a server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:59.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.468+0000 7f6f37fff700 10 client.0 ms_handle_connect on v2:172.21.15.61:3300/0 2023-01-01T17:39:59.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.468+0000 7f6f37fff700 1 -- 172.21.15.61:0/1867674832 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c012a40 con 0x55a1367d1710 2023-01-01T17:39:59.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.468+0000 7f6f37fff700 1 -- 172.21.15.61:0/1867674832 <== mon.0 v2:172.21.15.61:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6f4c012ba0 con 0x55a1367d1710 2023-01-01T17:39:59.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.468+0000 7f6f6b95db80 1 -- 172.21.15.61:0/1867674832 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a1367c26b0 con 0x55a1367d1710 2023-01-01T17:39:59.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.468+0000 7f6f37fff700 1 -- 172.21.15.61:0/1867674832 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f4c012d80 con 0x55a1367d1710 2023-01-01T17:39:59.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.468+0000 7f6f6b95db80 10 client.4401 fetch_fsmap learned FSMap version 7 2023-01-01T17:39:59.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.468+0000 7f6f6b95db80 1 -- 172.21.15.61:0/1867674832 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55a136550d90 con 0x55a1367d1710 2023-01-01T17:39:59.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.468+0000 7f6f37fff700 1 -- 172.21.15.61:0/1867674832 <== mon.0 v2:172.21.15.61:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a1367c26b0 con 0x55a1367d1710 2023-01-01T17:39:59.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.468+0000 7f6f37fff700 1 -- 172.21.15.61:0/1867674832 <== mon.0 v2:172.21.15.61:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f6f4c006860 con 0x55a1367d1710 2023-01-01T17:39:59.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.468+0000 7f6f6b95db80 10 client.4401 fetch_fsmap finished waiting for FSMap version 7 2023-01-01T17:39:59.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.468+0000 7f6f6b95db80 10 client.4401 resolve_mds: resolved name 'a' to daemon mds.a 2023-01-01T17:39:59.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.468+0000 7f6f6b95db80 20 client.4401 populate_metadata read hostname 'smithi061' 2023-01-01T17:39:59.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.469+0000 7f6f6b95db80 1 --2- 172.21.15.61:0/1867674832 >> [v2:172.21.15.61:6835/426398173,v1:172.21.15.61:6837/426398173] conn(0x55a1367ebf20 0x55a1367ec2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:59.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.469+0000 7f6f6b95db80 4 client.4401 mds_command: new command op to 4291 tid=0[{"prefix": "get_command_descriptions"}] 2023-01-01T17:39:59.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.469+0000 7f6f6b95db80 1 -- 172.21.15.61:0/1867674832 --> [v2:172.21.15.61:6835/426398173,v1:172.21.15.61:6837/426398173] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a13671a0b0 con 0x55a1367ebf20 2023-01-01T17:39:59.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.469+0000 7f6f5d57f700 1 --2- 172.21.15.61:0/1867674832 >> [v2:172.21.15.61:6835/426398173,v1:172.21.15.61:6837/426398173] conn(0x55a1367ebf20 0x55a1367ec2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:59.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.469+0000 7f6f37fff700 10 client.4401 ms_handle_connect on v2:172.21.15.61:6835/426398173 2023-01-01T17:39:59.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.469+0000 7f6f5d57f700 1 --2- 172.21.15.61:0/1867674832 >> [v2:172.21.15.61:6835/426398173,v1:172.21.15.61:6837/426398173] conn(0x55a1367ebf20 0x55a1367ec2f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff12259f04835662 server_cookie=e9e1e77eb4c6681b in_seq=0 out_seq=0 2023-01-01T17:39:59.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.470+0000 7f6f37fff700 1 -- 172.21.15.61:0/1867674832 <== mds.0 v2:172.21.15.61:6835/426398173 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x55a13671a0b0 con 0x55a1367ebf20 2023-01-01T17:39:59.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.470+0000 7f6f37fff700 10 client.4401 handle_command_reply: tid=0 2023-01-01T17:39:59.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.470+0000 7f6f6b95db80 1 client.4401 shutdown 2023-01-01T17:39:59.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.470+0000 7f6f6b95db80 1 -- 172.21.15.61:0/1867674832 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55a1367d1710 msgr2=0x55a13681f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:59.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.470+0000 7f6f6b95db80 1 --2- 172.21.15.61:0/1867674832 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55a1367d1710 0x55a13681f340 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c003d20 tx=0x7f6f4c003780 comp rx=0 tx=0).stop 2023-01-01T17:39:59.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.470+0000 7f6f6b95db80 1 -- 172.21.15.61:0/1867674832 shutdown_connections 2023-01-01T17:39:59.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.470+0000 7f6f6b95db80 1 --2- 172.21.15.61:0/1867674832 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a13680a970 0x55a1367ead00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.470+0000 7f6f6b95db80 1 --2- 172.21.15.61:0/1867674832 >> [v2:172.21.15.61:6835/426398173,v1:172.21.15.61:6837/426398173] conn(0x55a1367ebf20 0x55a1367ec2f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.470+0000 7f6f6b95db80 1 --2- 172.21.15.61:0/1867674832 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a1367ce460 0x55a13680c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.470+0000 7f6f37fff700 0 client.4401 ms_handle_reset on v2:172.21.15.61:6835/426398173 2023-01-01T17:39:59.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.470+0000 7f6f6b95db80 1 --2- 172.21.15.61:0/1867674832 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55a1367d1710 0x55a13681f340 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.470+0000 7f6f6b95db80 1 -- 172.21.15.61:0/1867674832 >> 172.21.15.61:0/1867674832 conn(0x55a1367ccb60 msgr2=0x55a13680ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:59.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.470+0000 7f6f6b95db80 1 -- 172.21.15.61:0/1867674832 shutdown_connections 2023-01-01T17:39:59.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.470+0000 7f6f6b95db80 1 -- 172.21.15.61:0/1867674832 wait complete. 2023-01-01T17:39:59.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.470+0000 7f6f6b95db80 20 client.4401 trim_cache size 0 max 16384 2023-01-01T17:39:59.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.487+0000 7f6f6b95db80 1 Processor -- start 2023-01-01T17:39:59.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.487+0000 7f6f6b95db80 1 -- start start 2023-01-01T17:39:59.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.488+0000 7f6f6b95db80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a1367ce460 0x55a13680f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:59.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.488+0000 7f6f6b95db80 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a1367d1710 0x55a136807fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:59.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.488+0000 7f6f6b95db80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55a13680a970 0x55a1368084e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:59.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.488+0000 7f6f6b95db80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a13681be40 con 0x55a13680a970 2023-01-01T17:39:59.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.488+0000 7f6f6b95db80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a13680a5e0 con 0x55a1367ce460 2023-01-01T17:39:59.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.488+0000 7f6f6b95db80 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a13681bb70 con 0x55a1367d1710 2023-01-01T17:39:59.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.488+0000 7f6f5dd80700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55a13680a970 0x55a1368084e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:59.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.488+0000 7f6f5dd80700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55a13680a970 0x55a1368084e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46128/0 (socket says 172.21.15.61:46128) 2023-01-01T17:39:59.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.488+0000 7f6f5dd80700 1 -- 172.21.15.61:0/3458393664 learned_addr learned my addr 172.21.15.61:0/3458393664 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:59.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.488+0000 7f6f5dd80700 1 -- 172.21.15.61:0/3458393664 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a1367d1710 msgr2=0x55a136807fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:59.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.488+0000 7f6f5dd80700 1 --2- 172.21.15.61:0/3458393664 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a1367d1710 0x55a136807fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.488+0000 7f6f5dd80700 1 -- 172.21.15.61:0/3458393664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a1367ce460 msgr2=0x55a13680f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:59.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.488+0000 7f6f5dd80700 1 --2- 172.21.15.61:0/3458393664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a1367ce460 0x55a13680f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.488+0000 7f6f5dd80700 1 -- 172.21.15.61:0/3458393664 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1366e8b50 con 0x55a13680a970 2023-01-01T17:39:59.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.488+0000 7f6f5dd80700 1 --2- 172.21.15.61:0/3458393664 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55a13680a970 0x55a1368084e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6f50004000 tx=0x7f6f50009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf3eacfa7aa594fb server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:59.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.488+0000 7f6f437fe700 1 -- 172.21.15.61:0/3458393664 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5002a070 con 0x55a13680a970 2023-01-01T17:39:59.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.488+0000 7f6f437fe700 1 -- 172.21.15.61:0/3458393664 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f50003d10 con 0x55a13680a970 2023-01-01T17:39:59.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.488+0000 7f6f437fe700 1 -- 172.21.15.61:0/3458393664 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5000b980 con 0x55a13680a970 2023-01-01T17:39:59.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.489+0000 7f6f6b95db80 1 -- 172.21.15.61:0/3458393664 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55a13680a970 msgr2=0x55a1368084e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:59.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.489+0000 7f6f6b95db80 1 --2- 172.21.15.61:0/3458393664 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55a13680a970 0x55a1368084e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6f50004000 tx=0x7f6f50009810 comp rx=0 tx=0).stop 2023-01-01T17:39:59.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.489+0000 7f6f6b95db80 1 -- 172.21.15.61:0/3458393664 shutdown_connections 2023-01-01T17:39:59.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.489+0000 7f6f6b95db80 1 --2- 172.21.15.61:0/3458393664 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55a13680a970 0x55a1368084e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.489+0000 7f6f6b95db80 1 --2- 172.21.15.61:0/3458393664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a1367ce460 0x55a13680f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.489+0000 7f6f6b95db80 1 --2- 172.21.15.61:0/3458393664 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a1367d1710 0x55a136807fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.489+0000 7f6f6b95db80 1 -- 172.21.15.61:0/3458393664 >> 172.21.15.61:0/3458393664 conn(0x55a1367ccb60 msgr2=0x55a13680c700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:59.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.489+0000 7f6f6b95db80 1 -- 172.21.15.61:0/3458393664 shutdown_connections 2023-01-01T17:39:59.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.489+0000 7f6f6b95db80 1 -- 172.21.15.61:0/3458393664 wait complete. 2023-01-01T17:39:59.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.490+0000 7f6f6b95db80 1 -- start start 2023-01-01T17:39:59.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.490+0000 7f6f6b95db80 1 Processor -- start 2023-01-01T17:39:59.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.490+0000 7f6f6b95db80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a1367ce460 0x55a13680b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:59.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.491+0000 7f6f6b95db80 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a1367d1710 0x55a136870bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:59.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.491+0000 7f6f6b95db80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55a13680a970 0x55a13686df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:59.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.491+0000 7f6f6b95db80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a13681f100 con 0x55a13680a970 2023-01-01T17:39:59.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.491+0000 7f6f6b95db80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a136875180 con 0x55a1367ce460 2023-01-01T17:39:59.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.491+0000 7f6f6b95db80 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a1368717d0 con 0x55a1367d1710 2023-01-01T17:39:59.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.491+0000 7f6f6b95db80 10 client.0 _ll_register_callbacks cb 0x7f6f4c014610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-01-01T17:39:59.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.491+0000 7f6f5dd80700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55a13680a970 0x55a13686df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:59.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.491+0000 7f6f5dd80700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55a13680a970 0x55a13686df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46134/0 (socket says 172.21.15.61:46134) 2023-01-01T17:39:59.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.491+0000 7f6f5dd80700 1 -- 172.21.15.61:0/1019505471 learned_addr learned my addr 172.21.15.61:0/1019505471 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:59.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.491+0000 7f6f5cd7e700 1 --2- 172.21.15.61:0/1019505471 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a1367d1710 0x55a136870bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:59.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.491+0000 7f6f5d57f700 1 --2- 172.21.15.61:0/1019505471 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a1367ce460 0x55a13680b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:59.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.491+0000 7f6f5dd80700 1 -- 172.21.15.61:0/1019505471 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a1367d1710 msgr2=0x55a136870bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:59.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.491+0000 7f6f5dd80700 1 --2- 172.21.15.61:0/1019505471 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a1367d1710 0x55a136870bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.491+0000 7f6f5dd80700 1 -- 172.21.15.61:0/1019505471 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a1367ce460 msgr2=0x55a13680b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:59.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.491+0000 7f6f5dd80700 1 --2- 172.21.15.61:0/1019505471 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a1367ce460 0x55a13680b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.491+0000 7f6f5dd80700 1 -- 172.21.15.61:0/1019505471 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a136746510 con 0x55a13680a970 2023-01-01T17:39:59.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.491+0000 7f6f5dd80700 1 --2- 172.21.15.61:0/1019505471 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55a13680a970 0x55a13686df60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000b370 tx=0x7f6f50004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3683138b54e4c40a server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:59.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.491+0000 7f6f37fff700 10 client.0 ms_handle_connect on v2:172.21.15.61:3300/0 2023-01-01T17:39:59.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.491+0000 7f6f37fff700 1 -- 172.21.15.61:0/1019505471 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5002a040 con 0x55a13680a970 2023-01-01T17:39:59.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.491+0000 7f6f37fff700 1 -- 172.21.15.61:0/1019505471 <== mon.0 v2:172.21.15.61:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6f5002bca0 con 0x55a13680a970 2023-01-01T17:39:59.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.491+0000 7f6f6b95db80 1 -- 172.21.15.61:0/1019505471 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6f5000bae0 con 0x55a13680a970 2023-01-01T17:39:59.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.491+0000 7f6f37fff700 1 -- 172.21.15.61:0/1019505471 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f5002be60 con 0x55a13680a970 2023-01-01T17:39:59.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.491+0000 7f6f6b95db80 10 client.4407 fetch_fsmap learned FSMap version 7 2023-01-01T17:39:59.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.491+0000 7f6f6b95db80 1 -- 172.21.15.61:0/1019505471 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55a136577200 con 0x55a13680a970 2023-01-01T17:39:59.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.492+0000 7f6f37fff700 1 -- 172.21.15.61:0/1019505471 <== mon.0 v2:172.21.15.61:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5000bae0 con 0x55a13680a970 2023-01-01T17:39:59.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.492+0000 7f6f37fff700 1 -- 172.21.15.61:0/1019505471 <== mon.0 v2:172.21.15.61:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f6f50012840 con 0x55a13680a970 2023-01-01T17:39:59.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.492+0000 7f6f6b95db80 10 client.4407 fetch_fsmap finished waiting for FSMap version 7 2023-01-01T17:39:59.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.492+0000 7f6f6b95db80 10 client.4407 resolve_mds: resolved name 'a' to daemon mds.a 2023-01-01T17:39:59.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.492+0000 7f6f6b95db80 20 client.4407 populate_metadata read hostname 'smithi061' 2023-01-01T17:39:59.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.492+0000 7f6f6b95db80 1 --2- 172.21.15.61:0/1019505471 >> [v2:172.21.15.61:6835/426398173,v1:172.21.15.61:6837/426398173] conn(0x55a136871100 0x55a13686e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:59.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.492+0000 7f6f6b95db80 4 client.4407 mds_command: new command op to 4291 tid=0[{"prefix": "status"}] 2023-01-01T17:39:59.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.492+0000 7f6f6b95db80 1 -- 172.21.15.61:0/1019505471 --> [v2:172.21.15.61:6835/426398173,v1:172.21.15.61:6837/426398173] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a136719dd0 con 0x55a136871100 2023-01-01T17:39:59.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.492+0000 7f6f5d57f700 1 --2- 172.21.15.61:0/1019505471 >> [v2:172.21.15.61:6835/426398173,v1:172.21.15.61:6837/426398173] conn(0x55a136871100 0x55a13686e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:59.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.492+0000 7f6f37fff700 10 client.4407 ms_handle_connect on v2:172.21.15.61:6835/426398173 2023-01-01T17:39:59.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.492+0000 7f6f5d57f700 1 --2- 172.21.15.61:0/1019505471 >> [v2:172.21.15.61:6835/426398173,v1:172.21.15.61:6837/426398173] conn(0x55a136871100 0x55a13686e4a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ff38bf4dd063cd7 server_cookie=381ef954128acb25 in_seq=0 out_seq=0 2023-01-01T17:39:59.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.492+0000 7f6f37fff700 1 -- 172.21.15.61:0/1019505471 <== mds.0 v2:172.21.15.61:6835/426398173 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+317 (crc 0 0 0) 0x55a136719dd0 con 0x55a136871100 2023-01-01T17:39:59.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.492+0000 7f6f37fff700 10 client.4407 handle_command_reply: tid=0 2023-01-01T17:39:59.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.492+0000 7f6f6b95db80 1 client.4407 shutdown 2023-01-01T17:39:59.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.492+0000 7f6f6b95db80 1 -- 172.21.15.61:0/1019505471 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55a13680a970 msgr2=0x55a13686df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:59.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.492+0000 7f6f6b95db80 1 --2- 172.21.15.61:0/1019505471 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55a13680a970 0x55a13686df60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000b370 tx=0x7f6f50004b40 comp rx=0 tx=0).stop 2023-01-01T17:39:59.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.493+0000 7f6f6b95db80 1 -- 172.21.15.61:0/1019505471 shutdown_connections 2023-01-01T17:39:59.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.493+0000 7f6f6b95db80 1 --2- 172.21.15.61:0/1019505471 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x55a13680a970 0x55a13686df60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.493+0000 7f6f6b95db80 1 --2- 172.21.15.61:0/1019505471 >> [v2:172.21.15.61:6835/426398173,v1:172.21.15.61:6837/426398173] conn(0x55a136871100 0x55a13686e4a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.493+0000 7f6f6b95db80 1 --2- 172.21.15.61:0/1019505471 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a1367ce460 0x55a13680b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.493+0000 7f6f37fff700 0 client.4407 ms_handle_reset on v2:172.21.15.61:6835/426398173 2023-01-01T17:39:59.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.493+0000 7f6f6b95db80 1 --2- 172.21.15.61:0/1019505471 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x55a1367d1710 0x55a136870bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.493+0000 7f6f6b95db80 1 -- 172.21.15.61:0/1019505471 >> 172.21.15.61:0/1019505471 conn(0x55a1367ccb60 msgr2=0x55a13680f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:59.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.493+0000 7f6f6b95db80 1 -- 172.21.15.61:0/1019505471 shutdown_connections 2023-01-01T17:39:59.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.493+0000 7f6f6b95db80 1 -- 172.21.15.61:0/1019505471 wait complete. 2023-01-01T17:39:59.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.493+0000 7f6f6b95db80 20 client.4407 trim_cache size 0 max 16384 2023-01-01T17:39:59.507 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-01-01T17:39:59.507 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_fsid": "fe0d3d8e-46ee-4ed9-92f8-749741721d01", 2023-01-01T17:39:59.525 INFO:teuthology.orchestra.run.smithi061.stdout: "whoami": 0, 2023-01-01T17:39:59.525 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 4291, 2023-01-01T17:39:59.525 INFO:teuthology.orchestra.run.smithi061.stdout: "want_state": "up:active", 2023-01-01T17:39:59.525 INFO:teuthology.orchestra.run.smithi061.stdout: "state": "up:active", 2023-01-01T17:39:59.525 INFO:teuthology.orchestra.run.smithi061.stdout: "fs_name": "cephfs", 2023-01-01T17:39:59.525 INFO:teuthology.orchestra.run.smithi061.stdout: "rank_uptime": 6.551697098, 2023-01-01T17:39:59.525 INFO:teuthology.orchestra.run.smithi061.stdout: "mdsmap_epoch": 7, 2023-01-01T17:39:59.526 INFO:teuthology.orchestra.run.smithi061.stdout: "osdmap_epoch": 24, 2023-01-01T17:39:59.526 INFO:teuthology.orchestra.run.smithi061.stdout: "osdmap_epoch_barrier": 23, 2023-01-01T17:39:59.526 INFO:teuthology.orchestra.run.smithi061.stdout: "uptime": 12.060720043 2023-01-01T17:39:59.526 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-01-01T17:39:59.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.493+0000 7f6f5f7e3700 1 -- 172.21.15.61:0/499916110 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f6f3c063290 msgr2=0x7f6f3c065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:59.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.493+0000 7f6f5f7e3700 1 --2- 172.21.15.61:0/499916110 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f6f3c063290 0x7f6f3c065740 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6f58153bc0 tx=0x7f6f4c009040 comp rx=0 tx=0).stop 2023-01-01T17:39:59.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.493+0000 7f6f5f7e3700 1 -- 172.21.15.61:0/499916110 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f5806a640 msgr2=0x7f6f580bee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:59.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.493+0000 7f6f5f7e3700 1 --2- 172.21.15.61:0/499916110 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f5806a640 0x7f6f580bee80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6f5400c750 tx=0x7f6f5400cb10 comp rx=0 tx=0).stop 2023-01-01T17:39:59.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.493+0000 7f6f5f7e3700 1 -- 172.21.15.61:0/499916110 shutdown_connections 2023-01-01T17:39:59.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.493+0000 7f6f5f7e3700 1 --2- 172.21.15.61:0/499916110 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f58157030 0x7f6f58152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.493+0000 7f6f5f7e3700 1 --2- 172.21.15.61:0/499916110 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f6f3c063290 0x7f6f3c065740 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.493+0000 7f6f5f7e3700 1 --2- 172.21.15.61:0/499916110 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f6f5806a640 0x7f6f580bee80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.493+0000 7f6f5f7e3700 1 --2- 172.21.15.61:0/499916110 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f6f580c1ad0 0x7f6f580a9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.493+0000 7f6f5f7e3700 1 -- 172.21.15.61:0/499916110 >> 172.21.15.61:0/499916110 conn(0x7f6f580c1f30 msgr2=0x7f6f580bb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:59.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.493+0000 7f6f5f7e3700 1 -- 172.21.15.61:0/499916110 shutdown_connections 2023-01-01T17:39:59.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.493+0000 7f6f5f7e3700 1 -- 172.21.15.61:0/499916110 wait complete. 2023-01-01T17:39:59.529 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-01-01T17:39:59.529 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-01-01T17:39:59.529 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-01-01T17:39:59.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.654+0000 7fbce70c4700 1 Processor -- start 2023-01-01T17:39:59.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.654+0000 7fbce70c4700 1 -- start start 2023-01-01T17:39:59.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.655+0000 7fbce70c4700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fbce0150280 0x7fbce006a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:59.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.655+0000 7fbce70c4700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbce00c1a70 0x7fbce00bfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:59.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.655+0000 7fbce70c4700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce006f1e0 con 0x7fbce006a8b0 2023-01-01T17:39:59.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.655+0000 7fbce70c4700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce0152d40 con 0x7fbce0150280 2023-01-01T17:39:59.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.655+0000 7fbce70c4700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce0071950 con 0x7fbce00c1a70 2023-01-01T17:39:59.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.656+0000 7fbce4e60700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fbce0150280 0x7fbce006a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:59.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.656+0000 7fbce4e60700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fbce0150280 0x7fbce006a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46138/0 (socket says 172.21.15.61:46138) 2023-01-01T17:39:59.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.656+0000 7fbce4e60700 1 -- 172.21.15.61:0/212439623 learned_addr learned my addr 172.21.15.61:0/212439623 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:59.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.656+0000 7fbcdffff700 1 --2- 172.21.15.61:0/212439623 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbce00c1a70 0x7fbce00bfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:59.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.656+0000 7fbce4e60700 1 -- 172.21.15.61:0/212439623 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbce00c1a70 msgr2=0x7fbce00bfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:39:59.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.656+0000 7fbce4e60700 1 --2- 172.21.15.61:0/212439623 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbce00c1a70 0x7fbce00bfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.656+0000 7fbce4e60700 1 -- 172.21.15.61:0/212439623 >> v1:172.21.15.149:6789/0 conn(0x7fbce006a8b0 legacy=0x7fbce0156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:59.658 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.656+0000 7fbce4e60700 1 -- 172.21.15.61:0/212439623 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce006f710 con 0x7fbce0150280 2023-01-01T17:39:59.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.656+0000 7fbce4e60700 1 --2- 172.21.15.61:0/212439623 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbce0150280 0x7fbce006a370 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbcd00098f0 tx=0x7fbcd0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e657c80180bcd6b server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:59.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.656+0000 7fbcdf7fe700 1 -- 172.21.15.61:0/212439623 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd000b8a0 con 0x7fbce0150280 2023-01-01T17:39:59.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.656+0000 7fbcdf7fe700 1 -- 172.21.15.61:0/212439623 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd000ba00 con 0x7fbce0150280 2023-01-01T17:39:59.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.656+0000 7fbcdf7fe700 1 -- 172.21.15.61:0/212439623 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd000bd90 con 0x7fbce0150280 2023-01-01T17:39:59.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.657+0000 7fbce70c4700 1 -- 172.21.15.61:0/212439623 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbce0150280 msgr2=0x7fbce006a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:59.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.657+0000 7fbce70c4700 1 --2- 172.21.15.61:0/212439623 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbce0150280 0x7fbce006a370 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbcd00098f0 tx=0x7fbcd0009c00 comp rx=0 tx=0).stop 2023-01-01T17:39:59.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.657+0000 7fbce70c4700 1 -- 172.21.15.61:0/212439623 shutdown_connections 2023-01-01T17:39:59.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.657+0000 7fbce70c4700 1 --2- 172.21.15.61:0/212439623 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbce0150280 0x7fbce006a370 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.657+0000 7fbce70c4700 1 --2- 172.21.15.61:0/212439623 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbce00c1a70 0x7fbce00bfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.657+0000 7fbce70c4700 1 -- 172.21.15.61:0/212439623 >> 172.21.15.61:0/212439623 conn(0x7fbce00c1f30 msgr2=0x7fbce00c2330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:59.659 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.657+0000 7fbce70c4700 1 -- 172.21.15.61:0/212439623 shutdown_connections 2023-01-01T17:39:59.660 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.657+0000 7fbce70c4700 1 -- 172.21.15.61:0/212439623 wait complete. 2023-01-01T17:39:59.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.658+0000 7fbce70c4700 1 Processor -- start 2023-01-01T17:39:59.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.658+0000 7fbce70c4700 1 -- start start 2023-01-01T17:39:59.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.659+0000 7fbce70c4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbce006a8b0 0x7fbce006bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:59.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.659+0000 7fbce70c4700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbce00c1a70 0x7fbce01ebf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:59.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.659+0000 7fbce70c4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbce0150280 0x7fbce00bb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:59.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.659+0000 7fbce70c4700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce0145660 con 0x7fbce006a8b0 2023-01-01T17:39:59.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.659+0000 7fbce70c4700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce01ebb00 con 0x7fbce0150280 2023-01-01T17:39:59.664 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.659+0000 7fbce70c4700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce00c52a0 con 0x7fbce00c1a70 2023-01-01T17:39:59.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.659+0000 7fbce4e60700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbce006a8b0 0x7fbce006bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:59.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.660+0000 7fbce4e60700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbce006a8b0 0x7fbce006bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46144/0 (socket says 172.21.15.61:46144) 2023-01-01T17:39:59.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.660+0000 7fbce4e60700 1 -- 172.21.15.61:0/2588645254 learned_addr learned my addr 172.21.15.61:0/2588645254 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:39:59.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.660+0000 7fbcdffff700 1 --2- 172.21.15.61:0/2588645254 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbce00c1a70 0x7fbce01ebf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:59.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.660+0000 7fbce5661700 1 --2- 172.21.15.61:0/2588645254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbce0150280 0x7fbce00bb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:59.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.660+0000 7fbce4e60700 1 -- 172.21.15.61:0/2588645254 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbce00c1a70 msgr2=0x7fbce01ebf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:59.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.660+0000 7fbce4e60700 1 --2- 172.21.15.61:0/2588645254 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbce00c1a70 0x7fbce01ebf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.660+0000 7fbce4e60700 1 -- 172.21.15.61:0/2588645254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbce0150280 msgr2=0x7fbce00bb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:59.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.660+0000 7fbce4e60700 1 --2- 172.21.15.61:0/2588645254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbce0150280 0x7fbce00bb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.660+0000 7fbce4e60700 1 -- 172.21.15.61:0/2588645254 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd0009550 con 0x7fbce006a8b0 2023-01-01T17:39:59.665 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.660+0000 7fbce4e60700 1 --2- 172.21.15.61:0/2588645254 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbce006a8b0 0x7fbce006bd40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0009c40 tx=0x7fbcd0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:59.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.660+0000 7fbcdd7fa700 1 -- 172.21.15.61:0/2588645254 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd0004300 con 0x7fbce006a8b0 2023-01-01T17:39:59.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.660+0000 7fbcdd7fa700 1 -- 172.21.15.61:0/2588645254 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd001f070 con 0x7fbce006a8b0 2023-01-01T17:39:59.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.660+0000 7fbce70c4700 1 -- 172.21.15.61:0/2588645254 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce0152f30 con 0x7fbce006a8b0 2023-01-01T17:39:59.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.660+0000 7fbcdd7fa700 1 -- 172.21.15.61:0/2588645254 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd00036a0 con 0x7fbce006a8b0 2023-01-01T17:39:59.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.660+0000 7fbce70c4700 1 -- 172.21.15.61:0/2588645254 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce006f430 con 0x7fbce006a8b0 2023-01-01T17:39:59.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.661+0000 7fbce70c4700 1 -- 172.21.15.61:0/2588645254 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbce0153210 con 0x7fbce006a8b0 2023-01-01T17:39:59.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.661+0000 7fbcdd7fa700 1 -- 172.21.15.61:0/2588645254 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7fbcd002a020 con 0x7fbce006a8b0 2023-01-01T17:39:59.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.662+0000 7fbcdd7fa700 1 --2- 172.21.15.61:0/2588645254 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fbcc0063290 0x7fbcc0065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:39:59.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.662+0000 7fbcdd7fa700 1 -- 172.21.15.61:0/2588645254 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbcd0081140 con 0x7fbce006a8b0 2023-01-01T17:39:59.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.662+0000 7fbcdffff700 1 --2- 172.21.15.61:0/2588645254 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fbcc0063290 0x7fbcc0065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:39:59.666 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.662+0000 7fbcdffff700 1 --2- 172.21.15.61:0/2588645254 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fbcc0063290 0x7fbcc0065740 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbce0151fd0 tx=0x7fbcc8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:39:59.667 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.666+0000 7fbcdd7fa700 1 -- 172.21.15.61:0/2588645254 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7fbcd004ff00 con 0x7fbce006a8b0 2023-01-01T17:39:59.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.904+0000 7fbce70c4700 1 -- 172.21.15.61:0/2588645254 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbce01ebde0 con 0x7fbce006a8b0 2023-01-01T17:39:59.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.904+0000 7fbcdd7fa700 1 -- 172.21.15.61:0/2588645254 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7fbcd0053520 con 0x7fbce006a8b0 2023-01-01T17:39:59.904 INFO:teuthology.orchestra.run.smithi061.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-01-01T17:39:59.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.906+0000 7fbce70c4700 1 -- 172.21.15.61:0/2588645254 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fbcc0063290 msgr2=0x7fbcc0065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:59.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.906+0000 7fbce70c4700 1 --2- 172.21.15.61:0/2588645254 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fbcc0063290 0x7fbcc0065740 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbce0151fd0 tx=0x7fbcc8008040 comp rx=0 tx=0).stop 2023-01-01T17:39:59.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.906+0000 7fbce70c4700 1 -- 172.21.15.61:0/2588645254 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbce006a8b0 msgr2=0x7fbce006bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:39:59.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.906+0000 7fbce70c4700 1 --2- 172.21.15.61:0/2588645254 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbce006a8b0 0x7fbce006bd40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0009c40 tx=0x7fbcd0004750 comp rx=0 tx=0).stop 2023-01-01T17:39:59.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.906+0000 7fbce70c4700 1 -- 172.21.15.61:0/2588645254 shutdown_connections 2023-01-01T17:39:59.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.906+0000 7fbce70c4700 1 --2- 172.21.15.61:0/2588645254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbce0150280 0x7fbce00bb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.906+0000 7fbce70c4700 1 --2- 172.21.15.61:0/2588645254 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fbcc0063290 0x7fbcc0065740 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.906+0000 7fbce70c4700 1 --2- 172.21.15.61:0/2588645254 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fbce006a8b0 0x7fbce006bd40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.906+0000 7fbce70c4700 1 --2- 172.21.15.61:0/2588645254 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fbce00c1a70 0x7fbce01ebf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:39:59.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.906+0000 7fbce70c4700 1 -- 172.21.15.61:0/2588645254 >> 172.21.15.61:0/2588645254 conn(0x7fbce00c1f30 msgr2=0x7fbce006b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:39:59.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.906+0000 7fbce70c4700 1 -- 172.21.15.61:0/2588645254 shutdown_connections 2023-01-01T17:39:59.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:39:59.906+0000 7fbce70c4700 1 -- 172.21.15.61:0/2588645254 wait complete. 2023-01-01T17:39:59.918 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-01-01T17:39:59.918 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-01-01T17:39:59.918 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi061.front.sepia.ceph.com 2023-01-01T17:39:59.918 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-01-01T17:39:59.918 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-01-01T17:39:59.918 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-01-01T17:39:59.918 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-01-01T17:39:59.918 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-01-01T17:39:59.918 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-01-01T17:39:59.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:39:59.919 DEBUG:teuthology.orchestra.run.smithi061:> ip addr 2023-01-01T17:39:59.936 INFO:teuthology.orchestra.run.smithi061.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-01-01T17:39:59.936 INFO:teuthology.orchestra.run.smithi061.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-01-01T17:39:59.936 INFO:teuthology.orchestra.run.smithi061.stdout: inet 127.0.0.1/8 scope host lo 2023-01-01T17:39:59.936 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-01-01T17:39:59.936 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 ::1/128 scope host 2023-01-01T17:39:59.936 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-01-01T17:39:59.936 INFO:teuthology.orchestra.run.smithi061.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-01-01T17:39:59.936 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:a8:bb:0c brd ff:ff:ff:ff:ff:ff 2023-01-01T17:39:59.937 INFO:teuthology.orchestra.run.smithi061.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-01-01T17:39:59.937 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:a8:bb:0d brd ff:ff:ff:ff:ff:ff 2023-01-01T17:39:59.937 INFO:teuthology.orchestra.run.smithi061.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-01-01T17:39:59.937 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:b6:f8:b8 brd ff:ff:ff:ff:ff:ff 2023-01-01T17:39:59.937 INFO:teuthology.orchestra.run.smithi061.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-01-01T17:39:59.937 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:b6:f8:b9 brd ff:ff:ff:ff:ff:ff 2023-01-01T17:39:59.937 INFO:teuthology.orchestra.run.smithi061.stdout: inet 172.21.15.61/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-01-01T17:39:59.937 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft 42525sec preferred_lft 42525sec 2023-01-01T17:39:59.937 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::f70e:cc41:1d49:8df7/64 scope link noprefixroute 2023-01-01T17:39:59.937 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-01-01T17:39:59.938 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-01-01T17:39:59.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:39:59.938 DEBUG:teuthology.orchestra.run.smithi061:> (cd / && exec bash -c ' 2023-01-01T17:39:59.938 DEBUG:teuthology.orchestra.run.smithi061:> set -e 2023-01-01T17:39:59.938 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip link add name ceph-brx type bridge 2023-01-01T17:39:59.938 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip addr flush dev ceph-brx 2023-01-01T17:39:59.938 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip link set ceph-brx up 2023-01-01T17:39:59.939 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-01-01T17:39:59.939 DEBUG:teuthology.orchestra.run.smithi061:> ') 2023-01-01T17:40:00.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:00.114 DEBUG:teuthology.orchestra.run.smithi061:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-01-01T17:40:00.142 INFO:teuthology.orchestra.run.smithi061.stdout:1 2023-01-01T17:40:00.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:00.144 DEBUG:teuthology.orchestra.run.smithi061:> route 2023-01-01T17:40:00.215 INFO:teuthology.orchestra.run.smithi061.stdout:Kernel IP routing table 2023-01-01T17:40:00.215 INFO:teuthology.orchestra.run.smithi061.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-01-01T17:40:00.215 INFO:teuthology.orchestra.run.smithi061.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-01-01T17:40:00.215 INFO:teuthology.orchestra.run.smithi061.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-01-01T17:40:00.215 INFO:teuthology.orchestra.run.smithi061.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-01-01T17:40:00.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:00.216 DEBUG:teuthology.orchestra.run.smithi061:> (cd / && exec bash -c ' 2023-01-01T17:40:00.216 DEBUG:teuthology.orchestra.run.smithi061:> set -e 2023-01-01T17:40:00.216 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-01-01T17:40:00.216 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-01-01T17:40:00.216 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-01-01T17:40:00.216 DEBUG:teuthology.orchestra.run.smithi061:> ') 2023-01-01T17:40:00.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:00.487 DEBUG:teuthology.orchestra.run.smithi061:> ip netns list 2023-01-01T17:40:00.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:00.504 DEBUG:teuthology.orchestra.run.smithi061:> ip netns list-id 2023-01-01T17:40:00.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:00.561 DEBUG:teuthology.orchestra.run.smithi061:> (cd / && exec bash -c ' 2023-01-01T17:40:00.562 DEBUG:teuthology.orchestra.run.smithi061:> set -e 2023-01-01T17:40:00.562 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-01-01T17:40:00.562 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-01-01T17:40:00.562 DEBUG:teuthology.orchestra.run.smithi061:> ') 2023-01-01T17:40:00.659 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-01-01T17:40:00.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:00.659 DEBUG:teuthology.orchestra.run.smithi061:> (cd / && exec bash -c ' 2023-01-01T17:40:00.659 DEBUG:teuthology.orchestra.run.smithi061:> set -e 2023-01-01T17:40:00.659 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-01-01T17:40:00.659 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-01-01T17:40:00.659 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-01-01T17:40:00.660 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-01-01T17:40:00.660 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-01-01T17:40:00.660 DEBUG:teuthology.orchestra.run.smithi061:> ') 2023-01-01T17:40:00.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:00.895 DEBUG:teuthology.orchestra.run.smithi061:> (cd / && exec bash -c ' 2023-01-01T17:40:00.895 DEBUG:teuthology.orchestra.run.smithi061:> set -e 2023-01-01T17:40:00.895 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip link set brx.0 up 2023-01-01T17:40:00.895 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip link set dev brx.0 master ceph-brx 2023-01-01T17:40:00.895 DEBUG:teuthology.orchestra.run.smithi061:> ') 2023-01-01T17:40:01.005 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-01-01T17:40:01.005 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-01-01T17:40:01.005 DEBUG:teuthology.orchestra.run.smithi061:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-01-01T17:40:01.023 INFO:teuthology.orchestra.run.smithi061.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-01-01T17:40:01.024 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-01-01T17:40:01.024 DEBUG:teuthology.orchestra.run.smithi061:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-01-01T17:40:01.080 DEBUG:teuthology.orchestra.run.smithi061:> sudo modprobe fuse 2023-01-01T17:40:01.148 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-01-01T17:40:01.148 DEBUG:teuthology.orchestra.run.smithi061:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-01-01T17:40:01.215 INFO:teuthology.orchestra.run.smithi061.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-01-01T17:40:01.216 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-01-01T17:40:01.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:01.216 DEBUG:teuthology.orchestra.run.smithi061:> ls /sys/fs/fuse/connections 2023-01-01T17:40:01.273 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-01-01T17:40:01.274 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_mountpoint=/ --client_fs=cephfs) 2023-01-01T17:40:01.316 DEBUG:teuthology.orchestra.run.smithi061:> sudo modprobe fuse 2023-01-01T17:40:01.344 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-01-01T17:40:01.344 DEBUG:teuthology.orchestra.run.smithi061:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-01-01T17:40:01.411 INFO:teuthology.orchestra.run.smithi061.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-01-01T17:40:01.412 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-01-01T17:40:01.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:01.412 DEBUG:teuthology.orchestra.run.smithi061:> ls /sys/fs/fuse/connections 2023-01-01T17:40:01.419 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi061.stderr:2023-01-01T17:40:01.419+0000 7f5e691585c0 -1 init, newargv = 0x561a0b9f89a0 newargc=15 2023-01-01T17:40:01.419 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi061.stderr:ceph-fuse[100368]: starting ceph client 2023-01-01T17:40:01.425 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi061.stderr:ceph-fuse[100368]: starting fuse 2023-01-01T17:40:01.437 INFO:teuthology.orchestra.run.smithi061.stdout:46 2023-01-01T17:40:01.437 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-01-01T17:40:01.437 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-01-01T17:40:01.437 DEBUG:teuthology.orchestra.run.smithi061:> import glob 2023-01-01T17:40:01.437 DEBUG:teuthology.orchestra.run.smithi061:> import re 2023-01-01T17:40:01.437 DEBUG:teuthology.orchestra.run.smithi061:> import os 2023-01-01T17:40:01.438 DEBUG:teuthology.orchestra.run.smithi061:> import subprocess 2023-01-01T17:40:01.438 DEBUG:teuthology.orchestra.run.smithi061:> 2023-01-01T17:40:01.438 DEBUG:teuthology.orchestra.run.smithi061:> def _find_admin_socket(client_name): 2023-01-01T17:40:01.438 DEBUG:teuthology.orchestra.run.smithi061:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-01-01T17:40:01.438 DEBUG:teuthology.orchestra.run.smithi061:> files = glob.glob(asok_path) 2023-01-01T17:40:01.438 DEBUG:teuthology.orchestra.run.smithi061:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-01-01T17:40:01.438 DEBUG:teuthology.orchestra.run.smithi061:> 2023-01-01T17:40:01.438 DEBUG:teuthology.orchestra.run.smithi061:> # Given a non-glob path, it better be there 2023-01-01T17:40:01.438 DEBUG:teuthology.orchestra.run.smithi061:> if "*" not in asok_path: 2023-01-01T17:40:01.438 DEBUG:teuthology.orchestra.run.smithi061:> assert(len(files) == 1) 2023-01-01T17:40:01.438 DEBUG:teuthology.orchestra.run.smithi061:> return files[0] 2023-01-01T17:40:01.438 DEBUG:teuthology.orchestra.run.smithi061:> 2023-01-01T17:40:01.438 DEBUG:teuthology.orchestra.run.smithi061:> for f in files: 2023-01-01T17:40:01.438 DEBUG:teuthology.orchestra.run.smithi061:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-01-01T17:40:01.439 DEBUG:teuthology.orchestra.run.smithi061:> if os.path.exists("/proc/{0}".format(pid)): 2023-01-01T17:40:01.439 DEBUG:teuthology.orchestra.run.smithi061:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-01-01T17:40:01.439 DEBUG:teuthology.orchestra.run.smithi061:> contents = proc_f.read() 2023-01-01T17:40:01.439 DEBUG:teuthology.orchestra.run.smithi061:> if mountpoint in contents: 2023-01-01T17:40:01.439 DEBUG:teuthology.orchestra.run.smithi061:> return f 2023-01-01T17:40:01.439 DEBUG:teuthology.orchestra.run.smithi061:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-01-01T17:40:01.439 DEBUG:teuthology.orchestra.run.smithi061:> 2023-01-01T17:40:01.439 DEBUG:teuthology.orchestra.run.smithi061:> print(_find_admin_socket("client.admin")) 2023-01-01T17:40:01.439 DEBUG:teuthology.orchestra.run.smithi061:> ' 2023-01-01T17:40:01.564 INFO:teuthology.orchestra.run.smithi061.stdout:/var/run/ceph/ceph-client.admin.100368.asok 2023-01-01T17:40:01.746 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.100368.asok 2023-01-01T17:40:01.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:01.747 DEBUG:teuthology.orchestra.run.smithi061:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.100368.asok status 2023-01-01T17:40:01.907 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-01-01T17:40:01.908 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": { 2023-01-01T17:40:01.908 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_sha1": "2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a", 2023-01-01T17:40:01.908 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_version": "ceph version 18.0.0-1638-g2d451fdb (2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a) reef (dev)", 2023-01-01T17:40:01.908 INFO:teuthology.orchestra.run.smithi061.stdout: "entity_id": "admin", 2023-01-01T17:40:01.908 INFO:teuthology.orchestra.run.smithi061.stdout: "hostname": "smithi061", 2023-01-01T17:40:01.908 INFO:teuthology.orchestra.run.smithi061.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-01-01T17:40:01.908 INFO:teuthology.orchestra.run.smithi061.stdout: "pid": "100368", 2023-01-01T17:40:01.908 INFO:teuthology.orchestra.run.smithi061.stdout: "root": "/" 2023-01-01T17:40:01.908 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-01-01T17:40:01.908 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_count": 0, 2023-01-01T17:40:01.909 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_pinned_count": 0, 2023-01-01T17:40:01.909 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 4419, 2023-01-01T17:40:01.909 INFO:teuthology.orchestra.run.smithi061.stdout: "inst": { 2023-01-01T17:40:01.909 INFO:teuthology.orchestra.run.smithi061.stdout: "name": { 2023-01-01T17:40:01.909 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "client", 2023-01-01T17:40:01.909 INFO:teuthology.orchestra.run.smithi061.stdout: "num": 4419 2023-01-01T17:40:01.909 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-01-01T17:40:01.909 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-01-01T17:40:01.909 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-01-01T17:40:01.909 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-01-01T17:40:01.909 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 4067854871 2023-01-01T17:40:01.909 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-01-01T17:40:01.910 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-01-01T17:40:01.910 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-01-01T17:40:01.910 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-01-01T17:40:01.910 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-01-01T17:40:01.910 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 4067854871 2023-01-01T17:40:01.910 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-01-01T17:40:01.910 INFO:teuthology.orchestra.run.smithi061.stdout: "inst_str": "client.4419 192.168.0.1:0/4067854871", 2023-01-01T17:40:01.910 INFO:teuthology.orchestra.run.smithi061.stdout: "addr_str": "192.168.0.1:0/4067854871", 2023-01-01T17:40:01.910 INFO:teuthology.orchestra.run.smithi061.stdout: "inode_count": 1, 2023-01-01T17:40:01.910 INFO:teuthology.orchestra.run.smithi061.stdout: "mds_epoch": 7, 2023-01-01T17:40:01.910 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch": 24, 2023-01-01T17:40:01.910 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch_barrier": 0, 2023-01-01T17:40:01.910 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklisted": false, 2023-01-01T17:40:01.911 INFO:teuthology.orchestra.run.smithi061.stdout: "fs_name": "cephfs" 2023-01-01T17:40:01.911 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-01-01T17:40:01.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:01.921 DEBUG:teuthology.orchestra.run.smithi061:> stat --file-system '--printf=%T 2023-01-01T17:40:01.921 DEBUG:teuthology.orchestra.run.smithi061:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-01-01T17:40:01.941 INFO:teuthology.orchestra.run.smithi061.stdout:fuseblk 2023-01-01T17:40:01.941 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-01-01T17:40:01.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:01.941 DEBUG:teuthology.orchestra.run.smithi061:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-01-01T17:40:02.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:02.010 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-01-01T17:40:02.107 INFO:teuthology.orchestra.run.smithi061.stdout:# file: . 2023-01-01T17:40:02.108 INFO:teuthology.orchestra.run.smithi061.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-01-01T17:40:02.108 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:40:02.108 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-01-01T17:40:02.108 DEBUG:teuthology.orchestra.run.smithi061:> dd if=/proc/self/mounts of=/dev/stdout 2023-01-01T17:40:02.127 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-01T17:40:02.289 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.290+0000 7f4eb89d3700 1 Processor -- start 2023-01-01T17:40:02.290 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.290+0000 7f4eb89d3700 1 -- start start 2023-01-01T17:40:02.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.291+0000 7f4eb89d3700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4eb406a640 0x7f4eb414ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:02.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.291+0000 7f4eb89d3700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4eb40c1ad0 0x7f4eb41504e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:02.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.291+0000 7f4eb89d3700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eb406dc10 con 0x7f4eb4157030 2023-01-01T17:40:02.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.291+0000 7f4eb89d3700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eb4071770 con 0x7f4eb406a640 2023-01-01T17:40:02.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.291+0000 7f4eb89d3700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb4156ba0 con 0x7f4eb40c1ad0 2023-01-01T17:40:02.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.291+0000 7f4eb2d9d700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f4eb4157030 0x7f4eb4152de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40028/0 (socket says 172.21.15.61:40028) 2023-01-01T17:40:02.293 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.291+0000 7f4eb2d9d700 1 -- 172.21.15.61:0/648220464 learned_addr learned my addr 172.21.15.61:0/648220464 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:40:02.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.291+0000 7f4eb1d9b700 1 --2- 172.21.15.61:0/648220464 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4eb40c1ad0 0x7f4eb41504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:02.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.291+0000 7f4eb259c700 1 --2- 172.21.15.61:0/648220464 >> v2:172.21.15.149:3300/0 conn(0x7f4eb406a640 0x7f4eb414ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:02.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.291+0000 7f4eb159a700 1 -- 172.21.15.61:0/648220464 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2511938052 0 0) 0x7f4eb406dc10 con 0x7f4eb4157030 2023-01-01T17:40:02.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.291+0000 7f4eb159a700 1 -- 172.21.15.61:0/648220464 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e9c0035b0 con 0x7f4eb4157030 2023-01-01T17:40:02.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.292+0000 7f4eb159a700 1 -- 172.21.15.61:0/648220464 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 687946292 0 0) 0x7f4e9c0035b0 con 0x7f4eb4157030 2023-01-01T17:40:02.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.292+0000 7f4eb159a700 1 -- 172.21.15.61:0/648220464 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4eb40c1ad0 msgr2=0x7f4eb41504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:02.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.292+0000 7f4eb159a700 1 --2- 172.21.15.61:0/648220464 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4eb40c1ad0 0x7f4eb41504e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:02.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.292+0000 7f4eb159a700 1 -- 172.21.15.61:0/648220464 >> v2:172.21.15.149:3300/0 conn(0x7f4eb406a640 msgr2=0x7f4eb414ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:02.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.292+0000 7f4eb159a700 1 --2- 172.21.15.61:0/648220464 >> v2:172.21.15.149:3300/0 conn(0x7f4eb406a640 0x7f4eb414ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:02.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.292+0000 7f4eb159a700 1 -- 172.21.15.61:0/648220464 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb406f7a0 con 0x7f4eb4157030 2023-01-01T17:40:02.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.292+0000 7f4eb159a700 1 -- 172.21.15.61:0/648220464 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586489653 0 0) 0x7f4eac0019f0 con 0x7f4eb4157030 2023-01-01T17:40:02.295 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.292+0000 7f4eb159a700 1 -- 172.21.15.61:0/648220464 >> v1:172.21.15.61:6789/0 conn(0x7f4eb4157030 legacy=0x7f4eb4152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:02.295 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.292+0000 7f4eb159a700 1 --2- 172.21.15.61:0/648220464 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4e9c003a00 0x7f4e9c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:02.295 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.292+0000 7f4eb159a700 1 --2- 172.21.15.61:0/648220464 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4eb40c1ad0 0x7f4e9c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:02.295 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.292+0000 7f4eb159a700 1 --2- 172.21.15.61:0/648220464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e9c004d90 0x7f4e9c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:02.295 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.292+0000 7f4eb159a700 1 -- 172.21.15.61:0/648220464 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb4156ba0 con 0x7f4e9c003a00 2023-01-01T17:40:02.295 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.292+0000 7f4eb159a700 1 -- 172.21.15.61:0/648220464 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c00ba10 con 0x7f4e9c004d90 2023-01-01T17:40:02.295 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.292+0000 7f4eb159a700 1 -- 172.21.15.61:0/648220464 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c00bb50 con 0x7f4eb40c1ad0 2023-01-01T17:40:02.295 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.292+0000 7f4eb259c700 1 --2- 172.21.15.61:0/648220464 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4e9c003a00 0x7f4e9c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:02.295 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.292+0000 7f4eb2d9d700 1 --2- 172.21.15.61:0/648220464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e9c004d90 0x7f4e9c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:02.295 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.292+0000 7f4eb1d9b700 1 --2- 172.21.15.61:0/648220464 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4eb40c1ad0 0x7f4e9c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:02.295 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.292+0000 7f4eb259c700 1 -- 172.21.15.61:0/648220464 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4eb40c1ad0 msgr2=0x7f4e9c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:02.296 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.292+0000 7f4eb259c700 1 --2- 172.21.15.61:0/648220464 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4eb40c1ad0 0x7f4e9c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:02.296 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.292+0000 7f4eb259c700 1 -- 172.21.15.61:0/648220464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e9c004d90 msgr2=0x7f4e9c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:02.296 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.292+0000 7f4eb259c700 1 --2- 172.21.15.61:0/648220464 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e9c004d90 0x7f4e9c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:02.296 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.292+0000 7f4eb259c700 1 -- 172.21.15.61:0/648220464 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9c0035b0 con 0x7f4e9c003a00 2023-01-01T17:40:02.296 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.292+0000 7f4eb1d9b700 1 --2- 172.21.15.61:0/648220464 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4eb40c1ad0 0x7f4e9c004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-01T17:40:02.296 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.292+0000 7f4eb259c700 1 --2- 172.21.15.61:0/648220464 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4e9c003a00 0x7f4e9c003e10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8009b60 tx=0x7f4e9c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c93a8a3c9fac49e3 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:02.296 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.292+0000 7f4eb159a700 1 -- 172.21.15.61:0/648220464 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea800e6c0 con 0x7f4e9c003a00 2023-01-01T17:40:02.296 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.292+0000 7f4eb159a700 1 -- 172.21.15.61:0/648220464 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea800e820 con 0x7f4e9c003a00 2023-01-01T17:40:02.296 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.292+0000 7f4eb159a700 1 -- 172.21.15.61:0/648220464 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea800eb90 con 0x7f4e9c003a00 2023-01-01T17:40:02.296 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.293+0000 7f4eb89d3700 1 -- 172.21.15.61:0/648220464 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4e9c003a00 msgr2=0x7f4e9c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:02.296 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.293+0000 7f4eb89d3700 1 --2- 172.21.15.61:0/648220464 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4e9c003a00 0x7f4e9c003e10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8009b60 tx=0x7f4e9c005880 comp rx=0 tx=0).stop 2023-01-01T17:40:02.297 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.293+0000 7f4eb2d9d700 1 -- 172.21.15.61:0/648220464 reap_dead start 2023-01-01T17:40:02.297 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.293+0000 7f4eb89d3700 1 -- 172.21.15.61:0/648220464 shutdown_connections 2023-01-01T17:40:02.297 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.293+0000 7f4eb89d3700 1 -- 172.21.15.61:0/648220464 >> 172.21.15.61:0/648220464 conn(0x7f4eb40c1f30 msgr2=0x7f4eb40c2330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:02.297 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.293+0000 7f4eb89d3700 1 -- 172.21.15.61:0/648220464 shutdown_connections 2023-01-01T17:40:02.297 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.293+0000 7f4eb89d3700 1 -- 172.21.15.61:0/648220464 wait complete. 2023-01-01T17:40:02.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.294+0000 7f4eb89d3700 1 Processor -- start 2023-01-01T17:40:02.300 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.294+0000 7f4eb89d3700 1 -- start start 2023-01-01T17:40:02.300 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.295+0000 7f4eb89d3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4e9c003a00 0x7f4eb40beb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:02.300 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.295+0000 7f4eb89d3700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4eb41ec270 0x7f4eb414ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:02.300 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.295+0000 7f4eb89d3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4eb40a94f0 0x7f4eb4145340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:02.300 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.295+0000 7f4eb89d3700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb414cfc0 con 0x7f4e9c003a00 2023-01-01T17:40:02.300 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.295+0000 7f4eb89d3700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb41eb820 con 0x7f4eb40a94f0 2023-01-01T17:40:02.300 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.295+0000 7f4eb89d3700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb41ec6e0 con 0x7f4eb41ec270 2023-01-01T17:40:02.300 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.295+0000 7f4eb259c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4e9c003a00 0x7f4eb40beb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:02.300 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.295+0000 7f4eb259c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4e9c003a00 0x7f4eb40beb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46186/0 (socket says 172.21.15.61:46186) 2023-01-01T17:40:02.300 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.295+0000 7f4eb259c700 1 -- 172.21.15.61:0/92177082 learned_addr learned my addr 172.21.15.61:0/92177082 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:02.300 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.295+0000 7f4eb259c700 1 -- 172.21.15.61:0/92177082 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4eb41ec270 msgr2=0x7f4eb414ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:02.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.295+0000 7f4eb259c700 1 --2- 172.21.15.61:0/92177082 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4eb41ec270 0x7f4eb414ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:02.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.295+0000 7f4eb259c700 1 -- 172.21.15.61:0/92177082 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4eb40a94f0 msgr2=0x7f4eb4145340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:02.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.295+0000 7f4eb2d9d700 1 --2- 172.21.15.61:0/92177082 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4eb40a94f0 0x7f4eb4145340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:02.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.295+0000 7f4eb259c700 1 --2- 172.21.15.61:0/92177082 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4eb40a94f0 0x7f4eb4145340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:02.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.295+0000 7f4eb259c700 1 -- 172.21.15.61:0/92177082 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb406f4c0 con 0x7f4e9c003a00 2023-01-01T17:40:02.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.296+0000 7f4eb259c700 1 --2- 172.21.15.61:0/92177082 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4e9c003a00 0x7f4eb40beb80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c004750 tx=0x7f4ea80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:02.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.296+0000 7f4ea2ffd700 1 -- 172.21.15.61:0/92177082 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea800e6c0 con 0x7f4e9c003a00 2023-01-01T17:40:02.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.296+0000 7f4ea2ffd700 1 -- 172.21.15.61:0/92177082 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea8003ad0 con 0x7f4e9c003a00 2023-01-01T17:40:02.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.296+0000 7f4ea2ffd700 1 -- 172.21.15.61:0/92177082 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8003e80 con 0x7f4e9c003a00 2023-01-01T17:40:02.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.296+0000 7f4eb89d3700 1 -- 172.21.15.61:0/92177082 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eb406f1e0 con 0x7f4e9c003a00 2023-01-01T17:40:02.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.296+0000 7f4eb89d3700 1 -- 172.21.15.61:0/92177082 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eb4156550 con 0x7f4e9c003a00 2023-01-01T17:40:02.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.297+0000 7f4eb89d3700 1 -- 172.21.15.61:0/92177082 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eb40668a0 con 0x7f4e9c003a00 2023-01-01T17:40:02.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.298+0000 7f4ea2ffd700 1 -- 172.21.15.61:0/92177082 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f4ea8019030 con 0x7f4e9c003a00 2023-01-01T17:40:02.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.298+0000 7f4ea2ffd700 1 --2- 172.21.15.61:0/92177082 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f4e94063290 0x7f4e94065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:02.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.298+0000 7f4ea2ffd700 1 -- 172.21.15.61:0/92177082 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4ea8081c00 con 0x7f4e9c003a00 2023-01-01T17:40:02.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.298+0000 7f4eb1d9b700 1 --2- 172.21.15.61:0/92177082 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f4e94063290 0x7f4e94065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:02.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.299+0000 7f4eb1d9b700 1 --2- 172.21.15.61:0/92177082 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f4e94063290 0x7f4e94065740 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4eb40bb5a0 tx=0x7f4ea4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:02.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.302+0000 7f4ea2ffd700 1 -- 172.21.15.61:0/92177082 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f4ea8050aa0 con 0x7f4e9c003a00 2023-01-01T17:40:02.492 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.493+0000 7f4eb89d3700 1 -- 172.21.15.61:0/92177082 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4eb414cfc0 con 0x7f4e9c003a00 2023-01-01T17:40:02.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.494+0000 7f4ea2ffd700 1 -- 172.21.15.61:0/92177082 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18729 (secure 0 0 0) 0x7f4ea8054080 con 0x7f4e9c003a00 2023-01-01T17:40:02.494 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:40:02.494 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":24,"fsid":"fe0d3d8e-46ee-4ed9-92f8-749741721d01","created":"2023-01-01T17:39:34.752404+0000","modified":"2023-01-01T17:39:57.386830+0000","last_up_change":"2023-01-01T17:39:45.159720+0000","last_in_change":"2023-01-01T17:39:37.293057+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-01-01T17:39:46.110776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-01-01T17:39:46.276625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-01-01T17:39:50.568073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-01-01T17:39:51.915351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-01-01T17:39:54.992107+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5ba13bcd-4407-4cfd-8487-80917501e525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":94349},{"type":"v1","addr":"172.21.15.61:6825","nonce":94349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":94349},{"type":"v1","addr":"172.21.15.61:6827","nonce":94349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":94349},{"type":"v1","addr":"172.21.15.61:6831","nonce":94349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":94349},{"type":"v1","addr":"172.21.15.61:6829","nonce":94349}]},"public_addr":"172.21.15.61:6825/94349","cluster_addr":"172.21.15.61:6827/94349","heartbeat_back_addr":"172.21.15.61:6831/94349","heartbeat_front_addr":"172.21.15.61:6829/94349","state":["exists","up"]},{"osd":1,"uuid":"7dca9f34-ea22-4894-b238-5606b16b9c74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6811","nonce":94348},{"type":"v1","addr":"172.21.15.61:6813","nonce":94348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":94348},{"type":"v1","addr":"172.21.15.61:6816","nonce":94348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6821","nonce":94348},{"type":"v1","addr":"172.21.15.61:6823","nonce":94348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":94348},{"type":"v1","addr":"172.21.15.61:6819","nonce":94348}]},"public_addr":"172.21.15.61:6813/94348","cluster_addr":"172.21.15.61:6816/94348","heartbeat_back_addr":"172.21.15.61:6823/94348","heartbeat_front_addr":"172.21.15.61:6819/94348","state":["exists","up"]},{"osd":2,"uuid":"7b43ea06-a7b6-49f4-a390-18ad14dfe4fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":94350},{"type":"v1","addr":"172.21.15.61:6809","nonce":94350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":94350},{"type":"v1","addr":"172.21.15.61:6812","nonce":94350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":94350},{"type":"v1","addr":"172.21.15.61:6822","nonce":94350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6815","nonce":94350},{"type":"v1","addr":"172.21.15.61:6817","nonce":94350}]},"public_addr":"172.21.15.61:6809/94350","cluster_addr":"172.21.15.61:6812/94350","heartbeat_back_addr":"172.21.15.61:6822/94350","heartbeat_front_addr":"172.21.15.61:6817/94350","state":["exists","up"]},{"osd":3,"uuid":"117c41d8-d40c-4cc0-b0e1-70bca058fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":94347},{"type":"v1","addr":"172.21.15.61:6801","nonce":94347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":94347},{"type":"v1","addr":"172.21.15.61:6803","nonce":94347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":94347},{"type":"v1","addr":"172.21.15.61:6807","nonce":94347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":94347},{"type":"v1","addr":"172.21.15.61:6805","nonce":94347}]},"public_addr":"172.21.15.61:6801/94347","cluster_addr":"172.21.15.61:6803/94347","heartbeat_back_addr":"172.21.15.61:6807/94347","heartbeat_front_addr":"172.21.15.61:6805/94347","state":["exists","up"]},{"osd":4,"uuid":"4073e0e8-c5dd-463f-aa1c-c9515ef09976","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":94711},{"type":"v1","addr":"172.21.15.149:6818","nonce":94711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":94711},{"type":"v1","addr":"172.21.15.149:6822","nonce":94711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":94711},{"type":"v1","addr":"172.21.15.149:6830","nonce":94711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":94711},{"type":"v1","addr":"172.21.15.149:6826","nonce":94711}]},"public_addr":"172.21.15.149:6818/94711","cluster_addr":"172.21.15.149:6822/94711","heartbeat_back_addr":"172.21.15.149:6830/94711","heartbeat_front_addr":"172.21.15.149:6826/94711","state":["exists","up"]},{"osd":5,"uuid":"88aa0c0f-e3c1-4dd3-af8c-61f4bc28504e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":94709},{"type":"v1","addr":"172.21.15.149:6809","nonce":94709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":94709},{"type":"v1","addr":"172.21.15.149:6811","nonce":94709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":94709},{"type":"v1","addr":"172.21.15.149:6815","nonce":94709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":94709},{"type":"v1","addr":"172.21.15.149:6813","nonce":94709}]},"public_addr":"172.21.15.149:6809/94709","cluster_addr":"172.21.15.149:6811/94709","heartbeat_back_addr":"172.21.15.149:6815/94709","heartbeat_front_addr":"172.21.15.149:6813/94709","state":["exists","up"]},{"osd":6,"uuid":"8b13fc0c-5f00-41c7-8923-c4570da77afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":94710},{"type":"v1","addr":"172.21.15.149:6801","nonce":94710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":94710},{"type":"v1","addr":"172.21.15.149:6803","nonce":94710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":94710},{"type":"v1","addr":"172.21.15.149:6807","nonce":94710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":94710},{"type":"v1","addr":"172.21.15.149:6805","nonce":94710}]},"public_addr":"172.21.15.149:6801/94710","cluster_addr":"172.21.15.149:6803/94710","heartbeat_back_addr":"172.21.15.149:6807/94710","heartbeat_front_addr":"172.21.15.149:6805/94710","state":["exists","up"]},{"osd":7,"uuid":"5390c6e5-39e7-4aa6-b73c-642458b2acf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":94734},{"type":"v1","addr":"172.21.15.149:6819","nonce":94734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":94734},{"type":"v1","addr":"172.21.15.149:6823","nonce":94734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":94734},{"type":"v1","addr":"172.21.15.149:6831","nonce":94734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":94734},{"type":"v1","addr":"172.21.15.149:6827","nonce":94734}]},"public_addr":"172.21.15.149:6819/94734","cluster_addr":"172.21.15.149:6823/94734","heartbeat_back_addr":"172.21.15.149:6831/94734","heartbeat_front_addr":"172.21.15.149:6827/94734","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.555826+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.508739+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.515601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.472067+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.535257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.493397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.554910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.552343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-01T17:40:02.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.496+0000 7f4eb89d3700 1 -- 172.21.15.61:0/92177082 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f4e94063290 msgr2=0x7f4e94065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:02.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.496+0000 7f4eb89d3700 1 --2- 172.21.15.61:0/92177082 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f4e94063290 0x7f4e94065740 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4eb40bb5a0 tx=0x7f4ea4008040 comp rx=0 tx=0).stop 2023-01-01T17:40:02.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.496+0000 7f4eb89d3700 1 -- 172.21.15.61:0/92177082 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4e9c003a00 msgr2=0x7f4eb40beb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:02.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.496+0000 7f4eb89d3700 1 --2- 172.21.15.61:0/92177082 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4e9c003a00 0x7f4eb40beb80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c004750 tx=0x7f4ea80047c0 comp rx=0 tx=0).stop 2023-01-01T17:40:02.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.496+0000 7f4eb89d3700 1 -- 172.21.15.61:0/92177082 shutdown_connections 2023-01-01T17:40:02.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.496+0000 7f4eb89d3700 1 --2- 172.21.15.61:0/92177082 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4eb40a94f0 0x7f4eb4145340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:02.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.496+0000 7f4eb89d3700 1 --2- 172.21.15.61:0/92177082 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f4e94063290 0x7f4e94065740 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:02.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.496+0000 7f4eb89d3700 1 --2- 172.21.15.61:0/92177082 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4e9c003a00 0x7f4eb40beb80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:02.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.496+0000 7f4eb89d3700 1 --2- 172.21.15.61:0/92177082 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4eb41ec270 0x7f4eb414ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:02.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.496+0000 7f4eb89d3700 1 -- 172.21.15.61:0/92177082 >> 172.21.15.61:0/92177082 conn(0x7f4eb40c1f30 msgr2=0x7f4eb4155d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:02.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.496+0000 7f4eb89d3700 1 -- 172.21.15.61:0/92177082 shutdown_connections 2023-01-01T17:40:02.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.496+0000 7f4eb89d3700 1 -- 172.21.15.61:0/92177082 wait complete. 2023-01-01T17:40:02.507 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-01-01T17:39:46.110776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-01-01T17:39:46.276625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-01-01T17:39:50.568073+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-01-01T17:39:51.915351+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-01-01T17:39:54.992107+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-01-01T17:40:02.508 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-01-01T17:40:02.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.636+0000 7fec1e538700 1 Processor -- start 2023-01-01T17:40:02.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.636+0000 7fec1e538700 1 -- start start 2023-01-01T17:40:02.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.637+0000 7fec1e538700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec180c68c0 0x7fec181567c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:02.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.637+0000 7fec1e538700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec180c4e30 con 0x7fec18071750 2023-01-01T17:40:02.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.637+0000 7fec1e538700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec181562c0 con 0x7fec180c64f0 2023-01-01T17:40:02.639 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.637+0000 7fec1e538700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1806de00 con 0x7fec180c68c0 2023-01-01T17:40:02.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.637+0000 7fec1cad5700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fec18071750 0x7fec1814f9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40048/0 (socket says 172.21.15.61:40048) 2023-01-01T17:40:02.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.637+0000 7fec1cad5700 1 -- 172.21.15.61:0/116326545 learned_addr learned my addr 172.21.15.61:0/116326545 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:40:02.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.637+0000 7fec16ffd700 1 -- 172.21.15.61:0/116326545 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1106448378 0 0) 0x7fec180c4e30 con 0x7fec18071750 2023-01-01T17:40:02.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.637+0000 7fec16ffd700 1 -- 172.21.15.61:0/116326545 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec040035b0 con 0x7fec18071750 2023-01-01T17:40:02.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.637+0000 7fec177fe700 1 --2- 172.21.15.61:0/116326545 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec180c68c0 0x7fec181567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:02.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.637+0000 7fec16ffd700 1 -- 172.21.15.61:0/116326545 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2772992698 0 0) 0x7fec040035b0 con 0x7fec18071750 2023-01-01T17:40:02.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.637+0000 7fec16ffd700 1 -- 172.21.15.61:0/116326545 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec180c68c0 msgr2=0x7fec181567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:02.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.637+0000 7fec16ffd700 1 --2- 172.21.15.61:0/116326545 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec180c68c0 0x7fec181567c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:02.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.637+0000 7fec16ffd700 1 -- 172.21.15.61:0/116326545 >> v1:172.21.15.149:6789/0 conn(0x7fec180c64f0 legacy=0x7fec180c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:02.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.637+0000 7fec16ffd700 1 -- 172.21.15.61:0/116326545 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec180c5080 con 0x7fec18071750 2023-01-01T17:40:02.640 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.637+0000 7fec16ffd700 1 -- 172.21.15.61:0/116326545 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586489653 0 0) 0x7fec100019f0 con 0x7fec18071750 2023-01-01T17:40:02.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.637+0000 7fec16ffd700 1 -- 172.21.15.61:0/116326545 >> v1:172.21.15.61:6789/0 conn(0x7fec18071750 legacy=0x7fec1814f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:02.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.637+0000 7fec16ffd700 1 --2- 172.21.15.61:0/116326545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec04003a30 0x7fec04003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:02.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.637+0000 7fec16ffd700 1 --2- 172.21.15.61:0/116326545 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec04004850 0x7fec04004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:02.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.637+0000 7fec16ffd700 1 --2- 172.21.15.61:0/116326545 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fec040051c0 0x7fec0400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:02.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.637+0000 7fec16ffd700 1 -- 172.21.15.61:0/116326545 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1806de00 con 0x7fec040051c0 2023-01-01T17:40:02.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.637+0000 7fec16ffd700 1 -- 172.21.15.61:0/116326545 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0400bf80 con 0x7fec04003a30 2023-01-01T17:40:02.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.637+0000 7fec16ffd700 1 -- 172.21.15.61:0/116326545 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec0400c140 con 0x7fec04004850 2023-01-01T17:40:02.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.638+0000 7fec1cad5700 1 --2- 172.21.15.61:0/116326545 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fec040051c0 0x7fec0400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:02.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.638+0000 7fec177fe700 1 --2- 172.21.15.61:0/116326545 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec04004850 0x7fec04004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:02.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.638+0000 7fec17fff700 1 --2- 172.21.15.61:0/116326545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec04003a30 0x7fec04003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:02.641 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.638+0000 7fec1cad5700 1 -- 172.21.15.61:0/116326545 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec04004850 msgr2=0x7fec04004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:02.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.638+0000 7fec1cad5700 1 --2- 172.21.15.61:0/116326545 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec04004850 0x7fec04004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:02.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.638+0000 7fec1cad5700 1 -- 172.21.15.61:0/116326545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec04003a30 msgr2=0x7fec04003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:02.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.638+0000 7fec1cad5700 1 --2- 172.21.15.61:0/116326545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec04003a30 0x7fec04003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:02.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.638+0000 7fec1cad5700 1 -- 172.21.15.61:0/116326545 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec040035b0 con 0x7fec040051c0 2023-01-01T17:40:02.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.638+0000 7fec1cad5700 1 --2- 172.21.15.61:0/116326545 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fec040051c0 0x7fec0400ba10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fec1806dc10 tx=0x7fec04005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcaa27f69ba6c7b5 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:02.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.638+0000 7fec16ffd700 1 -- 172.21.15.61:0/116326545 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1000a2f0 con 0x7fec040051c0 2023-01-01T17:40:02.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.638+0000 7fec16ffd700 1 -- 172.21.15.61:0/116326545 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec10012620 con 0x7fec040051c0 2023-01-01T17:40:02.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.638+0000 7fec16ffd700 1 -- 172.21.15.61:0/116326545 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec100129d0 con 0x7fec040051c0 2023-01-01T17:40:02.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.639+0000 7fec1e538700 1 -- 172.21.15.61:0/116326545 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fec040051c0 msgr2=0x7fec0400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:02.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.639+0000 7fec1e538700 1 --2- 172.21.15.61:0/116326545 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fec040051c0 0x7fec0400ba10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fec1806dc10 tx=0x7fec04005880 comp rx=0 tx=0).stop 2023-01-01T17:40:02.642 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.639+0000 7fec1cad5700 1 -- 172.21.15.61:0/116326545 reap_dead start 2023-01-01T17:40:02.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.639+0000 7fec1e538700 1 -- 172.21.15.61:0/116326545 shutdown_connections 2023-01-01T17:40:02.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.639+0000 7fec1e538700 1 -- 172.21.15.61:0/116326545 >> 172.21.15.61:0/116326545 conn(0x7fec180a8420 msgr2=0x7fec180c5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:02.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.639+0000 7fec1e538700 1 -- 172.21.15.61:0/116326545 shutdown_connections 2023-01-01T17:40:02.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.639+0000 7fec1e538700 1 -- 172.21.15.61:0/116326545 wait complete. 2023-01-01T17:40:02.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.640+0000 7fec1e538700 1 Processor -- start 2023-01-01T17:40:02.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.640+0000 7fec1e538700 1 -- start start 2023-01-01T17:40:02.645 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.641+0000 7fec1e538700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec040051c0 0x7fec181525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:02.645 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.641+0000 7fec1e538700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fec180bbe40 0x7fec180bc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:02.645 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.641+0000 7fec1e538700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec1814be50 0x7fec1814c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:02.645 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.641+0000 7fec1e538700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec180bc7d0 con 0x7fec180bbe40 2023-01-01T17:40:02.645 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.641+0000 7fec1e538700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec18154310 con 0x7fec1814be50 2023-01-01T17:40:02.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.641+0000 7fec1e538700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1814cae0 con 0x7fec040051c0 2023-01-01T17:40:02.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.641+0000 7fec177fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fec180bbe40 0x7fec180bc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:02.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.641+0000 7fec177fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fec180bbe40 0x7fec180bc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46206/0 (socket says 172.21.15.61:46206) 2023-01-01T17:40:02.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.641+0000 7fec177fe700 1 -- 172.21.15.61:0/1629842842 learned_addr learned my addr 172.21.15.61:0/1629842842 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:02.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.641+0000 7fec17fff700 1 --2- 172.21.15.61:0/1629842842 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec040051c0 0x7fec181525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:02.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.641+0000 7fec1cad5700 1 --2- 172.21.15.61:0/1629842842 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec1814be50 0x7fec1814c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:02.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.641+0000 7fec177fe700 1 -- 172.21.15.61:0/1629842842 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec040051c0 msgr2=0x7fec181525d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:02.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.641+0000 7fec177fe700 1 --2- 172.21.15.61:0/1629842842 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec040051c0 0x7fec181525d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:02.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.641+0000 7fec177fe700 1 -- 172.21.15.61:0/1629842842 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec1814be50 msgr2=0x7fec1814c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:02.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.641+0000 7fec177fe700 1 --2- 172.21.15.61:0/1629842842 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec1814be50 0x7fec1814c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:02.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.641+0000 7fec177fe700 1 -- 172.21.15.61:0/1629842842 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec18152cd0 con 0x7fec180bbe40 2023-01-01T17:40:02.646 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.641+0000 7fec177fe700 1 --2- 172.21.15.61:0/1629842842 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fec180bbe40 0x7fec180bc290 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fec00011aa0 tx=0x7fec00011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:02.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.641+0000 7fec14ff9700 1 -- 172.21.15.61:0/1629842842 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0000f980 con 0x7fec180bbe40 2023-01-01T17:40:02.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.642+0000 7fec14ff9700 1 -- 172.21.15.61:0/1629842842 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0000fae0 con 0x7fec180bbe40 2023-01-01T17:40:02.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.642+0000 7fec14ff9700 1 -- 172.21.15.61:0/1629842842 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0000fe90 con 0x7fec180bbe40 2023-01-01T17:40:02.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.642+0000 7fec1e538700 1 -- 172.21.15.61:0/1629842842 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec1806e1b0 con 0x7fec180bbe40 2023-01-01T17:40:02.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.642+0000 7fec1e538700 1 -- 172.21.15.61:0/1629842842 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec18150890 con 0x7fec180bbe40 2023-01-01T17:40:02.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.643+0000 7fec1e538700 1 -- 172.21.15.61:0/1629842842 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec18152e60 con 0x7fec180bbe40 2023-01-01T17:40:02.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.643+0000 7fec14ff9700 1 -- 172.21.15.61:0/1629842842 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7fec00014440 con 0x7fec180bbe40 2023-01-01T17:40:02.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.643+0000 7fec14ff9700 1 --2- 172.21.15.61:0/1629842842 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7febf8063290 0x7febf8065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:02.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.644+0000 7fec14ff9700 1 -- 172.21.15.61:0/1629842842 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fec00080670 con 0x7fec180bbe40 2023-01-01T17:40:02.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.644+0000 7fec17fff700 1 --2- 172.21.15.61:0/1629842842 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7febf8063290 0x7febf8065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:02.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.644+0000 7fec17fff700 1 --2- 172.21.15.61:0/1629842842 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7febf8063290 0x7febf8065740 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fec08007fd0 tx=0x7fec08009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:02.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.648+0000 7fec14ff9700 1 -- 172.21.15.61:0/1629842842 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7fec18152e60 con 0x7fec180bbe40 2023-01-01T17:40:02.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.838+0000 7fec1e538700 1 -- 172.21.15.61:0/1629842842 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fec18152e60 con 0x7fec180bbe40 2023-01-01T17:40:02.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.838+0000 7fec14ff9700 1 -- 172.21.15.61:0/1629842842 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fec18152e60 con 0x7fec180bbe40 2023-01-01T17:40:02.838 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 8 2023-01-01T17:40:02.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.840+0000 7fec1e538700 1 -- 172.21.15.61:0/1629842842 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7febf8063290 msgr2=0x7febf8065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:02.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.840+0000 7fec1e538700 1 --2- 172.21.15.61:0/1629842842 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7febf8063290 0x7febf8065740 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fec08007fd0 tx=0x7fec08009040 comp rx=0 tx=0).stop 2023-01-01T17:40:02.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.840+0000 7fec1e538700 1 -- 172.21.15.61:0/1629842842 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fec180bbe40 msgr2=0x7fec180bc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:02.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.840+0000 7fec1e538700 1 --2- 172.21.15.61:0/1629842842 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fec180bbe40 0x7fec180bc290 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fec00011aa0 tx=0x7fec00011e60 comp rx=0 tx=0).stop 2023-01-01T17:40:02.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.840+0000 7fec1e538700 1 -- 172.21.15.61:0/1629842842 shutdown_connections 2023-01-01T17:40:02.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.840+0000 7fec1e538700 1 --2- 172.21.15.61:0/1629842842 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec1814be50 0x7fec1814c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:02.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.840+0000 7fec1e538700 1 --2- 172.21.15.61:0/1629842842 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fec040051c0 0x7fec181525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:02.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.840+0000 7fec1e538700 1 --2- 172.21.15.61:0/1629842842 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7febf8063290 0x7febf8065740 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:02.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.840+0000 7fec1e538700 1 --2- 172.21.15.61:0/1629842842 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fec180bbe40 0x7fec180bc290 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:02.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.840+0000 7fec1e538700 1 -- 172.21.15.61:0/1629842842 >> 172.21.15.61:0/1629842842 conn(0x7fec180a8420 msgr2=0x7fec180a5da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:02.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.840+0000 7fec1e538700 1 -- 172.21.15.61:0/1629842842 shutdown_connections 2023-01-01T17:40:02.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.840+0000 7fec1e538700 1 -- 172.21.15.61:0/1629842842 wait complete. 2023-01-01T17:40:02.856 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-01-01T17:40:02.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.983+0000 7f84036fa700 1 Processor -- start 2023-01-01T17:40:02.983 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.983+0000 7f84036fa700 1 -- start start 2023-01-01T17:40:02.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.984+0000 7f84036fa700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f83fc14cf50 0x7f83fc0c0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:02.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.984+0000 7f84036fa700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83fc06cff0 0x7f83fc152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:02.985 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.984+0000 7f84036fa700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83fc06aaa0 con 0x7f83fc0c0760 2023-01-01T17:40:02.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.984+0000 7f84036fa700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83fc069e90 con 0x7f83fc14cf50 2023-01-01T17:40:02.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.984+0000 7f84036fa700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83fc06a170 con 0x7f83fc06cff0 2023-01-01T17:40:02.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.984+0000 7f8400c95700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f83fc0c0760 0x7f83fc069360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40066/0 (socket says 172.21.15.61:40066) 2023-01-01T17:40:02.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.984+0000 7f8400c95700 1 -- 172.21.15.61:0/1289019067 learned_addr learned my addr 172.21.15.61:0/1289019067 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:40:02.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.984+0000 7f8401496700 1 --2- 172.21.15.61:0/1289019067 >> v2:172.21.15.149:3300/0 conn(0x7f83fc14cf50 0x7f83fc0c0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:02.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.984+0000 7f8401c97700 1 --2- 172.21.15.61:0/1289019067 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83fc06cff0 0x7f83fc152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:02.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.985+0000 7f83f3fff700 1 -- 172.21.15.61:0/1289019067 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1573177138 0 0) 0x7f83fc06aaa0 con 0x7f83fc0c0760 2023-01-01T17:40:02.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.985+0000 7f83f3fff700 1 -- 172.21.15.61:0/1289019067 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83e80035b0 con 0x7f83fc0c0760 2023-01-01T17:40:02.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.985+0000 7f83f3fff700 1 -- 172.21.15.61:0/1289019067 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 825687254 0 0) 0x7f83e80035b0 con 0x7f83fc0c0760 2023-01-01T17:40:02.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.985+0000 7f8401496700 1 -- 172.21.15.61:0/1289019067 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83fc06cff0 msgr2=0x7f83fc152ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:02.986 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.985+0000 7f8401496700 1 --2- 172.21.15.61:0/1289019067 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83fc06cff0 0x7f83fc152ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:02.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.985+0000 7f8401496700 1 -- 172.21.15.61:0/1289019067 >> v1:172.21.15.61:6789/0 conn(0x7f83fc0c0760 legacy=0x7f83fc069360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:02.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.985+0000 7f8401496700 1 -- 172.21.15.61:0/1289019067 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83fc06a450 con 0x7f83fc14cf50 2023-01-01T17:40:02.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.985+0000 7f8401c97700 1 --2- 172.21.15.61:0/1289019067 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83fc06cff0 0x7f83fc152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-01-01T17:40:02.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.985+0000 7f8401496700 1 --2- 172.21.15.61:0/1289019067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83fc14cf50 0x7f83fc0c0220 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f83ec009840 tx=0x7f83ec009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d06c24cf961c38c2 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:02.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.985+0000 7f83f3fff700 1 -- 172.21.15.61:0/1289019067 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f8001670 con 0x7f83fc14cf50 2023-01-01T17:40:02.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.985+0000 7f83f3fff700 1 -- 172.21.15.61:0/1289019067 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ec004030 con 0x7f83fc14cf50 2023-01-01T17:40:02.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.985+0000 7f83f3fff700 1 -- 172.21.15.61:0/1289019067 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec0043c0 con 0x7f83fc14cf50 2023-01-01T17:40:02.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.986+0000 7f84036fa700 1 -- 172.21.15.61:0/1289019067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83fc14cf50 msgr2=0x7f83fc0c0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:02.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.986+0000 7f84036fa700 1 --2- 172.21.15.61:0/1289019067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83fc14cf50 0x7f83fc0c0220 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f83ec009840 tx=0x7f83ec009b50 comp rx=0 tx=0).stop 2023-01-01T17:40:02.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.986+0000 7f84036fa700 1 -- 172.21.15.61:0/1289019067 shutdown_connections 2023-01-01T17:40:02.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.986+0000 7f84036fa700 1 --2- 172.21.15.61:0/1289019067 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83fc06cff0 0x7f83fc152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:02.987 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.986+0000 7f84036fa700 1 --2- 172.21.15.61:0/1289019067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83fc14cf50 0x7f83fc0c0220 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:02.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.986+0000 7f84036fa700 1 -- 172.21.15.61:0/1289019067 >> 172.21.15.61:0/1289019067 conn(0x7f83fc0c1e80 msgr2=0x7f83fc0c2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:02.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.986+0000 7f84036fa700 1 -- 172.21.15.61:0/1289019067 shutdown_connections 2023-01-01T17:40:02.988 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.986+0000 7f84036fa700 1 -- 172.21.15.61:0/1289019067 wait complete. 2023-01-01T17:40:02.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.987+0000 7f84036fa700 1 Processor -- start 2023-01-01T17:40:02.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.987+0000 7f84036fa700 1 -- start start 2023-01-01T17:40:02.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.988+0000 7f84036fa700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83fc06cff0 0x7f83fc149d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:02.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.988+0000 7f84036fa700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83fc14cf50 0x7f83fc1eb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:02.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.988+0000 7f84036fa700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f83fc142330 0x7f83fc1e8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:02.990 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.988+0000 7f84036fa700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83fc14fb00 con 0x7f83fc142330 2023-01-01T17:40:02.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.988+0000 7f84036fa700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83fc1e8180 con 0x7f83fc14cf50 2023-01-01T17:40:02.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.988+0000 7f84036fa700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83fc1ebc70 con 0x7f83fc06cff0 2023-01-01T17:40:02.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.988+0000 7f8401c97700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f83fc142330 0x7f83fc1e8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:02.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.988+0000 7f8401c97700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f83fc142330 0x7f83fc1e8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46224/0 (socket says 172.21.15.61:46224) 2023-01-01T17:40:02.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.988+0000 7f8401c97700 1 -- 172.21.15.61:0/3989169095 learned_addr learned my addr 172.21.15.61:0/3989169095 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:02.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.988+0000 7f8400c95700 1 --2- 172.21.15.61:0/3989169095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83fc14cf50 0x7f83fc1eb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:02.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.988+0000 7f8401496700 1 --2- 172.21.15.61:0/3989169095 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83fc06cff0 0x7f83fc149d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:02.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.988+0000 7f8401c97700 1 -- 172.21.15.61:0/3989169095 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83fc06cff0 msgr2=0x7f83fc149d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:02.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.988+0000 7f8401c97700 1 --2- 172.21.15.61:0/3989169095 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83fc06cff0 0x7f83fc149d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:02.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.988+0000 7f8401c97700 1 -- 172.21.15.61:0/3989169095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83fc14cf50 msgr2=0x7f83fc1eb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:02.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.988+0000 7f8401c97700 1 --2- 172.21.15.61:0/3989169095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83fc14cf50 0x7f83fc1eb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:02.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.988+0000 7f8401c97700 1 -- 172.21.15.61:0/3989169095 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f4009a70 con 0x7f83fc142330 2023-01-01T17:40:02.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.988+0000 7f8401c97700 1 --2- 172.21.15.61:0/3989169095 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f83fc142330 0x7f83fc1e8b90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f83f400efc0 tx=0x7f83f400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:02.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.988+0000 7f83f1ffb700 1 -- 172.21.15.61:0/3989169095 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f4009d70 con 0x7f83fc142330 2023-01-01T17:40:02.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.989+0000 7f83f1ffb700 1 -- 172.21.15.61:0/3989169095 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f400f040 con 0x7f83fc142330 2023-01-01T17:40:02.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.989+0000 7f84036fa700 1 -- 172.21.15.61:0/3989169095 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83ec0094a0 con 0x7f83fc142330 2023-01-01T17:40:02.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.989+0000 7f83f1ffb700 1 -- 172.21.15.61:0/3989169095 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f400ce00 con 0x7f83fc142330 2023-01-01T17:40:02.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.989+0000 7f84036fa700 1 -- 172.21.15.61:0/3989169095 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83fc069a70 con 0x7f83fc142330 2023-01-01T17:40:02.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.990+0000 7f84036fa700 1 -- 172.21.15.61:0/3989169095 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83fc06a730 con 0x7f83fc142330 2023-01-01T17:40:02.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.990+0000 7f83f1ffb700 1 -- 172.21.15.61:0/3989169095 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f83f4014480 con 0x7f83fc142330 2023-01-01T17:40:02.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.990+0000 7f83f1ffb700 1 --2- 172.21.15.61:0/3989169095 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f83e0063290 0x7f83e0065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:02.992 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.991+0000 7f83f1ffb700 1 -- 172.21.15.61:0/3989169095 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f83f40806e0 con 0x7f83fc142330 2023-01-01T17:40:02.993 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.991+0000 7f8401496700 1 --2- 172.21.15.61:0/3989169095 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f83e0063290 0x7f83e0065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:02.993 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.991+0000 7f8401496700 1 --2- 172.21.15.61:0/3989169095 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f83e0063290 0x7f83e0065740 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f83ec0090b0 tx=0x7f83ec013040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:02.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:02.995+0000 7f83f1ffb700 1 -- 172.21.15.61:0/3989169095 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f83f404f350 con 0x7f83fc142330 2023-01-01T17:40:03.181 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.182+0000 7f84036fa700 1 -- 172.21.15.61:0/3989169095 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f83fc153400 con 0x7f83fc142330 2023-01-01T17:40:03.181 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.182+0000 7f83f1ffb700 1 -- 172.21.15.61:0/3989169095 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f83f4052970 con 0x7f83fc142330 2023-01-01T17:40:03.182 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 1 2023-01-01T17:40:03.183 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.184+0000 7f84036fa700 1 -- 172.21.15.61:0/3989169095 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f83e0063290 msgr2=0x7f83e0065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:03.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.184+0000 7f84036fa700 1 --2- 172.21.15.61:0/3989169095 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f83e0063290 0x7f83e0065740 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f83ec0090b0 tx=0x7f83ec013040 comp rx=0 tx=0).stop 2023-01-01T17:40:03.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.184+0000 7f84036fa700 1 -- 172.21.15.61:0/3989169095 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f83fc142330 msgr2=0x7f83fc1e8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:03.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.184+0000 7f84036fa700 1 --2- 172.21.15.61:0/3989169095 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f83fc142330 0x7f83fc1e8b90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f83f400efc0 tx=0x7f83f400c3a0 comp rx=0 tx=0).stop 2023-01-01T17:40:03.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.184+0000 7f84036fa700 1 -- 172.21.15.61:0/3989169095 shutdown_connections 2023-01-01T17:40:03.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.184+0000 7f84036fa700 1 --2- 172.21.15.61:0/3989169095 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f83e0063290 0x7f83e0065740 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:03.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.184+0000 7f84036fa700 1 --2- 172.21.15.61:0/3989169095 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f83fc142330 0x7f83fc1e8b90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:03.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.184+0000 7f84036fa700 1 --2- 172.21.15.61:0/3989169095 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f83fc06cff0 0x7f83fc149d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:03.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.184+0000 7f84036fa700 1 --2- 172.21.15.61:0/3989169095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83fc14cf50 0x7f83fc1eb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:03.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.184+0000 7f84036fa700 1 -- 172.21.15.61:0/3989169095 >> 172.21.15.61:0/3989169095 conn(0x7f83fc0c1e80 msgr2=0x7f83fc06c030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:03.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.184+0000 7f84036fa700 1 -- 172.21.15.61:0/3989169095 shutdown_connections 2023-01-01T17:40:03.184 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.184+0000 7f84036fa700 1 -- 172.21.15.61:0/3989169095 wait complete. 2023-01-01T17:40:03.197 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-01-01T17:40:03.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.324+0000 7f05769ca700 1 Processor -- start 2023-01-01T17:40:03.324 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.324+0000 7f05769ca700 1 -- start start 2023-01-01T17:40:03.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.325+0000 7f05769ca700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f057014cf50 0x7f05700c0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:03.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.325+0000 7f05769ca700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05700c0760 0x7f0570069360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:03.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.325+0000 7f05769ca700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f057006aaa0 con 0x7f057006cff0 2023-01-01T17:40:03.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.325+0000 7f05769ca700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0570069e90 con 0x7f057014cf50 2023-01-01T17:40:03.326 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.325+0000 7f05769ca700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057006a170 con 0x7f05700c0760 2023-01-01T17:40:03.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.325+0000 7f056ffff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f057014cf50 0x7f05700c0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:03.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.325+0000 7f0574f67700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f057006cff0 0x7f0570152ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40082/0 (socket says 172.21.15.61:40082) 2023-01-01T17:40:03.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.325+0000 7f0574f67700 1 -- 172.21.15.61:0/4186186266 learned_addr learned my addr 172.21.15.61:0/4186186266 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:40:03.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.325+0000 7f056f7fe700 1 --2- 172.21.15.61:0/4186186266 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05700c0760 0x7f0570069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:03.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.325+0000 7f056ffff700 1 -- 172.21.15.61:0/4186186266 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05700c0760 msgr2=0x7f0570069360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:03.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.325+0000 7f056ffff700 1 --2- 172.21.15.61:0/4186186266 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05700c0760 0x7f0570069360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:03.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.325+0000 7f056ffff700 1 -- 172.21.15.61:0/4186186266 >> v1:172.21.15.61:6789/0 conn(0x7f057006cff0 legacy=0x7f0570152ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:03.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.325+0000 7f056ffff700 1 -- 172.21.15.61:0/4186186266 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f057006a450 con 0x7f057014cf50 2023-01-01T17:40:03.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.325+0000 7f056effd700 1 -- 172.21.15.61:0/4186186266 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 812666746 0 0) 0x7f057006aaa0 con 0x7f057006cff0 2023-01-01T17:40:03.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.326+0000 7f056ffff700 1 --2- 172.21.15.61:0/4186186266 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f057014cf50 0x7f05700c0220 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0560009840 tx=0x7f0560009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c289acc6af38dcea server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:03.327 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.326+0000 7f056effd700 1 -- 172.21.15.61:0/4186186266 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0560011830 con 0x7f057014cf50 2023-01-01T17:40:03.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.326+0000 7f056effd700 1 -- 172.21.15.61:0/4186186266 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0560011990 con 0x7f057014cf50 2023-01-01T17:40:03.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.326+0000 7f056effd700 1 -- 172.21.15.61:0/4186186266 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0560011d20 con 0x7f057014cf50 2023-01-01T17:40:03.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.326+0000 7f05769ca700 1 -- 172.21.15.61:0/4186186266 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f057014cf50 msgr2=0x7f05700c0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:03.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.326+0000 7f05769ca700 1 --2- 172.21.15.61:0/4186186266 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f057014cf50 0x7f05700c0220 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0560009840 tx=0x7f0560009b50 comp rx=0 tx=0).stop 2023-01-01T17:40:03.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.326+0000 7f05769ca700 1 -- 172.21.15.61:0/4186186266 shutdown_connections 2023-01-01T17:40:03.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.326+0000 7f05769ca700 1 --2- 172.21.15.61:0/4186186266 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f057014cf50 0x7f05700c0220 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:03.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.326+0000 7f05769ca700 1 --2- 172.21.15.61:0/4186186266 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05700c0760 0x7f0570069360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:03.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.326+0000 7f05769ca700 1 -- 172.21.15.61:0/4186186266 >> 172.21.15.61:0/4186186266 conn(0x7f05700c1e80 msgr2=0x7f05700c2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:03.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.326+0000 7f05769ca700 1 -- 172.21.15.61:0/4186186266 shutdown_connections 2023-01-01T17:40:03.328 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.326+0000 7f05769ca700 1 -- 172.21.15.61:0/4186186266 wait complete. 2023-01-01T17:40:03.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.328+0000 7f05769ca700 1 Processor -- start 2023-01-01T17:40:03.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.328+0000 7f05769ca700 1 -- start start 2023-01-01T17:40:03.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.328+0000 7f05769ca700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f057006cff0 0x7f05701e8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:03.330 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.328+0000 7f05769ca700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f057014cf50 0x7f057013f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:03.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.328+0000 7f05769ca700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05700710a0 0x7f05701e9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:03.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.328+0000 7f05769ca700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05701ebb20 con 0x7f057014cf50 2023-01-01T17:40:03.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.328+0000 7f05769ca700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05701e83e0 con 0x7f05700710a0 2023-01-01T17:40:03.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.328+0000 7f05769ca700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05701e86c0 con 0x7f057006cff0 2023-01-01T17:40:03.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.329+0000 7f056f7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f057014cf50 0x7f057013f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:03.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.329+0000 7f056f7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f057014cf50 0x7f057013f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46236/0 (socket says 172.21.15.61:46236) 2023-01-01T17:40:03.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.329+0000 7f056f7fe700 1 -- 172.21.15.61:0/2576267242 learned_addr learned my addr 172.21.15.61:0/2576267242 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:03.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.329+0000 7f056ffff700 1 --2- 172.21.15.61:0/2576267242 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f057006cff0 0x7f05701e8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:03.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.329+0000 7f0574f67700 1 --2- 172.21.15.61:0/2576267242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05700710a0 0x7f05701e9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:03.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.329+0000 7f056f7fe700 1 -- 172.21.15.61:0/2576267242 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f057006cff0 msgr2=0x7f05701e8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:03.331 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.329+0000 7f056f7fe700 1 --2- 172.21.15.61:0/2576267242 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f057006cff0 0x7f05701e8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:03.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.329+0000 7f056f7fe700 1 -- 172.21.15.61:0/2576267242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05700710a0 msgr2=0x7f05701e9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:03.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.329+0000 7f056f7fe700 1 --2- 172.21.15.61:0/2576267242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05700710a0 0x7f05701e9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:03.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.329+0000 7f056f7fe700 1 -- 172.21.15.61:0/2576267242 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05600094a0 con 0x7f057014cf50 2023-01-01T17:40:03.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.329+0000 7f0574f67700 1 --2- 172.21.15.61:0/2576267242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05700710a0 0x7f05701e9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-01-01T17:40:03.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.329+0000 7f056ffff700 1 --2- 172.21.15.61:0/2576267242 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f057006cff0 0x7f05701e8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-01-01T17:40:03.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.329+0000 7f056f7fe700 1 --2- 172.21.15.61:0/2576267242 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f057014cf50 0x7f057013f770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f056400e9b0 tx=0x7f056400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:03.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.329+0000 7f056cff9700 1 -- 172.21.15.61:0/2576267242 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0564009710 con 0x7f057014cf50 2023-01-01T17:40:03.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.329+0000 7f056cff9700 1 -- 172.21.15.61:0/2576267242 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056400c850 con 0x7f057014cf50 2023-01-01T17:40:03.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.329+0000 7f05769ca700 1 -- 172.21.15.61:0/2576267242 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05700698a0 con 0x7f057014cf50 2023-01-01T17:40:03.332 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.329+0000 7f056cff9700 1 -- 172.21.15.61:0/2576267242 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056400cbc0 con 0x7f057014cf50 2023-01-01T17:40:03.333 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.329+0000 7f05769ca700 1 -- 172.21.15.61:0/2576267242 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f057006a730 con 0x7f057014cf50 2023-01-01T17:40:03.333 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.330+0000 7f05769ca700 1 -- 172.21.15.61:0/2576267242 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0570069a30 con 0x7f057014cf50 2023-01-01T17:40:03.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.331+0000 7f056cff9700 1 -- 172.21.15.61:0/2576267242 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f0564023070 con 0x7f057014cf50 2023-01-01T17:40:03.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.332+0000 7f056cff9700 1 --2- 172.21.15.61:0/2576267242 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f055c063290 0x7f055c065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:03.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.332+0000 7f056cff9700 1 -- 172.21.15.61:0/2576267242 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0564080600 con 0x7f057014cf50 2023-01-01T17:40:03.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.332+0000 7f056ffff700 1 --2- 172.21.15.61:0/2576267242 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f055c063290 0x7f055c065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:03.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.332+0000 7f056ffff700 1 --2- 172.21.15.61:0/2576267242 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f055c063290 0x7f055c065740 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0570144fc0 tx=0x7f0560008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:03.335 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.336+0000 7f056cff9700 1 -- 172.21.15.61:0/2576267242 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f056404f350 con 0x7f057014cf50 2023-01-01T17:40:03.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.527+0000 7f05769ca700 1 -- 172.21.15.61:0/2576267242 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f05701e8d10 con 0x7f057014cf50 2023-01-01T17:40:03.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.527+0000 7f056cff9700 1 -- 172.21.15.61:0/2576267242 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0564052970 con 0x7f057014cf50 2023-01-01T17:40:03.528 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 32 2023-01-01T17:40:03.529 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.529+0000 7f05769ca700 1 -- 172.21.15.61:0/2576267242 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f055c063290 msgr2=0x7f055c065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:03.529 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.529+0000 7f05769ca700 1 --2- 172.21.15.61:0/2576267242 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f055c063290 0x7f055c065740 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0570144fc0 tx=0x7f0560008030 comp rx=0 tx=0).stop 2023-01-01T17:40:03.530 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.529+0000 7f05769ca700 1 -- 172.21.15.61:0/2576267242 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f057014cf50 msgr2=0x7f057013f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:03.530 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.529+0000 7f05769ca700 1 --2- 172.21.15.61:0/2576267242 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f057014cf50 0x7f057013f770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f056400e9b0 tx=0x7f056400ed70 comp rx=0 tx=0).stop 2023-01-01T17:40:03.530 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.529+0000 7f05769ca700 1 -- 172.21.15.61:0/2576267242 shutdown_connections 2023-01-01T17:40:03.530 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.529+0000 7f05769ca700 1 --2- 172.21.15.61:0/2576267242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05700710a0 0x7f05701e9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:03.530 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.529+0000 7f05769ca700 1 --2- 172.21.15.61:0/2576267242 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f057006cff0 0x7f05701e8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:03.530 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.529+0000 7f05769ca700 1 --2- 172.21.15.61:0/2576267242 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f055c063290 0x7f055c065740 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:03.530 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.529+0000 7f05769ca700 1 --2- 172.21.15.61:0/2576267242 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f057014cf50 0x7f057013f770 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:03.530 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.529+0000 7f05769ca700 1 -- 172.21.15.61:0/2576267242 >> 172.21.15.61:0/2576267242 conn(0x7f05700c1e80 msgr2=0x7f05700c2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:03.530 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.529+0000 7f05769ca700 1 -- 172.21.15.61:0/2576267242 shutdown_connections 2023-01-01T17:40:03.530 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.529+0000 7f05769ca700 1 -- 172.21.15.61:0/2576267242 wait complete. 2023-01-01T17:40:03.541 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-01-01T17:40:03.668 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.669+0000 7fa68c2de700 1 Processor -- start 2023-01-01T17:40:03.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.669+0000 7fa68c2de700 1 -- start start 2023-01-01T17:40:03.684 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.670+0000 7fa68c2de700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fa68414cf50 0x7fa6840c0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:03.684 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.670+0000 7fa68c2de700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa68406cff0 0x7fa684152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:03.684 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.670+0000 7fa68c2de700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa68406aaa0 con 0x7fa6840c0760 2023-01-01T17:40:03.684 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.670+0000 7fa68c2de700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa684069e90 con 0x7fa68414cf50 2023-01-01T17:40:03.684 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.670+0000 7fa68c2de700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68406a170 con 0x7fa68406cff0 2023-01-01T17:40:03.684 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.670+0000 7fa68a07a700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fa68414cf50 0x7fa6840c0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:03.684 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.670+0000 7fa689879700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fa6840c0760 0x7fa684069360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40092/0 (socket says 172.21.15.61:40092) 2023-01-01T17:40:03.684 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.670+0000 7fa689879700 1 -- 172.21.15.61:0/2320843545 learned_addr learned my addr 172.21.15.61:0/2320843545 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:40:03.684 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.670+0000 7fa68a87b700 1 --2- 172.21.15.61:0/2320843545 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa68406cff0 0x7fa684152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:03.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.670+0000 7fa689078700 1 -- 172.21.15.61:0/2320843545 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2861437905 0 0) 0x7fa68406aaa0 con 0x7fa6840c0760 2023-01-01T17:40:03.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.670+0000 7fa689078700 1 -- 172.21.15.61:0/2320843545 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6700035b0 con 0x7fa6840c0760 2023-01-01T17:40:03.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.670+0000 7fa68a07a700 1 -- 172.21.15.61:0/2320843545 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa68406cff0 msgr2=0x7fa684152ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:03.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.670+0000 7fa68a07a700 1 --2- 172.21.15.61:0/2320843545 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa68406cff0 0x7fa684152ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:03.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.670+0000 7fa68a07a700 1 -- 172.21.15.61:0/2320843545 >> v1:172.21.15.61:6789/0 conn(0x7fa6840c0760 legacy=0x7fa684069360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:03.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.670+0000 7fa68a07a700 1 -- 172.21.15.61:0/2320843545 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa68406a450 con 0x7fa68414cf50 2023-01-01T17:40:03.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.670+0000 7fa68a07a700 1 --2- 172.21.15.61:0/2320843545 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa68414cf50 0x7fa6840c0220 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa680009840 tx=0x7fa680009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b9be42a60d263d1 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:03.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.670+0000 7fa689078700 1 -- 172.21.15.61:0/2320843545 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa680011830 con 0x7fa68414cf50 2023-01-01T17:40:03.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.670+0000 7fa689078700 1 -- 172.21.15.61:0/2320843545 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa680011990 con 0x7fa68414cf50 2023-01-01T17:40:03.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.670+0000 7fa689078700 1 -- 172.21.15.61:0/2320843545 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa680011d20 con 0x7fa68414cf50 2023-01-01T17:40:03.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.671+0000 7fa68c2de700 1 -- 172.21.15.61:0/2320843545 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa68414cf50 msgr2=0x7fa6840c0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:03.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.671+0000 7fa68c2de700 1 --2- 172.21.15.61:0/2320843545 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa68414cf50 0x7fa6840c0220 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa680009840 tx=0x7fa680009b50 comp rx=0 tx=0).stop 2023-01-01T17:40:03.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.671+0000 7fa68c2de700 1 -- 172.21.15.61:0/2320843545 shutdown_connections 2023-01-01T17:40:03.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.671+0000 7fa68c2de700 1 --2- 172.21.15.61:0/2320843545 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa68406cff0 0x7fa684152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:03.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.671+0000 7fa68c2de700 1 --2- 172.21.15.61:0/2320843545 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa68414cf50 0x7fa6840c0220 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:03.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.671+0000 7fa68c2de700 1 -- 172.21.15.61:0/2320843545 >> 172.21.15.61:0/2320843545 conn(0x7fa6840c1e80 msgr2=0x7fa6840c2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:03.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.671+0000 7fa68c2de700 1 -- 172.21.15.61:0/2320843545 shutdown_connections 2023-01-01T17:40:03.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.671+0000 7fa68c2de700 1 -- 172.21.15.61:0/2320843545 wait complete. 2023-01-01T17:40:03.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.672+0000 7fa68c2de700 1 Processor -- start 2023-01-01T17:40:03.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.672+0000 7fa68c2de700 1 -- start start 2023-01-01T17:40:03.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.673+0000 7fa68c2de700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa68406cff0 0x7fa6840a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:03.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.673+0000 7fa68c2de700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa68414cf50 0x7fa6841e9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:03.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.673+0000 7fa68c2de700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa6841521d0 0x7fa684152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:03.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.673+0000 7fa68c2de700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6840aa650 con 0x7fa6841521d0 2023-01-01T17:40:03.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.673+0000 7fa68c2de700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa684155c70 con 0x7fa68406cff0 2023-01-01T17:40:03.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.673+0000 7fa68c2de700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6841e8ca0 con 0x7fa68414cf50 2023-01-01T17:40:03.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.673+0000 7fa68a87b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa6841521d0 0x7fa684152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:03.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.673+0000 7fa68a87b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa6841521d0 0x7fa684152650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46252/0 (socket says 172.21.15.61:46252) 2023-01-01T17:40:03.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.673+0000 7fa68a87b700 1 -- 172.21.15.61:0/632972624 learned_addr learned my addr 172.21.15.61:0/632972624 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:03.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.673+0000 7fa68a07a700 1 --2- 172.21.15.61:0/632972624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa68406cff0 0x7fa6840a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:03.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.673+0000 7fa689879700 1 --2- 172.21.15.61:0/632972624 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa68414cf50 0x7fa6841e9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:03.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.673+0000 7fa68a87b700 1 -- 172.21.15.61:0/632972624 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa68414cf50 msgr2=0x7fa6841e9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:03.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.673+0000 7fa68a87b700 1 --2- 172.21.15.61:0/632972624 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa68414cf50 0x7fa6841e9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:03.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.673+0000 7fa68a87b700 1 -- 172.21.15.61:0/632972624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa68406cff0 msgr2=0x7fa6840a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:03.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.673+0000 7fa68a87b700 1 --2- 172.21.15.61:0/632972624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa68406cff0 0x7fa6840a88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:03.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.673+0000 7fa68a87b700 1 -- 172.21.15.61:0/632972624 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6800094a0 con 0x7fa6841521d0 2023-01-01T17:40:03.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.673+0000 7fa68a07a700 1 --2- 172.21.15.61:0/632972624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa68406cff0 0x7fa6840a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-01T17:40:03.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.673+0000 7fa689879700 1 --2- 172.21.15.61:0/632972624 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa68414cf50 0x7fa6841e9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-01T17:40:03.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.673+0000 7fa68a87b700 1 --2- 172.21.15.61:0/632972624 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa6841521d0 0x7fa684152650 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa67c007e70 tx=0x7fa67c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:03.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.674+0000 7fa67affd700 1 -- 172.21.15.61:0/632972624 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c00ee50 con 0x7fa6841521d0 2023-01-01T17:40:03.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.674+0000 7fa67affd700 1 -- 172.21.15.61:0/632972624 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67c014420 con 0x7fa6841521d0 2023-01-01T17:40:03.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.674+0000 7fa68c2de700 1 -- 172.21.15.61:0/632972624 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa684069a70 con 0x7fa6841521d0 2023-01-01T17:40:03.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.674+0000 7fa67affd700 1 -- 172.21.15.61:0/632972624 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c0147d0 con 0x7fa6841521d0 2023-01-01T17:40:03.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.674+0000 7fa68c2de700 1 -- 172.21.15.61:0/632972624 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa68406a730 con 0x7fa6841521d0 2023-01-01T17:40:03.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.675+0000 7fa68c2de700 1 -- 172.21.15.61:0/632972624 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa684153400 con 0x7fa6841521d0 2023-01-01T17:40:03.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.675+0000 7fa67affd700 1 -- 172.21.15.61:0/632972624 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7fa67c012050 con 0x7fa6841521d0 2023-01-01T17:40:03.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.675+0000 7fa67affd700 1 --2- 172.21.15.61:0/632972624 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fa668063290 0x7fa668065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:03.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.676+0000 7fa67affd700 1 -- 172.21.15.61:0/632972624 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa67c080430 con 0x7fa6841521d0 2023-01-01T17:40:03.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.676+0000 7fa68a07a700 1 --2- 172.21.15.61:0/632972624 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fa668063290 0x7fa668065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:03.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.676+0000 7fa68a07a700 1 --2- 172.21.15.61:0/632972624 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fa668063290 0x7fa668065740 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa680000c00 tx=0x7fa68001c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:03.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.680+0000 7fa67affd700 1 -- 172.21.15.61:0/632972624 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7fa67c04f1f0 con 0x7fa6841521d0 2023-01-01T17:40:03.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.867+0000 7fa68c2de700 1 -- 172.21.15.61:0/632972624 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa684072a80 con 0x7fa6841521d0 2023-01-01T17:40:03.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.867+0000 7fa67affd700 1 -- 172.21.15.61:0/632972624 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa67c052810 con 0x7fa6841521d0 2023-01-01T17:40:03.867 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 64 2023-01-01T17:40:03.869 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.869+0000 7fa68c2de700 1 -- 172.21.15.61:0/632972624 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fa668063290 msgr2=0x7fa668065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:03.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.869+0000 7fa68c2de700 1 --2- 172.21.15.61:0/632972624 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fa668063290 0x7fa668065740 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa680000c00 tx=0x7fa68001c040 comp rx=0 tx=0).stop 2023-01-01T17:40:03.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.869+0000 7fa68c2de700 1 -- 172.21.15.61:0/632972624 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa6841521d0 msgr2=0x7fa684152650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:03.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.869+0000 7fa68c2de700 1 --2- 172.21.15.61:0/632972624 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa6841521d0 0x7fa684152650 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa67c007e70 tx=0x7fa67c00e3c0 comp rx=0 tx=0).stop 2023-01-01T17:40:03.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.869+0000 7fa68c2de700 1 -- 172.21.15.61:0/632972624 shutdown_connections 2023-01-01T17:40:03.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.869+0000 7fa68c2de700 1 --2- 172.21.15.61:0/632972624 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fa668063290 0x7fa668065740 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:03.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.869+0000 7fa68c2de700 1 --2- 172.21.15.61:0/632972624 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa6841521d0 0x7fa684152650 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:03.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.869+0000 7fa68c2de700 1 --2- 172.21.15.61:0/632972624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa68406cff0 0x7fa6840a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:03.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.869+0000 7fa68c2de700 1 --2- 172.21.15.61:0/632972624 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa68414cf50 0x7fa6841e9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:03.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.869+0000 7fa68c2de700 1 -- 172.21.15.61:0/632972624 >> 172.21.15.61:0/632972624 conn(0x7fa6840c1e80 msgr2=0x7fa68414b280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:03.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.870+0000 7fa68c2de700 1 -- 172.21.15.61:0/632972624 shutdown_connections 2023-01-01T17:40:03.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:03.870+0000 7fa68c2de700 1 -- 172.21.15.61:0/632972624 wait complete. 2023-01-01T17:40:03.883 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-01-01T17:40:04.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.011+0000 7f374f08d700 1 Processor -- start 2023-01-01T17:40:04.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.011+0000 7f374f08d700 1 -- start start 2023-01-01T17:40:04.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.011+0000 7f374f08d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f374814cf50 0x7f37480c0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:04.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.011+0000 7f374f08d700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37480c0760 0x7f3748069360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:04.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.011+0000 7f374f08d700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f374806aaa0 con 0x7f374806cff0 2023-01-01T17:40:04.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.011+0000 7f374f08d700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3748069e90 con 0x7f374814cf50 2023-01-01T17:40:04.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.011+0000 7f374f08d700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f374806a170 con 0x7f37480c0760 2023-01-01T17:40:04.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.012+0000 7f3747fff700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37480c0760 0x7f3748069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:04.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.012+0000 7f374ce29700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f374814cf50 0x7f37480c0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:04.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.012+0000 7f374d62a700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f374806cff0 0x7f3748152ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.61:48584/0 (socket says 172.21.15.61:48584) 2023-01-01T17:40:04.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.012+0000 7f374d62a700 1 -- 172.21.15.61:0/1520200958 learned_addr learned my addr 172.21.15.61:0/1520200958 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:40:04.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.012+0000 7f37477fe700 1 -- 172.21.15.61:0/1520200958 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3375629770 0 0) 0x7f374806aaa0 con 0x7f374806cff0 2023-01-01T17:40:04.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.012+0000 7f37477fe700 1 -- 172.21.15.61:0/1520200958 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37380035b0 con 0x7f374806cff0 2023-01-01T17:40:04.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.012+0000 7f3747fff700 1 -- 172.21.15.61:0/1520200958 >> v2:172.21.15.149:3300/0 conn(0x7f374814cf50 msgr2=0x7f37480c0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:04.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.012+0000 7f3747fff700 1 --2- 172.21.15.61:0/1520200958 >> v2:172.21.15.149:3300/0 conn(0x7f374814cf50 0x7f37480c0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:04.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.012+0000 7f3747fff700 1 -- 172.21.15.61:0/1520200958 >> v1:172.21.15.149:6789/0 conn(0x7f374806cff0 legacy=0x7f3748152ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:04.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.012+0000 7f3747fff700 1 -- 172.21.15.61:0/1520200958 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374806a450 con 0x7f37480c0760 2023-01-01T17:40:04.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.012+0000 7f374ce29700 1 --2- 172.21.15.61:0/1520200958 >> v2:172.21.15.149:3300/0 conn(0x7f374814cf50 0x7f37480c0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-01-01T17:40:04.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.012+0000 7f3747fff700 1 --2- 172.21.15.61:0/1520200958 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37480c0760 0x7f3748069360 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3734009840 tx=0x7f3734009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=662629340e1f360e server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:04.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.012+0000 7f37477fe700 1 -- 172.21.15.61:0/1520200958 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3734011830 con 0x7f37480c0760 2023-01-01T17:40:04.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.013+0000 7f37477fe700 1 -- 172.21.15.61:0/1520200958 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3734011990 con 0x7f37480c0760 2023-01-01T17:40:04.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.013+0000 7f37477fe700 1 -- 172.21.15.61:0/1520200958 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3734011d20 con 0x7f37480c0760 2023-01-01T17:40:04.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.013+0000 7f374f08d700 1 -- 172.21.15.61:0/1520200958 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37480c0760 msgr2=0x7f3748069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:04.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.013+0000 7f374f08d700 1 --2- 172.21.15.61:0/1520200958 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37480c0760 0x7f3748069360 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3734009840 tx=0x7f3734009b50 comp rx=0 tx=0).stop 2023-01-01T17:40:04.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.013+0000 7f374f08d700 1 -- 172.21.15.61:0/1520200958 shutdown_connections 2023-01-01T17:40:04.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.013+0000 7f374f08d700 1 --2- 172.21.15.61:0/1520200958 >> v2:172.21.15.149:3300/0 conn(0x7f374814cf50 0x7f37480c0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:04.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.013+0000 7f374f08d700 1 --2- 172.21.15.61:0/1520200958 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37480c0760 0x7f3748069360 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:04.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.013+0000 7f374f08d700 1 -- 172.21.15.61:0/1520200958 >> 172.21.15.61:0/1520200958 conn(0x7f37480c1e80 msgr2=0x7f37480c2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:04.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.013+0000 7f374f08d700 1 -- 172.21.15.61:0/1520200958 shutdown_connections 2023-01-01T17:40:04.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.013+0000 7f374f08d700 1 -- 172.21.15.61:0/1520200958 wait complete. 2023-01-01T17:40:04.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.014+0000 7f374f08d700 1 Processor -- start 2023-01-01T17:40:04.018 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.014+0000 7f374f08d700 1 -- start start 2023-01-01T17:40:04.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.015+0000 7f374f08d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f374806cff0 0x7f3748154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:04.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.015+0000 7f374f08d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f374814cf50 0x7f37480c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:04.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.015+0000 7f374f08d700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37480a9a40 0x7f37480a9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:04.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.015+0000 7f374f08d700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374814df90 con 0x7f374806cff0 2023-01-01T17:40:04.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.015+0000 7f374f08d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37480ab430 con 0x7f374814cf50 2023-01-01T17:40:04.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.015+0000 7f374f08d700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37480aae70 con 0x7f37480a9a40 2023-01-01T17:40:04.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.015+0000 7f374ce29700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f374806cff0 0x7f3748154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:04.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.015+0000 7f374ce29700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f374806cff0 0x7f3748154140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46262/0 (socket says 172.21.15.61:46262) 2023-01-01T17:40:04.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.015+0000 7f374ce29700 1 -- 172.21.15.61:0/1820892168 learned_addr learned my addr 172.21.15.61:0/1820892168 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:04.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.015+0000 7f3747fff700 1 --2- 172.21.15.61:0/1820892168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f374814cf50 0x7f37480c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:04.019 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.015+0000 7f374d62a700 1 --2- 172.21.15.61:0/1820892168 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37480a9a40 0x7f37480a9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:04.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.016+0000 7f374ce29700 1 -- 172.21.15.61:0/1820892168 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37480a9a40 msgr2=0x7f37480a9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:04.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.016+0000 7f374ce29700 1 --2- 172.21.15.61:0/1820892168 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37480a9a40 0x7f37480a9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:04.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.016+0000 7f374ce29700 1 -- 172.21.15.61:0/1820892168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f374814cf50 msgr2=0x7f37480c24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:04.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.016+0000 7f374ce29700 1 --2- 172.21.15.61:0/1820892168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f374814cf50 0x7f37480c24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:04.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.016+0000 7f374ce29700 1 -- 172.21.15.61:0/1820892168 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f373c0094a0 con 0x7f374806cff0 2023-01-01T17:40:04.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.016+0000 7f374ce29700 1 --2- 172.21.15.61:0/1820892168 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f374806cff0 0x7f3748154140 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f373c00ebe0 tx=0x7f373c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:04.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.016+0000 7f37457fa700 1 -- 172.21.15.61:0/1820892168 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373c009760 con 0x7f374806cff0 2023-01-01T17:40:04.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.016+0000 7f37457fa700 1 -- 172.21.15.61:0/1820892168 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373c00c850 con 0x7f374806cff0 2023-01-01T17:40:04.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.016+0000 7f374f08d700 1 -- 172.21.15.61:0/1820892168 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37340094a0 con 0x7f374806cff0 2023-01-01T17:40:04.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.016+0000 7f37457fa700 1 -- 172.21.15.61:0/1820892168 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373c00cbe0 con 0x7f374806cff0 2023-01-01T17:40:04.020 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.016+0000 7f374f08d700 1 -- 172.21.15.61:0/1820892168 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37480698a0 con 0x7f374806cff0 2023-01-01T17:40:04.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.017+0000 7f374f08d700 1 -- 172.21.15.61:0/1820892168 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f374806a730 con 0x7f374806cff0 2023-01-01T17:40:04.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.017+0000 7f37457fa700 1 -- 172.21.15.61:0/1820892168 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f373c019030 con 0x7f374806cff0 2023-01-01T17:40:04.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.018+0000 7f37457fa700 1 --2- 172.21.15.61:0/1820892168 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f372c063290 0x7f372c065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:04.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.018+0000 7f37457fa700 1 -- 172.21.15.61:0/1820892168 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f373c07fbe0 con 0x7f374806cff0 2023-01-01T17:40:04.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.018+0000 7f3747fff700 1 --2- 172.21.15.61:0/1820892168 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f372c063290 0x7f372c065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:04.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.018+0000 7f3747fff700 1 --2- 172.21.15.61:0/1820892168 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f372c063290 0x7f372c065740 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3734000c00 tx=0x7f3734008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:04.021 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.022+0000 7f37457fa700 1 -- 172.21.15.61:0/1820892168 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f373c04e9a0 con 0x7f374806cff0 2023-01-01T17:40:04.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.211+0000 7f374f08d700 1 -- 172.21.15.61:0/1820892168 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3748069a30 con 0x7f374806cff0 2023-01-01T17:40:04.210 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.211+0000 7f37457fa700 1 -- 172.21.15.61:0/1820892168 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f373c0170a0 con 0x7f374806cff0 2023-01-01T17:40:04.211 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 32 2023-01-01T17:40:04.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.213+0000 7f374f08d700 1 -- 172.21.15.61:0/1820892168 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f372c063290 msgr2=0x7f372c065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:04.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.213+0000 7f374f08d700 1 --2- 172.21.15.61:0/1820892168 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f372c063290 0x7f372c065740 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3734000c00 tx=0x7f3734008030 comp rx=0 tx=0).stop 2023-01-01T17:40:04.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.213+0000 7f374f08d700 1 -- 172.21.15.61:0/1820892168 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f374806cff0 msgr2=0x7f3748154140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:04.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.213+0000 7f374f08d700 1 --2- 172.21.15.61:0/1820892168 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f374806cff0 0x7f3748154140 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f373c00ebe0 tx=0x7f373c00eef0 comp rx=0 tx=0).stop 2023-01-01T17:40:04.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.213+0000 7f374f08d700 1 -- 172.21.15.61:0/1820892168 shutdown_connections 2023-01-01T17:40:04.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.213+0000 7f374f08d700 1 --2- 172.21.15.61:0/1820892168 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f37480a9a40 0x7f37480a9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:04.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.213+0000 7f374f08d700 1 --2- 172.21.15.61:0/1820892168 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f372c063290 0x7f372c065740 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:04.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.213+0000 7f374f08d700 1 --2- 172.21.15.61:0/1820892168 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f374806cff0 0x7f3748154140 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:04.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.213+0000 7f374f08d700 1 --2- 172.21.15.61:0/1820892168 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f374814cf50 0x7f37480c24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:04.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.213+0000 7f374f08d700 1 -- 172.21.15.61:0/1820892168 >> 172.21.15.61:0/1820892168 conn(0x7f37480c1e80 msgr2=0x7f374814b580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:04.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.213+0000 7f374f08d700 1 -- 172.21.15.61:0/1820892168 shutdown_connections 2023-01-01T17:40:04.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.213+0000 7f374f08d700 1 -- 172.21.15.61:0/1820892168 wait complete. 2023-01-01T17:40:04.225 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-01-01T17:40:04.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.350+0000 7f2731c2a700 1 Processor -- start 2023-01-01T17:40:04.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.350+0000 7f2731c2a700 1 -- start start 2023-01-01T17:40:04.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.351+0000 7f2731c2a700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f272c150280 0x7f272c06a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:04.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.351+0000 7f2731c2a700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f272c06f1e0 con 0x7f272c06a8b0 2023-01-01T17:40:04.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.351+0000 7f2731c2a700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f272c06f710 con 0x7f272c0c1a70 2023-01-01T17:40:04.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.351+0000 7f2731c2a700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272c152d40 con 0x7f272c150280 2023-01-01T17:40:04.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.351+0000 7f272bfff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f272c06a8b0 0x7f272c15d6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40124/0 (socket says 172.21.15.61:40124) 2023-01-01T17:40:04.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.351+0000 7f272bfff700 1 -- 172.21.15.61:0/1823292949 learned_addr learned my addr 172.21.15.61:0/1823292949 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:40:04.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.352+0000 7f272b7fe700 1 --2- 172.21.15.61:0/1823292949 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f272c150280 0x7f272c06a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:04.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.352+0000 7f272a7fc700 1 -- 172.21.15.61:0/1823292949 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1539380935 0 0) 0x7f272c06f1e0 con 0x7f272c06a8b0 2023-01-01T17:40:04.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.352+0000 7f272a7fc700 1 -- 172.21.15.61:0/1823292949 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27140035b0 con 0x7f272c06a8b0 2023-01-01T17:40:04.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.352+0000 7f272a7fc700 1 -- 172.21.15.61:0/1823292949 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1087795382 0 0) 0x7f272c06f710 con 0x7f272c0c1a70 2023-01-01T17:40:04.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.352+0000 7f272a7fc700 1 -- 172.21.15.61:0/1823292949 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f272c06f1e0 con 0x7f272c0c1a70 2023-01-01T17:40:04.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.352+0000 7f272a7fc700 1 -- 172.21.15.61:0/1823292949 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3077518961 0 0) 0x7f27140035b0 con 0x7f272c06a8b0 2023-01-01T17:40:04.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.352+0000 7f272b7fe700 1 -- 172.21.15.61:0/1823292949 >> v1:172.21.15.149:6789/0 conn(0x7f272c0c1a70 legacy=0x7f272c0bfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:04.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.352+0000 7f272b7fe700 1 -- 172.21.15.61:0/1823292949 >> v1:172.21.15.61:6789/0 conn(0x7f272c06a8b0 legacy=0x7f272c15d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:04.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.352+0000 7f272b7fe700 1 -- 172.21.15.61:0/1823292949 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272c06f430 con 0x7f272c150280 2023-01-01T17:40:04.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.352+0000 7f272b7fe700 1 --2- 172.21.15.61:0/1823292949 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f272c150280 0x7f272c06a370 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f271c009870 tx=0x7f271c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df337b8ddd1ed67c server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:04.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.352+0000 7f272a7fc700 1 -- 172.21.15.61:0/1823292949 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27240019f0 con 0x7f272c150280 2023-01-01T17:40:04.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.352+0000 7f272a7fc700 1 -- 172.21.15.61:0/1823292949 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271c004030 con 0x7f272c150280 2023-01-01T17:40:04.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.352+0000 7f272a7fc700 1 -- 172.21.15.61:0/1823292949 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c0043c0 con 0x7f272c150280 2023-01-01T17:40:04.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.353+0000 7f2731c2a700 1 -- 172.21.15.61:0/1823292949 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f272c150280 msgr2=0x7f272c06a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:04.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.353+0000 7f2731c2a700 1 --2- 172.21.15.61:0/1823292949 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f272c150280 0x7f272c06a370 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f271c009870 tx=0x7f271c009b80 comp rx=0 tx=0).stop 2023-01-01T17:40:04.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.353+0000 7f2731c2a700 1 -- 172.21.15.61:0/1823292949 shutdown_connections 2023-01-01T17:40:04.355 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.353+0000 7f2731c2a700 1 --2- 172.21.15.61:0/1823292949 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f272c150280 0x7f272c06a370 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:04.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.353+0000 7f2731c2a700 1 -- 172.21.15.61:0/1823292949 >> 172.21.15.61:0/1823292949 conn(0x7f272c0c1f30 msgr2=0x7f272c0c2330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:04.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.353+0000 7f2731c2a700 1 -- 172.21.15.61:0/1823292949 shutdown_connections 2023-01-01T17:40:04.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.353+0000 7f2731c2a700 1 -- 172.21.15.61:0/1823292949 wait complete. 2023-01-01T17:40:04.358 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.354+0000 7f2731c2a700 1 Processor -- start 2023-01-01T17:40:04.358 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.354+0000 7f2731c2a700 1 -- start start 2023-01-01T17:40:04.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.355+0000 7f2731c2a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f272c06a8b0 0x7f272c06c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:04.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.355+0000 7f2731c2a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f272c0c1a70 0x7f272c147c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:04.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.355+0000 7f2731c2a700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f272c150280 0x7f272c148180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:04.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.355+0000 7f2731c2a700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c1486c0 con 0x7f272c0c1a70 2023-01-01T17:40:04.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.355+0000 7f2731c2a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c148de0 con 0x7f272c06a8b0 2023-01-01T17:40:04.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.355+0000 7f2731c2a700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272c148820 con 0x7f272c150280 2023-01-01T17:40:04.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.355+0000 7f272affd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f272c0c1a70 0x7f272c147c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:04.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.355+0000 7f272affd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f272c0c1a70 0x7f272c147c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46278/0 (socket says 172.21.15.61:46278) 2023-01-01T17:40:04.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.355+0000 7f272affd700 1 -- 172.21.15.61:0/1447117608 learned_addr learned my addr 172.21.15.61:0/1447117608 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:04.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.355+0000 7f272b7fe700 1 --2- 172.21.15.61:0/1447117608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f272c06a8b0 0x7f272c06c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:04.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.355+0000 7f272bfff700 1 --2- 172.21.15.61:0/1447117608 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f272c150280 0x7f272c148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:04.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.355+0000 7f272affd700 1 -- 172.21.15.61:0/1447117608 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f272c150280 msgr2=0x7f272c148180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:04.359 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.355+0000 7f272affd700 1 --2- 172.21.15.61:0/1447117608 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f272c150280 0x7f272c148180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:04.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.355+0000 7f272affd700 1 -- 172.21.15.61:0/1447117608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f272c06a8b0 msgr2=0x7f272c06c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:04.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.355+0000 7f272affd700 1 --2- 172.21.15.61:0/1447117608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f272c06a8b0 0x7f272c06c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:04.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.355+0000 7f272affd700 1 -- 172.21.15.61:0/1447117608 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271c0094a0 con 0x7f272c0c1a70 2023-01-01T17:40:04.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.355+0000 7f272b7fe700 1 --2- 172.21.15.61:0/1447117608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f272c06a8b0 0x7f272c06c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-01-01T17:40:04.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.355+0000 7f272bfff700 1 --2- 172.21.15.61:0/1447117608 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f272c150280 0x7f272c148180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-01-01T17:40:04.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.355+0000 7f272affd700 1 --2- 172.21.15.61:0/1447117608 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f272c0c1a70 0x7f272c147c40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f272000c520 tx=0x7f272000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:04.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.356+0000 7f2713fff700 1 -- 172.21.15.61:0/1447117608 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27200052d0 con 0x7f272c0c1a70 2023-01-01T17:40:04.360 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.356+0000 7f2713fff700 1 -- 172.21.15.61:0/1447117608 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2720005430 con 0x7f272c0c1a70 2023-01-01T17:40:04.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.356+0000 7f2731c2a700 1 -- 172.21.15.61:0/1447117608 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f272c153210 con 0x7f272c0c1a70 2023-01-01T17:40:04.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.356+0000 7f2713fff700 1 -- 172.21.15.61:0/1447117608 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27200038c0 con 0x7f272c0c1a70 2023-01-01T17:40:04.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.356+0000 7f2731c2a700 1 -- 172.21.15.61:0/1447117608 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f272c152f30 con 0x7f272c0c1a70 2023-01-01T17:40:04.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.357+0000 7f2731c2a700 1 -- 172.21.15.61:0/1447117608 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f272c1534f0 con 0x7f272c0c1a70 2023-01-01T17:40:04.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.357+0000 7f2713fff700 1 -- 172.21.15.61:0/1447117608 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f2720019030 con 0x7f272c0c1a70 2023-01-01T17:40:04.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.357+0000 7f2713fff700 1 --2- 172.21.15.61:0/1447117608 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f2718063290 0x7f2718065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:04.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.357+0000 7f2713fff700 1 -- 172.21.15.61:0/1447117608 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f272007f1d0 con 0x7f272c0c1a70 2023-01-01T17:40:04.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.357+0000 7f272b7fe700 1 --2- 172.21.15.61:0/1447117608 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f2718063290 0x7f2718065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:04.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.358+0000 7f272b7fe700 1 --2- 172.21.15.61:0/1447117608 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f2718063290 0x7f2718065740 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f271c0090b0 tx=0x7f271c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:04.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.362+0000 7f2713fff700 1 -- 172.21.15.61:0/1447117608 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f272004df90 con 0x7f272c0c1a70 2023-01-01T17:40:04.568 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.568+0000 7f2731c2a700 1 -- 172.21.15.61:0/1447117608 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f272c0668a0 con 0x7f272c0c1a70 2023-01-01T17:40:04.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.569+0000 7f2713fff700 1 -- 172.21.15.61:0/1447117608 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f27200515b0 con 0x7f272c0c1a70 2023-01-01T17:40:04.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.571+0000 7f2731c2a700 1 -- 172.21.15.61:0/1447117608 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f2718063290 msgr2=0x7f2718065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:04.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.571+0000 7f2731c2a700 1 --2- 172.21.15.61:0/1447117608 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f2718063290 0x7f2718065740 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f271c0090b0 tx=0x7f271c008030 comp rx=0 tx=0).stop 2023-01-01T17:40:04.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.571+0000 7f2731c2a700 1 -- 172.21.15.61:0/1447117608 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f272c0c1a70 msgr2=0x7f272c147c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:04.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.571+0000 7f2731c2a700 1 --2- 172.21.15.61:0/1447117608 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f272c0c1a70 0x7f272c147c40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f272000c520 tx=0x7f272000c8e0 comp rx=0 tx=0).stop 2023-01-01T17:40:04.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.571+0000 7f2731c2a700 1 -- 172.21.15.61:0/1447117608 shutdown_connections 2023-01-01T17:40:04.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.571+0000 7f2731c2a700 1 --2- 172.21.15.61:0/1447117608 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f272c150280 0x7f272c148180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:04.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.571+0000 7f2731c2a700 1 --2- 172.21.15.61:0/1447117608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f272c06a8b0 0x7f272c06c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:04.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.571+0000 7f2731c2a700 1 --2- 172.21.15.61:0/1447117608 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f2718063290 0x7f2718065740 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:04.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.571+0000 7f2731c2a700 1 --2- 172.21.15.61:0/1447117608 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f272c0c1a70 0x7f272c147c40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:04.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.571+0000 7f2731c2a700 1 -- 172.21.15.61:0/1447117608 >> 172.21.15.61:0/1447117608 conn(0x7f272c0c1f30 msgr2=0x7f272c069360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:04.572 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.571+0000 7f2731c2a700 1 -- 172.21.15.61:0/1447117608 shutdown_connections 2023-01-01T17:40:04.573 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.571+0000 7f2731c2a700 1 -- 172.21.15.61:0/1447117608 wait complete. 2023-01-01T17:40:04.573 INFO:teuthology.orchestra.run.smithi061.stderr:listed 0 entries 2023-01-01T17:40:04.582 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-01-01T17:40:04.583 DEBUG:teuthology.orchestra.run.smithi061:> dd if=/proc/self/mounts of=/dev/stdout 2023-01-01T17:40:04.603 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-01T17:40:04.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.862+0000 7f9411e90700 1 Processor -- start 2023-01-01T17:40:04.862 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.862+0000 7f9411e90700 1 -- start start 2023-01-01T17:40:04.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.863+0000 7f9411e90700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f940c0c4e20 0x7f940c0c3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:04.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.863+0000 7f9411e90700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f940c0c51f0 con 0x7f940c155010 2023-01-01T17:40:04.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.863+0000 7f9411e90700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f940c0715b0 con 0x7f940c070440 2023-01-01T17:40:04.864 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.863+0000 7f9411e90700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f940c0708c0 con 0x7f940c0c4e20 2023-01-01T17:40:04.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.863+0000 7f940b7fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f940c0c4e20 0x7f940c0c3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:04.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.863+0000 7f940bfff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f940c155010 0x7f940c155410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40138/0 (socket says 172.21.15.61:40138) 2023-01-01T17:40:04.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.863+0000 7f940bfff700 1 -- 172.21.15.61:0/1310954510 learned_addr learned my addr 172.21.15.61:0/1310954510 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:40:04.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.863+0000 7f940b7fe700 1 -- 172.21.15.61:0/1310954510 >> v1:172.21.15.149:6789/0 conn(0x7f940c070440 legacy=0x7f940c069360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:04.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.863+0000 7f940b7fe700 1 -- 172.21.15.61:0/1310954510 >> v1:172.21.15.61:6789/0 conn(0x7f940c155010 legacy=0x7f940c155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:04.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.863+0000 7f940b7fe700 1 -- 172.21.15.61:0/1310954510 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f940c070b40 con 0x7f940c0c4e20 2023-01-01T17:40:04.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.864+0000 7f940b7fe700 1 --2- 172.21.15.61:0/1310954510 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f940c0c4e20 0x7f940c0c3ca0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f93fc009840 tx=0x7f93fc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7475d8adf81a24f server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:04.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.864+0000 7f940a7fc700 1 -- 172.21.15.61:0/1310954510 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93fc004230 con 0x7f940c0c4e20 2023-01-01T17:40:04.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.864+0000 7f940a7fc700 1 -- 172.21.15.61:0/1310954510 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93fc004390 con 0x7f940c0c4e20 2023-01-01T17:40:04.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.864+0000 7f940a7fc700 1 -- 172.21.15.61:0/1310954510 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93fc0036a0 con 0x7f940c0c4e20 2023-01-01T17:40:04.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.864+0000 7f9411e90700 1 -- 172.21.15.61:0/1310954510 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f940c0c4e20 msgr2=0x7f940c0c3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:04.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.864+0000 7f9411e90700 1 --2- 172.21.15.61:0/1310954510 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f940c0c4e20 0x7f940c0c3ca0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f93fc009840 tx=0x7f93fc009b50 comp rx=0 tx=0).stop 2023-01-01T17:40:04.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.864+0000 7f9411e90700 1 -- 172.21.15.61:0/1310954510 shutdown_connections 2023-01-01T17:40:04.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.864+0000 7f9411e90700 1 --2- 172.21.15.61:0/1310954510 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f940c0c4e20 0x7f940c0c3ca0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:04.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.864+0000 7f9411e90700 1 -- 172.21.15.61:0/1310954510 >> 172.21.15.61:0/1310954510 conn(0x7f940c06b100 msgr2=0x7f940c0c5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:04.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.864+0000 7f9411e90700 1 -- 172.21.15.61:0/1310954510 shutdown_connections 2023-01-01T17:40:04.867 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.864+0000 7f9411e90700 1 -- 172.21.15.61:0/1310954510 wait complete. 2023-01-01T17:40:04.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.865+0000 7f9411e90700 1 Processor -- start 2023-01-01T17:40:04.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.866+0000 7f9411e90700 1 -- start start 2023-01-01T17:40:04.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.866+0000 7f9411e90700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f940c070440 0x7f940c06cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:04.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.866+0000 7f9411e90700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f940c0c4e20 0x7f940c1e8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:04.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.866+0000 7f9411e90700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f940c155010 0x7f940c1e91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:04.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.866+0000 7f9411e90700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f940c1df3a0 con 0x7f940c155010 2023-01-01T17:40:04.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.866+0000 7f9411e90700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f940c14fb20 con 0x7f940c070440 2023-01-01T17:40:04.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.866+0000 7f9411e90700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f940c14f5a0 con 0x7f940c0c4e20 2023-01-01T17:40:04.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.866+0000 7f940bfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f940c155010 0x7f940c1e91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:04.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.866+0000 7f940bfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f940c155010 0x7f940c1e91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46294/0 (socket says 172.21.15.61:46294) 2023-01-01T17:40:04.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.866+0000 7f940bfff700 1 -- 172.21.15.61:0/763492051 learned_addr learned my addr 172.21.15.61:0/763492051 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:04.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.867+0000 7f940b7fe700 1 --2- 172.21.15.61:0/763492051 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f940c070440 0x7f940c06cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:04.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.867+0000 7f940affd700 1 --2- 172.21.15.61:0/763492051 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f940c0c4e20 0x7f940c1e8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:04.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.867+0000 7f940bfff700 1 -- 172.21.15.61:0/763492051 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f940c0c4e20 msgr2=0x7f940c1e8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:04.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.867+0000 7f940bfff700 1 --2- 172.21.15.61:0/763492051 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f940c0c4e20 0x7f940c1e8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:04.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.867+0000 7f940bfff700 1 -- 172.21.15.61:0/763492051 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f940c070440 msgr2=0x7f940c06cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:04.871 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.867+0000 7f940bfff700 1 --2- 172.21.15.61:0/763492051 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f940c070440 0x7f940c06cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:04.872 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.867+0000 7f940bfff700 1 -- 172.21.15.61:0/763492051 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93fc0094a0 con 0x7f940c155010 2023-01-01T17:40:04.872 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.867+0000 7f940b7fe700 1 --2- 172.21.15.61:0/763492051 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f940c070440 0x7f940c06cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-01-01T17:40:04.872 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.867+0000 7f940bfff700 1 --2- 172.21.15.61:0/763492051 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f940c155010 0x7f940c1e91e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f940400cca0 tx=0x7f940400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:04.872 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.867+0000 7f93f3fff700 1 -- 172.21.15.61:0/763492051 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940400cea0 con 0x7f940c155010 2023-01-01T17:40:04.872 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.867+0000 7f93f3fff700 1 -- 172.21.15.61:0/763492051 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940400ada0 con 0x7f940c155010 2023-01-01T17:40:04.872 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.867+0000 7f9411e90700 1 -- 172.21.15.61:0/763492051 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f940c154810 con 0x7f940c155010 2023-01-01T17:40:04.872 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.867+0000 7f93f3fff700 1 -- 172.21.15.61:0/763492051 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9404007310 con 0x7f940c155010 2023-01-01T17:40:04.872 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.867+0000 7f9411e90700 1 -- 172.21.15.61:0/763492051 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f940c070e20 con 0x7f940c155010 2023-01-01T17:40:04.872 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.868+0000 7f9411e90700 1 -- 172.21.15.61:0/763492051 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f940c154af0 con 0x7f940c155010 2023-01-01T17:40:04.872 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.868+0000 7f93f3fff700 1 -- 172.21.15.61:0/763492051 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f940401a030 con 0x7f940c155010 2023-01-01T17:40:04.872 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.869+0000 7f93f3fff700 1 --2- 172.21.15.61:0/763492051 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f93f8063290 0x7f93f8065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:04.873 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.869+0000 7f93f3fff700 1 -- 172.21.15.61:0/763492051 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f940407fad0 con 0x7f940c155010 2023-01-01T17:40:04.873 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.869+0000 7f940b7fe700 1 --2- 172.21.15.61:0/763492051 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f93f8063290 0x7f93f8065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:04.873 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.869+0000 7f940b7fe700 1 --2- 172.21.15.61:0/763492051 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f93f8063290 0x7f93f8065740 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f940c0a8850 tx=0x7f93fc013040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:04.873 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:04.873+0000 7f93f3fff700 1 -- 172.21.15.61:0/763492051 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f940404e890 con 0x7f940c155010 2023-01-01T17:40:05.066 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.066+0000 7f9411e90700 1 -- 172.21.15.61:0/763492051 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f940c1ecf80 con 0x7f940c155010 2023-01-01T17:40:05.066 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.067+0000 7f93f3fff700 1 -- 172.21.15.61:0/763492051 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18729 (secure 0 0 0) 0x7f9404018070 con 0x7f940c155010 2023-01-01T17:40:05.067 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:40:05.067 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":24,"fsid":"fe0d3d8e-46ee-4ed9-92f8-749741721d01","created":"2023-01-01T17:39:34.752404+0000","modified":"2023-01-01T17:39:57.386830+0000","last_up_change":"2023-01-01T17:39:45.159720+0000","last_in_change":"2023-01-01T17:39:37.293057+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-01-01T17:39:46.110776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-01-01T17:39:46.276625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-01-01T17:39:50.568073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-01-01T17:39:51.915351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-01-01T17:39:54.992107+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5ba13bcd-4407-4cfd-8487-80917501e525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":94349},{"type":"v1","addr":"172.21.15.61:6825","nonce":94349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":94349},{"type":"v1","addr":"172.21.15.61:6827","nonce":94349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":94349},{"type":"v1","addr":"172.21.15.61:6831","nonce":94349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":94349},{"type":"v1","addr":"172.21.15.61:6829","nonce":94349}]},"public_addr":"172.21.15.61:6825/94349","cluster_addr":"172.21.15.61:6827/94349","heartbeat_back_addr":"172.21.15.61:6831/94349","heartbeat_front_addr":"172.21.15.61:6829/94349","state":["exists","up"]},{"osd":1,"uuid":"7dca9f34-ea22-4894-b238-5606b16b9c74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6811","nonce":94348},{"type":"v1","addr":"172.21.15.61:6813","nonce":94348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":94348},{"type":"v1","addr":"172.21.15.61:6816","nonce":94348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6821","nonce":94348},{"type":"v1","addr":"172.21.15.61:6823","nonce":94348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":94348},{"type":"v1","addr":"172.21.15.61:6819","nonce":94348}]},"public_addr":"172.21.15.61:6813/94348","cluster_addr":"172.21.15.61:6816/94348","heartbeat_back_addr":"172.21.15.61:6823/94348","heartbeat_front_addr":"172.21.15.61:6819/94348","state":["exists","up"]},{"osd":2,"uuid":"7b43ea06-a7b6-49f4-a390-18ad14dfe4fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":94350},{"type":"v1","addr":"172.21.15.61:6809","nonce":94350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":94350},{"type":"v1","addr":"172.21.15.61:6812","nonce":94350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":94350},{"type":"v1","addr":"172.21.15.61:6822","nonce":94350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6815","nonce":94350},{"type":"v1","addr":"172.21.15.61:6817","nonce":94350}]},"public_addr":"172.21.15.61:6809/94350","cluster_addr":"172.21.15.61:6812/94350","heartbeat_back_addr":"172.21.15.61:6822/94350","heartbeat_front_addr":"172.21.15.61:6817/94350","state":["exists","up"]},{"osd":3,"uuid":"117c41d8-d40c-4cc0-b0e1-70bca058fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":94347},{"type":"v1","addr":"172.21.15.61:6801","nonce":94347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":94347},{"type":"v1","addr":"172.21.15.61:6803","nonce":94347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":94347},{"type":"v1","addr":"172.21.15.61:6807","nonce":94347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":94347},{"type":"v1","addr":"172.21.15.61:6805","nonce":94347}]},"public_addr":"172.21.15.61:6801/94347","cluster_addr":"172.21.15.61:6803/94347","heartbeat_back_addr":"172.21.15.61:6807/94347","heartbeat_front_addr":"172.21.15.61:6805/94347","state":["exists","up"]},{"osd":4,"uuid":"4073e0e8-c5dd-463f-aa1c-c9515ef09976","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":94711},{"type":"v1","addr":"172.21.15.149:6818","nonce":94711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":94711},{"type":"v1","addr":"172.21.15.149:6822","nonce":94711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":94711},{"type":"v1","addr":"172.21.15.149:6830","nonce":94711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":94711},{"type":"v1","addr":"172.21.15.149:6826","nonce":94711}]},"public_addr":"172.21.15.149:6818/94711","cluster_addr":"172.21.15.149:6822/94711","heartbeat_back_addr":"172.21.15.149:6830/94711","heartbeat_front_addr":"172.21.15.149:6826/94711","state":["exists","up"]},{"osd":5,"uuid":"88aa0c0f-e3c1-4dd3-af8c-61f4bc28504e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":94709},{"type":"v1","addr":"172.21.15.149:6809","nonce":94709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":94709},{"type":"v1","addr":"172.21.15.149:6811","nonce":94709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":94709},{"type":"v1","addr":"172.21.15.149:6815","nonce":94709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":94709},{"type":"v1","addr":"172.21.15.149:6813","nonce":94709}]},"public_addr":"172.21.15.149:6809/94709","cluster_addr":"172.21.15.149:6811/94709","heartbeat_back_addr":"172.21.15.149:6815/94709","heartbeat_front_addr":"172.21.15.149:6813/94709","state":["exists","up"]},{"osd":6,"uuid":"8b13fc0c-5f00-41c7-8923-c4570da77afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":94710},{"type":"v1","addr":"172.21.15.149:6801","nonce":94710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":94710},{"type":"v1","addr":"172.21.15.149:6803","nonce":94710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":94710},{"type":"v1","addr":"172.21.15.149:6807","nonce":94710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":94710},{"type":"v1","addr":"172.21.15.149:6805","nonce":94710}]},"public_addr":"172.21.15.149:6801/94710","cluster_addr":"172.21.15.149:6803/94710","heartbeat_back_addr":"172.21.15.149:6807/94710","heartbeat_front_addr":"172.21.15.149:6805/94710","state":["exists","up"]},{"osd":7,"uuid":"5390c6e5-39e7-4aa6-b73c-642458b2acf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":94734},{"type":"v1","addr":"172.21.15.149:6819","nonce":94734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":94734},{"type":"v1","addr":"172.21.15.149:6823","nonce":94734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":94734},{"type":"v1","addr":"172.21.15.149:6831","nonce":94734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":94734},{"type":"v1","addr":"172.21.15.149:6827","nonce":94734}]},"public_addr":"172.21.15.149:6819/94734","cluster_addr":"172.21.15.149:6823/94734","heartbeat_back_addr":"172.21.15.149:6831/94734","heartbeat_front_addr":"172.21.15.149:6827/94734","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.555826+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.508739+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.515601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.472067+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.535257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.493397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.554910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.552343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-01T17:40:05.070 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.069+0000 7f9411e90700 1 -- 172.21.15.61:0/763492051 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f93f8063290 msgr2=0x7f93f8065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:05.070 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.069+0000 7f9411e90700 1 --2- 172.21.15.61:0/763492051 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f93f8063290 0x7f93f8065740 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f940c0a8850 tx=0x7f93fc013040 comp rx=0 tx=0).stop 2023-01-01T17:40:05.070 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.069+0000 7f9411e90700 1 -- 172.21.15.61:0/763492051 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f940c155010 msgr2=0x7f940c1e91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:05.070 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.069+0000 7f9411e90700 1 --2- 172.21.15.61:0/763492051 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f940c155010 0x7f940c1e91e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f940400cca0 tx=0x7f940400a340 comp rx=0 tx=0).stop 2023-01-01T17:40:05.070 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.069+0000 7f9411e90700 1 -- 172.21.15.61:0/763492051 shutdown_connections 2023-01-01T17:40:05.070 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.069+0000 7f9411e90700 1 --2- 172.21.15.61:0/763492051 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f93f8063290 0x7f93f8065740 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:05.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.069+0000 7f9411e90700 1 --2- 172.21.15.61:0/763492051 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f940c155010 0x7f940c1e91e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:05.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.069+0000 7f9411e90700 1 --2- 172.21.15.61:0/763492051 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f940c070440 0x7f940c06cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:05.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.069+0000 7f9411e90700 1 --2- 172.21.15.61:0/763492051 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f940c0c4e20 0x7f940c1e8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:05.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.069+0000 7f9411e90700 1 -- 172.21.15.61:0/763492051 >> 172.21.15.61:0/763492051 conn(0x7f940c06b100 msgr2=0x7f940c155e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:05.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.069+0000 7f9411e90700 1 -- 172.21.15.61:0/763492051 shutdown_connections 2023-01-01T17:40:05.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.069+0000 7f9411e90700 1 -- 172.21.15.61:0/763492051 wait complete. 2023-01-01T17:40:05.081 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-01-01T17:39:46.110776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-01-01T17:39:46.276625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-01-01T17:39:50.568073+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-01-01T17:39:51.915351+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-01-01T17:39:54.992107+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-01-01T17:40:05.082 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-01-01T17:40:05.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.209+0000 7f2629f41700 1 Processor -- start 2023-01-01T17:40:05.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.209+0000 7f2629f41700 1 -- start start 2023-01-01T17:40:05.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.210+0000 7f2629f41700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26240c6e90 0x7f26240c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:05.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.210+0000 7f2629f41700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f262406df70 0x7f26240c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:05.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.210+0000 7f2629f41700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f262406dae0 con 0x7f26240c7260 2023-01-01T17:40:05.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.210+0000 7f2629f41700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26240ba5b0 con 0x7f262406df70 2023-01-01T17:40:05.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.210+0000 7f2629f41700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262406e550 con 0x7f26240c6e90 2023-01-01T17:40:05.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.210+0000 7f2623fff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f262406df70 0x7f26240c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:05.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.210+0000 7f2622ffd700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f26240c7260 0x7f26241544b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40150/0 (socket says 172.21.15.61:40150) 2023-01-01T17:40:05.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.210+0000 7f2622ffd700 1 -- 172.21.15.61:0/2847340042 learned_addr learned my addr 172.21.15.61:0/2847340042 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:40:05.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.210+0000 7f26237fe700 1 --2- 172.21.15.61:0/2847340042 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26240c6e90 0x7f26240c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:05.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.210+0000 7f2623fff700 1 -- 172.21.15.61:0/2847340042 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26240c6e90 msgr2=0x7f26240c55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:05.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.210+0000 7f2623fff700 1 --2- 172.21.15.61:0/2847340042 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26240c6e90 0x7f26240c55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:05.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.210+0000 7f2623fff700 1 -- 172.21.15.61:0/2847340042 >> v1:172.21.15.61:6789/0 conn(0x7f26240c7260 legacy=0x7f26241544b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:05.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.210+0000 7f2623fff700 1 -- 172.21.15.61:0/2847340042 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262406e830 con 0x7f262406df70 2023-01-01T17:40:05.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.210+0000 7f26227fc700 1 -- 172.21.15.61:0/2847340042 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 666170317 0 0) 0x7f262406dae0 con 0x7f26240c7260 2023-01-01T17:40:05.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.211+0000 7f2623fff700 1 --2- 172.21.15.61:0/2847340042 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f262406df70 0x7f26240c5b20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f261c009d90 tx=0x7f261c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce46137f7c58a8a server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:05.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.211+0000 7f26227fc700 1 -- 172.21.15.61:0/2847340042 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c00e070 con 0x7f262406df70 2023-01-01T17:40:05.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.211+0000 7f26227fc700 1 -- 172.21.15.61:0/2847340042 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261c00bb20 con 0x7f262406df70 2023-01-01T17:40:05.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.211+0000 7f26227fc700 1 -- 172.21.15.61:0/2847340042 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c012430 con 0x7f262406df70 2023-01-01T17:40:05.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.211+0000 7f2629f41700 1 -- 172.21.15.61:0/2847340042 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f262406df70 msgr2=0x7f26240c5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:05.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.211+0000 7f2629f41700 1 --2- 172.21.15.61:0/2847340042 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f262406df70 0x7f26240c5b20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f261c009d90 tx=0x7f261c00b330 comp rx=0 tx=0).stop 2023-01-01T17:40:05.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.211+0000 7f2629f41700 1 -- 172.21.15.61:0/2847340042 shutdown_connections 2023-01-01T17:40:05.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.211+0000 7f2629f41700 1 --2- 172.21.15.61:0/2847340042 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26240c6e90 0x7f26240c55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:05.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.211+0000 7f2629f41700 1 --2- 172.21.15.61:0/2847340042 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f262406df70 0x7f26240c5b20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:05.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.211+0000 7f2629f41700 1 -- 172.21.15.61:0/2847340042 >> 172.21.15.61:0/2847340042 conn(0x7f2624070ad0 msgr2=0x7f2624070ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:05.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.211+0000 7f2629f41700 1 -- 172.21.15.61:0/2847340042 shutdown_connections 2023-01-01T17:40:05.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.211+0000 7f2629f41700 1 -- 172.21.15.61:0/2847340042 wait complete. 2023-01-01T17:40:05.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.212+0000 7f2629f41700 1 Processor -- start 2023-01-01T17:40:05.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.213+0000 7f2629f41700 1 -- start start 2023-01-01T17:40:05.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.213+0000 7f2629f41700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f262406df70 0x7f262414e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:05.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.213+0000 7f2629f41700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f26240c6e90 0x7f26240a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:05.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.213+0000 7f2629f41700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26240c7260 0x7f26241e9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:05.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.213+0000 7f2629f41700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262414cfa0 con 0x7f26240c6e90 2023-01-01T17:40:05.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.213+0000 7f2629f41700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26240a8cb0 con 0x7f262406df70 2023-01-01T17:40:05.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.213+0000 7f2629f41700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262414da70 con 0x7f26240c7260 2023-01-01T17:40:05.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.213+0000 7f2622ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f26240c6e90 0x7f26240a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:05.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.213+0000 7f2622ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f26240c6e90 0x7f26240a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46304/0 (socket says 172.21.15.61:46304) 2023-01-01T17:40:05.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.213+0000 7f2622ffd700 1 -- 172.21.15.61:0/597378888 learned_addr learned my addr 172.21.15.61:0/597378888 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:05.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.214+0000 7f2623fff700 1 --2- 172.21.15.61:0/597378888 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26240c7260 0x7f26241e9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:05.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.214+0000 7f26237fe700 1 --2- 172.21.15.61:0/597378888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f262406df70 0x7f262414e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:05.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.214+0000 7f2622ffd700 1 -- 172.21.15.61:0/597378888 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26240c7260 msgr2=0x7f26241e9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:05.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.214+0000 7f2622ffd700 1 --2- 172.21.15.61:0/597378888 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26240c7260 0x7f26241e9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:05.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.214+0000 7f2622ffd700 1 -- 172.21.15.61:0/597378888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f262406df70 msgr2=0x7f262414e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:05.222 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.214+0000 7f2622ffd700 1 --2- 172.21.15.61:0/597378888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f262406df70 0x7f262414e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:05.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.214+0000 7f2622ffd700 1 -- 172.21.15.61:0/597378888 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c009a70 con 0x7f26240c6e90 2023-01-01T17:40:05.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.214+0000 7f2622ffd700 1 --2- 172.21.15.61:0/597378888 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f26240c6e90 0x7f26240a9b60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f260c00c550 tx=0x7f260c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:05.223 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.214+0000 7f261bfff700 1 -- 172.21.15.61:0/597378888 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c004c80 con 0x7f26240c6e90 2023-01-01T17:40:05.224 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.214+0000 7f261bfff700 1 -- 172.21.15.61:0/597378888 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260c004e00 con 0x7f26240c6e90 2023-01-01T17:40:05.224 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.214+0000 7f2629f41700 1 -- 172.21.15.61:0/597378888 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f262406d770 con 0x7f26240c6e90 2023-01-01T17:40:05.224 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.214+0000 7f261bfff700 1 -- 172.21.15.61:0/597378888 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c007310 con 0x7f26240c6e90 2023-01-01T17:40:05.224 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.214+0000 7f2629f41700 1 -- 172.21.15.61:0/597378888 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f262406eb10 con 0x7f26240c6e90 2023-01-01T17:40:05.224 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.215+0000 7f2629f41700 1 -- 172.21.15.61:0/597378888 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f262406d400 con 0x7f26240c6e90 2023-01-01T17:40:05.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.215+0000 7f261bfff700 1 -- 172.21.15.61:0/597378888 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f260c01a020 con 0x7f26240c6e90 2023-01-01T17:40:05.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.216+0000 7f261bfff700 1 --2- 172.21.15.61:0/597378888 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f2604063290 0x7f2604065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:05.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.216+0000 7f261bfff700 1 -- 172.21.15.61:0/597378888 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f260c07f820 con 0x7f26240c6e90 2023-01-01T17:40:05.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.216+0000 7f26237fe700 1 --2- 172.21.15.61:0/597378888 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f2604063290 0x7f2604065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:05.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.216+0000 7f26237fe700 1 --2- 172.21.15.61:0/597378888 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f2604063290 0x7f2604065740 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2614009be0 tx=0x7f2614009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:05.226 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.220+0000 7f261bfff700 1 -- 172.21.15.61:0/597378888 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f260c04e5e0 con 0x7f26240c6e90 2023-01-01T17:40:05.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.409+0000 7f2629f41700 1 -- 172.21.15.61:0/597378888 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f26240668a0 con 0x7f26240c6e90 2023-01-01T17:40:05.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.409+0000 7f261bfff700 1 -- 172.21.15.61:0/597378888 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f260c051c00 con 0x7f26240c6e90 2023-01-01T17:40:05.409 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 8 2023-01-01T17:40:05.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.411+0000 7f2629f41700 1 -- 172.21.15.61:0/597378888 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f2604063290 msgr2=0x7f2604065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:05.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.411+0000 7f2629f41700 1 --2- 172.21.15.61:0/597378888 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f2604063290 0x7f2604065740 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2614009be0 tx=0x7f2614009210 comp rx=0 tx=0).stop 2023-01-01T17:40:05.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.411+0000 7f2629f41700 1 -- 172.21.15.61:0/597378888 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f26240c6e90 msgr2=0x7f26240a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:05.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.411+0000 7f2629f41700 1 --2- 172.21.15.61:0/597378888 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f26240c6e90 0x7f26240a9b60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f260c00c550 tx=0x7f260c00c860 comp rx=0 tx=0).stop 2023-01-01T17:40:05.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.411+0000 7f2629f41700 1 -- 172.21.15.61:0/597378888 shutdown_connections 2023-01-01T17:40:05.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.411+0000 7f2629f41700 1 --2- 172.21.15.61:0/597378888 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f26240c7260 0x7f26241e9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:05.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.411+0000 7f2629f41700 1 --2- 172.21.15.61:0/597378888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f262406df70 0x7f262414e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:05.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.411+0000 7f2629f41700 1 --2- 172.21.15.61:0/597378888 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f2604063290 0x7f2604065740 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:05.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.411+0000 7f2629f41700 1 --2- 172.21.15.61:0/597378888 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f26240c6e90 0x7f26240a9b60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:05.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.411+0000 7f2629f41700 1 -- 172.21.15.61:0/597378888 >> 172.21.15.61:0/597378888 conn(0x7f2624070ad0 msgr2=0x7f26240ac1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:05.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.411+0000 7f2629f41700 1 -- 172.21.15.61:0/597378888 shutdown_connections 2023-01-01T17:40:05.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.411+0000 7f2629f41700 1 -- 172.21.15.61:0/597378888 wait complete. 2023-01-01T17:40:05.423 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-01-01T17:40:05.558 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.552+0000 7fb83b191700 1 Processor -- start 2023-01-01T17:40:05.558 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.552+0000 7fb83b191700 1 -- start start 2023-01-01T17:40:05.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.552+0000 7fb83b191700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb834152ec0 0x7fb8341532c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:05.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.552+0000 7fb83b191700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb83406aaa0 con 0x7fb83414cf50 2023-01-01T17:40:05.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.552+0000 7fb83b191700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8340c0930 con 0x7fb83406cff0 2023-01-01T17:40:05.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.552+0000 7fb83b191700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb834069e90 con 0x7fb834152ec0 2023-01-01T17:40:05.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.553+0000 7fb838f2d700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fb83414cf50 0x7fb8340c0220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40162/0 (socket says 172.21.15.61:40162) 2023-01-01T17:40:05.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.553+0000 7fb838f2d700 1 -- 172.21.15.61:0/2955713699 learned_addr learned my addr 172.21.15.61:0/2955713699 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:40:05.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.553+0000 7fb83972e700 1 --2- 172.21.15.61:0/2955713699 >> v2:172.21.15.149:3300/0 conn(0x7fb834152ec0 0x7fb8341532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:05.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.553+0000 7fb8337fe700 1 -- 172.21.15.61:0/2955713699 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 291500311 0 0) 0x7fb83406aaa0 con 0x7fb83414cf50 2023-01-01T17:40:05.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.553+0000 7fb8337fe700 1 -- 172.21.15.61:0/2955713699 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8240035b0 con 0x7fb83414cf50 2023-01-01T17:40:05.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.553+0000 7fb8337fe700 1 -- 172.21.15.61:0/2955713699 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3998800121 0 0) 0x7fb8340c0930 con 0x7fb83406cff0 2023-01-01T17:40:05.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.553+0000 7fb8337fe700 1 -- 172.21.15.61:0/2955713699 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb83406aaa0 con 0x7fb83406cff0 2023-01-01T17:40:05.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.553+0000 7fb8337fe700 1 -- 172.21.15.61:0/2955713699 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4171927252 0 0) 0x7fb8240035b0 con 0x7fb83414cf50 2023-01-01T17:40:05.560 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.553+0000 7fb83972e700 1 -- 172.21.15.61:0/2955713699 >> v1:172.21.15.149:6789/0 conn(0x7fb83406cff0 legacy=0x7fb834069360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:05.561 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.553+0000 7fb83972e700 1 -- 172.21.15.61:0/2955713699 >> v1:172.21.15.61:6789/0 conn(0x7fb83414cf50 legacy=0x7fb8340c0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:05.561 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.553+0000 7fb83972e700 1 -- 172.21.15.61:0/2955713699 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83406a170 con 0x7fb834152ec0 2023-01-01T17:40:05.561 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.553+0000 7fb83972e700 1 --2- 172.21.15.61:0/2955713699 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb834152ec0 0x7fb8341532c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb82c009d90 tx=0x7fb82c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e297c77c2af7d868 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:05.561 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.554+0000 7fb8337fe700 1 -- 172.21.15.61:0/2955713699 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82c00e070 con 0x7fb834152ec0 2023-01-01T17:40:05.561 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.554+0000 7fb8337fe700 1 -- 172.21.15.61:0/2955713699 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82c003a20 con 0x7fb834152ec0 2023-01-01T17:40:05.561 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.554+0000 7fb8337fe700 1 -- 172.21.15.61:0/2955713699 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb828001670 con 0x7fb834152ec0 2023-01-01T17:40:05.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.554+0000 7fb83b191700 1 -- 172.21.15.61:0/2955713699 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb834152ec0 msgr2=0x7fb8341532c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:05.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.554+0000 7fb83b191700 1 --2- 172.21.15.61:0/2955713699 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb834152ec0 0x7fb8341532c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb82c009d90 tx=0x7fb82c00b330 comp rx=0 tx=0).stop 2023-01-01T17:40:05.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.554+0000 7fb83b191700 1 -- 172.21.15.61:0/2955713699 shutdown_connections 2023-01-01T17:40:05.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.554+0000 7fb83b191700 1 --2- 172.21.15.61:0/2955713699 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb834152ec0 0x7fb8341532c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:05.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.554+0000 7fb83b191700 1 -- 172.21.15.61:0/2955713699 >> 172.21.15.61:0/2955713699 conn(0x7fb8340c1e80 msgr2=0x7fb8340c2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:05.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.554+0000 7fb83b191700 1 -- 172.21.15.61:0/2955713699 shutdown_connections 2023-01-01T17:40:05.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.554+0000 7fb83b191700 1 -- 172.21.15.61:0/2955713699 wait complete. 2023-01-01T17:40:05.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.555+0000 7fb83b191700 1 Processor -- start 2023-01-01T17:40:05.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.555+0000 7fb83b191700 1 -- start start 2023-01-01T17:40:05.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.556+0000 7fb83b191700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb83406cff0 0x7fb8341e9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:05.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.556+0000 7fb83b191700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb83414cf50 0x7fb83414d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:05.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.556+0000 7fb83b191700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb834152ec0 0x7fb834150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:05.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.556+0000 7fb83b191700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb834152b90 con 0x7fb83406cff0 2023-01-01T17:40:05.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.556+0000 7fb83b191700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8340ab300 con 0x7fb83414cf50 2023-01-01T17:40:05.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.556+0000 7fb83b191700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8341e8da0 con 0x7fb834152ec0 2023-01-01T17:40:05.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.556+0000 7fb838f2d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb83406cff0 0x7fb8341e9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:05.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.556+0000 7fb838f2d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb83406cff0 0x7fb8341e9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46318/0 (socket says 172.21.15.61:46318) 2023-01-01T17:40:05.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.556+0000 7fb838f2d700 1 -- 172.21.15.61:0/3778461626 learned_addr learned my addr 172.21.15.61:0/3778461626 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:05.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.557+0000 7fb833fff700 1 --2- 172.21.15.61:0/3778461626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb83414cf50 0x7fb83414d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:05.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.557+0000 7fb83972e700 1 --2- 172.21.15.61:0/3778461626 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb834152ec0 0x7fb834150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:05.564 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.557+0000 7fb838f2d700 1 -- 172.21.15.61:0/3778461626 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb834152ec0 msgr2=0x7fb834150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:05.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.557+0000 7fb838f2d700 1 --2- 172.21.15.61:0/3778461626 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb834152ec0 0x7fb834150bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:05.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.557+0000 7fb838f2d700 1 -- 172.21.15.61:0/3778461626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb83414cf50 msgr2=0x7fb83414d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:05.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.557+0000 7fb838f2d700 1 --2- 172.21.15.61:0/3778461626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb83414cf50 0x7fb83414d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:05.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.557+0000 7fb838f2d700 1 -- 172.21.15.61:0/3778461626 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82c009a70 con 0x7fb83406cff0 2023-01-01T17:40:05.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.557+0000 7fb833fff700 1 --2- 172.21.15.61:0/3778461626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb83414cf50 0x7fb83414d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-01T17:40:05.565 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.557+0000 7fb83972e700 1 --2- 172.21.15.61:0/3778461626 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb834152ec0 0x7fb834150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-01T17:40:05.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.557+0000 7fb838f2d700 1 --2- 172.21.15.61:0/3778461626 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb83406cff0 0x7fb8341e9860 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb82800c780 tx=0x7fb82800cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:05.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.557+0000 7fb8317fa700 1 -- 172.21.15.61:0/3778461626 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb828007560 con 0x7fb83406cff0 2023-01-01T17:40:05.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.557+0000 7fb8317fa700 1 -- 172.21.15.61:0/3778461626 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8280076c0 con 0x7fb83406cff0 2023-01-01T17:40:05.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.557+0000 7fb83b191700 1 -- 172.21.15.61:0/3778461626 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb83406a730 con 0x7fb83406cff0 2023-01-01T17:40:05.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.557+0000 7fb8317fa700 1 -- 172.21.15.61:0/3778461626 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb828004a70 con 0x7fb83406cff0 2023-01-01T17:40:05.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.557+0000 7fb83b191700 1 -- 172.21.15.61:0/3778461626 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb83406a450 con 0x7fb83406cff0 2023-01-01T17:40:05.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.558+0000 7fb83b191700 1 -- 172.21.15.61:0/3778461626 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb834069a70 con 0x7fb83406cff0 2023-01-01T17:40:05.566 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.558+0000 7fb8317fa700 1 -- 172.21.15.61:0/3778461626 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7fb828010070 con 0x7fb83406cff0 2023-01-01T17:40:05.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.559+0000 7fb8317fa700 1 --2- 172.21.15.61:0/3778461626 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fb818063290 0x7fb818065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:05.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.559+0000 7fb8317fa700 1 -- 172.21.15.61:0/3778461626 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb82807efd0 con 0x7fb83406cff0 2023-01-01T17:40:05.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.559+0000 7fb833fff700 1 --2- 172.21.15.61:0/3778461626 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fb818063290 0x7fb818065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:05.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.559+0000 7fb833fff700 1 --2- 172.21.15.61:0/3778461626 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fb818063290 0x7fb818065740 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb8340a84e0 tx=0x7fb820009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:05.567 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.563+0000 7fb8317fa700 1 -- 172.21.15.61:0/3778461626 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7fb82804dd10 con 0x7fb83406cff0 2023-01-01T17:40:05.750 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.750+0000 7fb83b191700 1 -- 172.21.15.61:0/3778461626 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb83414d420 con 0x7fb83406cff0 2023-01-01T17:40:05.750 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.750+0000 7fb8317fa700 1 -- 172.21.15.61:0/3778461626 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb828018020 con 0x7fb83406cff0 2023-01-01T17:40:05.750 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 1 2023-01-01T17:40:05.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.752+0000 7fb83b191700 1 -- 172.21.15.61:0/3778461626 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fb818063290 msgr2=0x7fb818065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:05.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.752+0000 7fb83b191700 1 --2- 172.21.15.61:0/3778461626 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fb818063290 0x7fb818065740 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb8340a84e0 tx=0x7fb820009040 comp rx=0 tx=0).stop 2023-01-01T17:40:05.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.752+0000 7fb83b191700 1 -- 172.21.15.61:0/3778461626 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb83406cff0 msgr2=0x7fb8341e9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:05.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.752+0000 7fb83b191700 1 --2- 172.21.15.61:0/3778461626 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb83406cff0 0x7fb8341e9860 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb82800c780 tx=0x7fb82800cb40 comp rx=0 tx=0).stop 2023-01-01T17:40:05.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.752+0000 7fb83b191700 1 -- 172.21.15.61:0/3778461626 shutdown_connections 2023-01-01T17:40:05.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.752+0000 7fb83b191700 1 --2- 172.21.15.61:0/3778461626 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb834152ec0 0x7fb834150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:05.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.752+0000 7fb83b191700 1 --2- 172.21.15.61:0/3778461626 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fb818063290 0x7fb818065740 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:05.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.752+0000 7fb83b191700 1 --2- 172.21.15.61:0/3778461626 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb83406cff0 0x7fb8341e9860 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:05.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.752+0000 7fb83b191700 1 --2- 172.21.15.61:0/3778461626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb83414cf50 0x7fb83414d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:05.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.752+0000 7fb83b191700 1 -- 172.21.15.61:0/3778461626 >> 172.21.15.61:0/3778461626 conn(0x7fb8340c1e80 msgr2=0x7fb83414a160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:05.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.752+0000 7fb83b191700 1 -- 172.21.15.61:0/3778461626 shutdown_connections 2023-01-01T17:40:05.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.752+0000 7fb83b191700 1 -- 172.21.15.61:0/3778461626 wait complete. 2023-01-01T17:40:05.764 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-01-01T17:40:05.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.893+0000 7f7add4be700 1 Processor -- start 2023-01-01T17:40:05.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.893+0000 7f7add4be700 1 -- start start 2023-01-01T17:40:05.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.894+0000 7f7add4be700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f7ad8150330 0x7f7ad80c5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:05.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.894+0000 7f7add4be700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ad8069890 0x7f7ad80c7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:05.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.894+0000 7f7add4be700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ad8153890 con 0x7f7ad80c5d90 2023-01-01T17:40:05.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.894+0000 7f7add4be700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ad806b860 con 0x7f7ad8150330 2023-01-01T17:40:05.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.894+0000 7f7add4be700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad806a5b0 con 0x7f7ad8069890 2023-01-01T17:40:05.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.894+0000 7f7ad6ffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f7ad8150330 0x7f7ad80c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:05.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.894+0000 7f7ad67fc700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ad8069890 0x7f7ad80c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:05.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.894+0000 7f7ad6ffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f7ad8150330 0x7f7ad80c5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46326/0 (socket says 172.21.15.61:46326) 2023-01-01T17:40:05.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.894+0000 7f7ad6ffd700 1 -- 172.21.15.61:0/878320068 learned_addr learned my addr 172.21.15.61:0/878320068 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:05.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.894+0000 7f7ad6ffd700 1 -- 172.21.15.61:0/878320068 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ad8069890 msgr2=0x7f7ad80c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:05.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.894+0000 7f7ad6ffd700 1 --2- 172.21.15.61:0/878320068 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ad8069890 0x7f7ad80c7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:05.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.894+0000 7f7ad6ffd700 1 -- 172.21.15.61:0/878320068 >> v1:172.21.15.149:6789/0 conn(0x7f7ad80c5d90 legacy=0x7f7ad80c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:05.904 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.894+0000 7f7ad6ffd700 1 -- 172.21.15.61:0/878320068 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad8153dc0 con 0x7f7ad8150330 2023-01-01T17:40:05.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.894+0000 7f7ad5ffb700 1 -- 172.21.15.61:0/878320068 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3497130235 0 0) 0x7f7ad8153890 con 0x7f7ad80c5d90 2023-01-01T17:40:05.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.894+0000 7f7ad67fc700 1 --2- 172.21.15.61:0/878320068 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ad8069890 0x7f7ad80c7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-01-01T17:40:05.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.894+0000 7f7ad6ffd700 1 --2- 172.21.15.61:0/878320068 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7ad8150330 0x7f7ad80c5850 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7acc0098f0 tx=0x7f7acc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e76e1f0dbfbca1ed server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:05.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.895+0000 7f7ad5ffb700 1 -- 172.21.15.61:0/878320068 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc011830 con 0x7f7ad8150330 2023-01-01T17:40:05.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.895+0000 7f7ad5ffb700 1 -- 172.21.15.61:0/878320068 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7acc011990 con 0x7f7ad8150330 2023-01-01T17:40:05.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.895+0000 7f7ad5ffb700 1 -- 172.21.15.61:0/878320068 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc011d20 con 0x7f7ad8150330 2023-01-01T17:40:05.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.895+0000 7f7add4be700 1 -- 172.21.15.61:0/878320068 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7ad8150330 msgr2=0x7f7ad80c5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:05.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.895+0000 7f7add4be700 1 --2- 172.21.15.61:0/878320068 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7ad8150330 0x7f7ad80c5850 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7acc0098f0 tx=0x7f7acc009c00 comp rx=0 tx=0).stop 2023-01-01T17:40:05.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.895+0000 7f7add4be700 1 -- 172.21.15.61:0/878320068 shutdown_connections 2023-01-01T17:40:05.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.895+0000 7f7add4be700 1 --2- 172.21.15.61:0/878320068 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7ad8150330 0x7f7ad80c5850 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:05.905 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.895+0000 7f7add4be700 1 --2- 172.21.15.61:0/878320068 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ad8069890 0x7f7ad80c7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:05.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.895+0000 7f7add4be700 1 -- 172.21.15.61:0/878320068 >> 172.21.15.61:0/878320068 conn(0x7f7ad80c8e40 msgr2=0x7f7ad80c9240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:05.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.895+0000 7f7add4be700 1 -- 172.21.15.61:0/878320068 shutdown_connections 2023-01-01T17:40:05.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.895+0000 7f7add4be700 1 -- 172.21.15.61:0/878320068 wait complete. 2023-01-01T17:40:05.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.896+0000 7f7add4be700 1 Processor -- start 2023-01-01T17:40:05.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.896+0000 7f7add4be700 1 -- start start 2023-01-01T17:40:05.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.897+0000 7f7add4be700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ad8069890 0x7f7ad81ec4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:05.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.897+0000 7f7add4be700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ad80c5d90 0x7f7ad80c21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:05.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.897+0000 7f7add4be700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7ad8150330 0x7f7ad814a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:05.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.897+0000 7f7add4be700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad8151c70 con 0x7f7ad8150330 2023-01-01T17:40:05.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.897+0000 7f7add4be700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad80a8ad0 con 0x7f7ad80c5d90 2023-01-01T17:40:05.906 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.897+0000 7f7add4be700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad80a9090 con 0x7f7ad8069890 2023-01-01T17:40:05.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.897+0000 7f7ad77fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7ad8150330 0x7f7ad814a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:05.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.897+0000 7f7ad77fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7ad8150330 0x7f7ad814a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46336/0 (socket says 172.21.15.61:46336) 2023-01-01T17:40:05.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.897+0000 7f7ad77fe700 1 -- 172.21.15.61:0/3147130288 learned_addr learned my addr 172.21.15.61:0/3147130288 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:05.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.897+0000 7f7ad6ffd700 1 --2- 172.21.15.61:0/3147130288 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ad8069890 0x7f7ad81ec4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:05.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.898+0000 7f7ad67fc700 1 --2- 172.21.15.61:0/3147130288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ad80c5d90 0x7f7ad80c21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:05.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.898+0000 7f7ad77fe700 1 -- 172.21.15.61:0/3147130288 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ad8069890 msgr2=0x7f7ad81ec4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:05.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.898+0000 7f7ad77fe700 1 --2- 172.21.15.61:0/3147130288 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ad8069890 0x7f7ad81ec4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:05.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.898+0000 7f7ad77fe700 1 -- 172.21.15.61:0/3147130288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ad80c5d90 msgr2=0x7f7ad80c21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:05.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.898+0000 7f7ad77fe700 1 --2- 172.21.15.61:0/3147130288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ad80c5d90 0x7f7ad80c21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:05.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.898+0000 7f7ad77fe700 1 -- 172.21.15.61:0/3147130288 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac80094a0 con 0x7f7ad8150330 2023-01-01T17:40:05.907 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.898+0000 7f7ad77fe700 1 --2- 172.21.15.61:0/3147130288 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7ad8150330 0x7f7ad814a0f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0001560 tx=0x7f7ad000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:05.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.898+0000 7f7abf7fe700 1 -- 172.21.15.61:0/3147130288 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0003e30 con 0x7f7ad8150330 2023-01-01T17:40:05.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.898+0000 7f7abf7fe700 1 -- 172.21.15.61:0/3147130288 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad0005070 con 0x7f7ad8150330 2023-01-01T17:40:05.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.898+0000 7f7add4be700 1 -- 172.21.15.61:0/3147130288 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7acc009550 con 0x7f7ad8150330 2023-01-01T17:40:05.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.898+0000 7f7abf7fe700 1 -- 172.21.15.61:0/3147130288 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0005420 con 0x7f7ad8150330 2023-01-01T17:40:05.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.898+0000 7f7add4be700 1 -- 172.21.15.61:0/3147130288 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad8153ae0 con 0x7f7ad8150330 2023-01-01T17:40:05.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.899+0000 7f7add4be700 1 -- 172.21.15.61:0/3147130288 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ad80bc710 con 0x7f7ad8150330 2023-01-01T17:40:05.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.899+0000 7f7abf7fe700 1 -- 172.21.15.61:0/3147130288 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f7ad0019030 con 0x7f7ad8150330 2023-01-01T17:40:05.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.900+0000 7f7abf7fe700 1 --2- 172.21.15.61:0/3147130288 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f7ac4063290 0x7f7ac4065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:05.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.900+0000 7f7abf7fe700 1 -- 172.21.15.61:0/3147130288 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7ad007f3d0 con 0x7f7ad8150330 2023-01-01T17:40:05.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.900+0000 7f7ad6ffd700 1 --2- 172.21.15.61:0/3147130288 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f7ac4063290 0x7f7ac4065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:05.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.900+0000 7f7ad6ffd700 1 --2- 172.21.15.61:0/3147130288 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f7ac4063290 0x7f7ac4065740 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7acc000c00 tx=0x7f7acc008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:05.908 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:05.904+0000 7f7abf7fe700 1 -- 172.21.15.61:0/3147130288 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f7ad004e190 con 0x7f7ad8150330 2023-01-01T17:40:06.095 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.093+0000 7f7add4be700 1 -- 172.21.15.61:0/3147130288 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7ad806b2a0 con 0x7f7ad8150330 2023-01-01T17:40:06.095 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.094+0000 7f7abf7fe700 1 -- 172.21.15.61:0/3147130288 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7ad00517b0 con 0x7f7ad8150330 2023-01-01T17:40:06.096 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 32 2023-01-01T17:40:06.097 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.095+0000 7f7add4be700 1 -- 172.21.15.61:0/3147130288 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f7ac4063290 msgr2=0x7f7ac4065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:06.097 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.095+0000 7f7add4be700 1 --2- 172.21.15.61:0/3147130288 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f7ac4063290 0x7f7ac4065740 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7acc000c00 tx=0x7f7acc008030 comp rx=0 tx=0).stop 2023-01-01T17:40:06.098 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.095+0000 7f7add4be700 1 -- 172.21.15.61:0/3147130288 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7ad8150330 msgr2=0x7f7ad814a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:06.098 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.095+0000 7f7add4be700 1 --2- 172.21.15.61:0/3147130288 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7ad8150330 0x7f7ad814a0f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0001560 tx=0x7f7ad000cc00 comp rx=0 tx=0).stop 2023-01-01T17:40:06.098 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.095+0000 7f7add4be700 1 -- 172.21.15.61:0/3147130288 shutdown_connections 2023-01-01T17:40:06.098 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.095+0000 7f7add4be700 1 --2- 172.21.15.61:0/3147130288 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f7ac4063290 0x7f7ac4065740 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:06.098 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.095+0000 7f7add4be700 1 --2- 172.21.15.61:0/3147130288 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7ad8150330 0x7f7ad814a0f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:06.098 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.095+0000 7f7add4be700 1 --2- 172.21.15.61:0/3147130288 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f7ad8069890 0x7f7ad81ec4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:06.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.095+0000 7f7add4be700 1 --2- 172.21.15.61:0/3147130288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7ad80c5d90 0x7f7ad80c21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:06.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.096+0000 7f7add4be700 1 -- 172.21.15.61:0/3147130288 >> 172.21.15.61:0/3147130288 conn(0x7f7ad80c8e40 msgr2=0x7f7ad8153020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:06.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.096+0000 7f7add4be700 1 -- 172.21.15.61:0/3147130288 shutdown_connections 2023-01-01T17:40:06.099 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.096+0000 7f7add4be700 1 -- 172.21.15.61:0/3147130288 wait complete. 2023-01-01T17:40:06.108 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-01-01T17:40:06.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.243+0000 7f95f149c700 1 Processor -- start 2023-01-01T17:40:06.243 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.243+0000 7f95f149c700 1 -- start start 2023-01-01T17:40:06.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.244+0000 7f95f149c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f95ec150330 0x7f95ec0c5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:06.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.244+0000 7f95f149c700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95ec0c5d90 0x7f95ec0c7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:06.245 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.244+0000 7f95f149c700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95ec153890 con 0x7f95ec069890 2023-01-01T17:40:06.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.244+0000 7f95f149c700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95ec06b860 con 0x7f95ec150330 2023-01-01T17:40:06.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.244+0000 7f95f149c700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec06a5b0 con 0x7f95ec0c5d90 2023-01-01T17:40:06.246 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.244+0000 7f95eaffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f95ec150330 0x7f95ec0c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:06.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.244+0000 7f95eaffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f95ec150330 0x7f95ec0c5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46340/0 (socket says 172.21.15.61:46340) 2023-01-01T17:40:06.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.244+0000 7f95eaffd700 1 -- 172.21.15.61:0/903534807 learned_addr learned my addr 172.21.15.61:0/903534807 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:06.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.244+0000 7f95eb7fe700 1 --2- 172.21.15.61:0/903534807 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95ec0c5d90 0x7f95ec0c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:06.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.244+0000 7f95eaffd700 1 -- 172.21.15.61:0/903534807 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95ec0c5d90 msgr2=0x7f95ec0c7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:06.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.244+0000 7f95eaffd700 1 --2- 172.21.15.61:0/903534807 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95ec0c5d90 0x7f95ec0c7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:06.247 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.244+0000 7f95eaffd700 1 -- 172.21.15.61:0/903534807 >> v1:172.21.15.149:6789/0 conn(0x7f95ec069890 legacy=0x7f95ec0c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:06.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.244+0000 7f95eaffd700 1 -- 172.21.15.61:0/903534807 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ec153dc0 con 0x7f95ec150330 2023-01-01T17:40:06.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.244+0000 7f95eb7fe700 1 --2- 172.21.15.61:0/903534807 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95ec0c5d90 0x7f95ec0c7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-01-01T17:40:06.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.245+0000 7f95eaffd700 1 --2- 172.21.15.61:0/903534807 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f95ec150330 0x7f95ec0c5850 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f95e00098f0 tx=0x7f95e0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6466c8cb1e779ae9 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:06.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.245+0000 7f95e9ffb700 1 -- 172.21.15.61:0/903534807 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e0004230 con 0x7f95ec150330 2023-01-01T17:40:06.248 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.245+0000 7f95e9ffb700 1 -- 172.21.15.61:0/903534807 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e0004390 con 0x7f95ec150330 2023-01-01T17:40:06.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.245+0000 7f95e9ffb700 1 -- 172.21.15.61:0/903534807 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e00036a0 con 0x7f95ec150330 2023-01-01T17:40:06.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.245+0000 7f95f149c700 1 -- 172.21.15.61:0/903534807 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f95ec150330 msgr2=0x7f95ec0c5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:06.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.245+0000 7f95f149c700 1 --2- 172.21.15.61:0/903534807 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f95ec150330 0x7f95ec0c5850 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f95e00098f0 tx=0x7f95e0009c00 comp rx=0 tx=0).stop 2023-01-01T17:40:06.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.245+0000 7f95f149c700 1 -- 172.21.15.61:0/903534807 shutdown_connections 2023-01-01T17:40:06.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.245+0000 7f95f149c700 1 --2- 172.21.15.61:0/903534807 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95ec0c5d90 0x7f95ec0c7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:06.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.245+0000 7f95f149c700 1 --2- 172.21.15.61:0/903534807 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f95ec150330 0x7f95ec0c5850 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:06.249 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.245+0000 7f95f149c700 1 -- 172.21.15.61:0/903534807 >> 172.21.15.61:0/903534807 conn(0x7f95ec0c8e40 msgr2=0x7f95ec0c9240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:06.252 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.245+0000 7f95f149c700 1 -- 172.21.15.61:0/903534807 shutdown_connections 2023-01-01T17:40:06.253 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.245+0000 7f95f149c700 1 -- 172.21.15.61:0/903534807 wait complete. 2023-01-01T17:40:06.255 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.247+0000 7f95f149c700 1 Processor -- start 2023-01-01T17:40:06.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.247+0000 7f95f149c700 1 -- start start 2023-01-01T17:40:06.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.247+0000 7f95f149c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f95ec069890 0x7f95ec0c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:06.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.247+0000 7f95f149c700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95ec0c5d90 0x7f95ec152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:06.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.247+0000 7f95f149c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95ec150330 0x7f95ec1528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:06.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.247+0000 7f95f149c700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec149230 con 0x7f95ec069890 2023-01-01T17:40:06.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.247+0000 7f95f149c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec1ecbc0 con 0x7f95ec150330 2023-01-01T17:40:06.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.247+0000 7f95f149c700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec14ac80 con 0x7f95ec0c5d90 2023-01-01T17:40:06.256 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.248+0000 7f95eaffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f95ec069890 0x7f95ec0c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:06.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.248+0000 7f95eaffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f95ec069890 0x7f95ec0c36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46346/0 (socket says 172.21.15.61:46346) 2023-01-01T17:40:06.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.248+0000 7f95eaffd700 1 -- 172.21.15.61:0/2436949371 learned_addr learned my addr 172.21.15.61:0/2436949371 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:06.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.248+0000 7f95eb7fe700 1 --2- 172.21.15.61:0/2436949371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95ec150330 0x7f95ec1528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:06.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.248+0000 7f95ea7fc700 1 --2- 172.21.15.61:0/2436949371 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95ec0c5d90 0x7f95ec152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:06.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.248+0000 7f95eaffd700 1 -- 172.21.15.61:0/2436949371 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95ec0c5d90 msgr2=0x7f95ec152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:06.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.248+0000 7f95eaffd700 1 --2- 172.21.15.61:0/2436949371 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95ec0c5d90 0x7f95ec152370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:06.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.248+0000 7f95eaffd700 1 -- 172.21.15.61:0/2436949371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95ec150330 msgr2=0x7f95ec1528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:06.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.248+0000 7f95eaffd700 1 --2- 172.21.15.61:0/2436949371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95ec150330 0x7f95ec1528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:06.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.248+0000 7f95eaffd700 1 -- 172.21.15.61:0/2436949371 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e0009550 con 0x7f95ec069890 2023-01-01T17:40:06.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.248+0000 7f95eaffd700 1 --2- 172.21.15.61:0/2436949371 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f95ec069890 0x7f95ec0c36c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f95e0009130 tx=0x7f95e0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:06.257 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.248+0000 7f95d37fe700 1 -- 172.21.15.61:0/2436949371 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e000b660 con 0x7f95ec069890 2023-01-01T17:40:06.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.248+0000 7f95d37fe700 1 -- 172.21.15.61:0/2436949371 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e000b7c0 con 0x7f95ec069890 2023-01-01T17:40:06.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.248+0000 7f95f149c700 1 -- 172.21.15.61:0/2436949371 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95ec153ae0 con 0x7f95ec069890 2023-01-01T17:40:06.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.248+0000 7f95d37fe700 1 -- 172.21.15.61:0/2436949371 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e000bb70 con 0x7f95ec069890 2023-01-01T17:40:06.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.248+0000 7f95f149c700 1 -- 172.21.15.61:0/2436949371 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95ec0bc710 con 0x7f95ec069890 2023-01-01T17:40:06.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.249+0000 7f95f149c700 1 -- 172.21.15.61:0/2436949371 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95ec06b2a0 con 0x7f95ec069890 2023-01-01T17:40:06.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.250+0000 7f95d37fe700 1 -- 172.21.15.61:0/2436949371 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f95e0017020 con 0x7f95ec069890 2023-01-01T17:40:06.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.250+0000 7f95d37fe700 1 --2- 172.21.15.61:0/2436949371 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f95d8063290 0x7f95d8065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:06.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.250+0000 7f95d37fe700 1 -- 172.21.15.61:0/2436949371 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f95e00814d0 con 0x7f95ec069890 2023-01-01T17:40:06.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.250+0000 7f95ea7fc700 1 --2- 172.21.15.61:0/2436949371 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f95d8063290 0x7f95d8065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:06.258 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.250+0000 7f95ea7fc700 1 --2- 172.21.15.61:0/2436949371 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f95d8063290 0x7f95d8065740 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f95ec0ab390 tx=0x7f95dc007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:06.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.254+0000 7f95d37fe700 1 -- 172.21.15.61:0/2436949371 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f95e0050290 con 0x7f95ec069890 2023-01-01T17:40:06.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.444+0000 7f95f149c700 1 -- 172.21.15.61:0/2436949371 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f95ec066190 con 0x7f95ec069890 2023-01-01T17:40:06.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.445+0000 7f95d37fe700 1 -- 172.21.15.61:0/2436949371 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f95e00538b0 con 0x7f95ec069890 2023-01-01T17:40:06.444 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 64 2023-01-01T17:40:06.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.446+0000 7f95f149c700 1 -- 172.21.15.61:0/2436949371 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f95d8063290 msgr2=0x7f95d8065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:06.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.446+0000 7f95f149c700 1 --2- 172.21.15.61:0/2436949371 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f95d8063290 0x7f95d8065740 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f95ec0ab390 tx=0x7f95dc007ec0 comp rx=0 tx=0).stop 2023-01-01T17:40:06.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.446+0000 7f95f149c700 1 -- 172.21.15.61:0/2436949371 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f95ec069890 msgr2=0x7f95ec0c36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:06.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.446+0000 7f95f149c700 1 --2- 172.21.15.61:0/2436949371 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f95ec069890 0x7f95ec0c36c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f95e0009130 tx=0x7f95e0004750 comp rx=0 tx=0).stop 2023-01-01T17:40:06.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.447+0000 7f95f149c700 1 -- 172.21.15.61:0/2436949371 shutdown_connections 2023-01-01T17:40:06.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.447+0000 7f95f149c700 1 --2- 172.21.15.61:0/2436949371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95ec150330 0x7f95ec1528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:06.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.447+0000 7f95f149c700 1 --2- 172.21.15.61:0/2436949371 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f95d8063290 0x7f95d8065740 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:06.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.447+0000 7f95f149c700 1 --2- 172.21.15.61:0/2436949371 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f95ec069890 0x7f95ec0c36c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:06.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.447+0000 7f95f149c700 1 --2- 172.21.15.61:0/2436949371 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f95ec0c5d90 0x7f95ec152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:06.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.447+0000 7f95f149c700 1 -- 172.21.15.61:0/2436949371 >> 172.21.15.61:0/2436949371 conn(0x7f95ec0c8e40 msgr2=0x7f95ec0aa190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:06.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.447+0000 7f95f149c700 1 -- 172.21.15.61:0/2436949371 shutdown_connections 2023-01-01T17:40:06.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.447+0000 7f95f149c700 1 -- 172.21.15.61:0/2436949371 wait complete. 2023-01-01T17:40:06.463 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-01-01T17:40:06.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.591+0000 7ff22fc43700 1 Processor -- start 2023-01-01T17:40:06.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.591+0000 7ff22fc43700 1 -- start start 2023-01-01T17:40:06.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.592+0000 7ff22fc43700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff2280c6e90 0x7ff2280c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:06.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.592+0000 7ff22fc43700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff2280c7260 0x7ff2280c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:06.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.592+0000 7ff22fc43700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff22806df70 0x7ff2281544b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:06.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.592+0000 7ff22fc43700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff22806dae0 con 0x7ff2280c7260 2023-01-01T17:40:06.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.592+0000 7ff22fc43700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2280ba5b0 con 0x7ff2280c6e90 2023-01-01T17:40:06.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.592+0000 7ff22fc43700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff22806e550 con 0x7ff22806df70 2023-01-01T17:40:06.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.592+0000 7ff22d1de700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff2280c7260 0x7ff2280c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:06.594 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.592+0000 7ff22d1de700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff2280c7260 0x7ff2280c5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46356/0 (socket says 172.21.15.61:46356) 2023-01-01T17:40:06.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.592+0000 7ff22d1de700 1 -- 172.21.15.61:0/517899521 learned_addr learned my addr 172.21.15.61:0/517899521 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:06.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.593+0000 7ff22e1e0700 1 --2- 172.21.15.61:0/517899521 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff22806df70 0x7ff2281544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:06.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.593+0000 7ff22d9df700 1 --2- 172.21.15.61:0/517899521 >> v2:172.21.15.149:3300/0 conn(0x7ff2280c6e90 0x7ff2280c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:06.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.593+0000 7ff22d1de700 1 -- 172.21.15.61:0/517899521 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff22806df70 msgr2=0x7ff2281544b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:06.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.593+0000 7ff22d1de700 1 --2- 172.21.15.61:0/517899521 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff22806df70 0x7ff2281544b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:06.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.593+0000 7ff22d1de700 1 -- 172.21.15.61:0/517899521 >> v2:172.21.15.149:3300/0 conn(0x7ff2280c6e90 msgr2=0x7ff2280c55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:06.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.593+0000 7ff22d1de700 1 --2- 172.21.15.61:0/517899521 >> v2:172.21.15.149:3300/0 conn(0x7ff2280c6e90 0x7ff2280c55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:06.595 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.593+0000 7ff22d1de700 1 -- 172.21.15.61:0/517899521 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22806e830 con 0x7ff2280c7260 2023-01-01T17:40:06.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.593+0000 7ff22d1de700 1 --2- 172.21.15.61:0/517899521 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff2280c7260 0x7ff2280c5b20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff228071600 tx=0x7ff224009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=842b6aa2ec204d96 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:06.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.593+0000 7ff22c9dd700 1 -- 172.21.15.61:0/517899521 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22400b870 con 0x7ff2280c7260 2023-01-01T17:40:06.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.593+0000 7ff22c9dd700 1 -- 172.21.15.61:0/517899521 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22400b9d0 con 0x7ff2280c7260 2023-01-01T17:40:06.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.593+0000 7ff22c9dd700 1 -- 172.21.15.61:0/517899521 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22400bd60 con 0x7ff2280c7260 2023-01-01T17:40:06.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.594+0000 7ff22fc43700 1 -- 172.21.15.61:0/517899521 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff2280c7260 msgr2=0x7ff2280c5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:06.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.594+0000 7ff22fc43700 1 --2- 172.21.15.61:0/517899521 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff2280c7260 0x7ff2280c5b20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff228071600 tx=0x7ff224009bd0 comp rx=0 tx=0).stop 2023-01-01T17:40:06.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.594+0000 7ff22fc43700 1 -- 172.21.15.61:0/517899521 shutdown_connections 2023-01-01T17:40:06.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.594+0000 7ff22fc43700 1 --2- 172.21.15.61:0/517899521 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff22806df70 0x7ff2281544b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:06.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.594+0000 7ff22fc43700 1 --2- 172.21.15.61:0/517899521 >> v2:172.21.15.149:3300/0 conn(0x7ff2280c6e90 0x7ff2280c55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:06.596 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.594+0000 7ff22fc43700 1 --2- 172.21.15.61:0/517899521 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff2280c7260 0x7ff2280c5b20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:06.597 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.594+0000 7ff22fc43700 1 -- 172.21.15.61:0/517899521 >> 172.21.15.61:0/517899521 conn(0x7ff228070ad0 msgr2=0x7ff228070ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:06.597 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.594+0000 7ff22fc43700 1 -- 172.21.15.61:0/517899521 shutdown_connections 2023-01-01T17:40:06.597 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.594+0000 7ff22fc43700 1 -- 172.21.15.61:0/517899521 wait complete. 2023-01-01T17:40:06.600 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.595+0000 7ff22fc43700 1 Processor -- start 2023-01-01T17:40:06.600 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.595+0000 7ff22fc43700 1 -- start start 2023-01-01T17:40:06.600 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.596+0000 7ff22fc43700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff22806df70 0x7ff2280bf900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:06.600 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.596+0000 7ff22fc43700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2280c6e90 0x7ff2280ad060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:06.600 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.596+0000 7ff22fc43700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff2280c7260 0x7ff2281e3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:06.600 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.596+0000 7ff22fc43700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2281e7e20 con 0x7ff2280c7260 2023-01-01T17:40:06.600 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.596+0000 7ff22fc43700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2281e8100 con 0x7ff2280c6e90 2023-01-01T17:40:06.601 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.596+0000 7ff22fc43700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2281e83e0 con 0x7ff22806df70 2023-01-01T17:40:06.601 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.596+0000 7ff22e1e0700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff2280c7260 0x7ff2281e3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:06.601 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.596+0000 7ff22e1e0700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff2280c7260 0x7ff2281e3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46364/0 (socket says 172.21.15.61:46364) 2023-01-01T17:40:06.601 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.596+0000 7ff22e1e0700 1 -- 172.21.15.61:0/3975816588 learned_addr learned my addr 172.21.15.61:0/3975816588 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:06.601 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.597+0000 7ff22d1de700 1 --2- 172.21.15.61:0/3975816588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2280c6e90 0x7ff2280ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:06.601 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.597+0000 7ff22d9df700 1 --2- 172.21.15.61:0/3975816588 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff22806df70 0x7ff2280bf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:06.601 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.597+0000 7ff22e1e0700 1 -- 172.21.15.61:0/3975816588 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff22806df70 msgr2=0x7ff2280bf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:06.601 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.597+0000 7ff22e1e0700 1 --2- 172.21.15.61:0/3975816588 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff22806df70 0x7ff2280bf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:06.601 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.597+0000 7ff22e1e0700 1 -- 172.21.15.61:0/3975816588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2280c6e90 msgr2=0x7ff2280ad060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:06.601 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.597+0000 7ff22e1e0700 1 --2- 172.21.15.61:0/3975816588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2280c6e90 0x7ff2280ad060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:06.602 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.597+0000 7ff22e1e0700 1 -- 172.21.15.61:0/3975816588 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff224009550 con 0x7ff2280c7260 2023-01-01T17:40:06.602 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.597+0000 7ff22d1de700 1 --2- 172.21.15.61:0/3975816588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2280c6e90 0x7ff2280ad060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-01T17:40:06.602 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.597+0000 7ff22e1e0700 1 --2- 172.21.15.61:0/3975816588 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff2280c7260 0x7ff2281e3d30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff22000cd20 tx=0x7ff22000a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:06.602 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.597+0000 7ff21e7fc700 1 -- 172.21.15.61:0/3975816588 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff220003a20 con 0x7ff2280c7260 2023-01-01T17:40:06.602 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.597+0000 7ff21e7fc700 1 -- 172.21.15.61:0/3975816588 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff220003b80 con 0x7ff2280c7260 2023-01-01T17:40:06.602 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.597+0000 7ff22fc43700 1 -- 172.21.15.61:0/3975816588 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff22806d770 con 0x7ff2280c7260 2023-01-01T17:40:06.602 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.597+0000 7ff21e7fc700 1 -- 172.21.15.61:0/3975816588 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff220004020 con 0x7ff2280c7260 2023-01-01T17:40:06.602 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.597+0000 7ff22fc43700 1 -- 172.21.15.61:0/3975816588 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff22806eb10 con 0x7ff2280c7260 2023-01-01T17:40:06.602 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.598+0000 7ff22fc43700 1 -- 172.21.15.61:0/3975816588 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff22806d400 con 0x7ff2280c7260 2023-01-01T17:40:06.602 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.598+0000 7ff21e7fc700 1 -- 172.21.15.61:0/3975816588 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7ff22001c020 con 0x7ff2280c7260 2023-01-01T17:40:06.602 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.599+0000 7ff21e7fc700 1 --2- 172.21.15.61:0/3975816588 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7ff20c0632c0 0x7ff20c065770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:06.602 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.599+0000 7ff21e7fc700 1 -- 172.21.15.61:0/3975816588 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff220012070 con 0x7ff2280c7260 2023-01-01T17:40:06.603 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.599+0000 7ff22d9df700 1 --2- 172.21.15.61:0/3975816588 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7ff20c0632c0 0x7ff20c065770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:06.603 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.599+0000 7ff22d9df700 1 --2- 172.21.15.61:0/3975816588 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7ff20c0632c0 0x7ff20c065770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff21800a910 tx=0x7ff218008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:06.603 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.603+0000 7ff21e7fc700 1 -- 172.21.15.61:0/3975816588 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7ff22004f2b0 con 0x7ff2280c7260 2023-01-01T17:40:06.792 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.793+0000 7ff22fc43700 1 -- 172.21.15.61:0/3975816588 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff2280668a0 con 0x7ff2280c7260 2023-01-01T17:40:06.792 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.793+0000 7ff21e7fc700 1 -- 172.21.15.61:0/3975816588 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff2200528d0 con 0x7ff2280c7260 2023-01-01T17:40:06.793 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 32 2023-01-01T17:40:06.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.795+0000 7ff22fc43700 1 -- 172.21.15.61:0/3975816588 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7ff20c0632c0 msgr2=0x7ff20c065770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:06.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.795+0000 7ff22fc43700 1 --2- 172.21.15.61:0/3975816588 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7ff20c0632c0 0x7ff20c065770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff21800a910 tx=0x7ff218008040 comp rx=0 tx=0).stop 2023-01-01T17:40:06.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.795+0000 7ff22fc43700 1 -- 172.21.15.61:0/3975816588 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff2280c7260 msgr2=0x7ff2281e3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:06.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.795+0000 7ff22fc43700 1 --2- 172.21.15.61:0/3975816588 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff2280c7260 0x7ff2281e3d30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff22000cd20 tx=0x7ff22000a570 comp rx=0 tx=0).stop 2023-01-01T17:40:06.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.795+0000 7ff22fc43700 1 -- 172.21.15.61:0/3975816588 shutdown_connections 2023-01-01T17:40:06.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.795+0000 7ff22fc43700 1 --2- 172.21.15.61:0/3975816588 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7ff20c0632c0 0x7ff20c065770 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:06.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.795+0000 7ff22fc43700 1 --2- 172.21.15.61:0/3975816588 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff2280c7260 0x7ff2281e3d30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:06.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.795+0000 7ff22fc43700 1 --2- 172.21.15.61:0/3975816588 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff22806df70 0x7ff2280bf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:06.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.795+0000 7ff22fc43700 1 --2- 172.21.15.61:0/3975816588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff2280c6e90 0x7ff2280ad060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:06.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.795+0000 7ff22fc43700 1 -- 172.21.15.61:0/3975816588 >> 172.21.15.61:0/3975816588 conn(0x7ff228070ad0 msgr2=0x7ff2280a9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:06.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.795+0000 7ff22fc43700 1 -- 172.21.15.61:0/3975816588 shutdown_connections 2023-01-01T17:40:06.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.795+0000 7ff22fc43700 1 -- 172.21.15.61:0/3975816588 wait complete. 2023-01-01T17:40:06.807 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-01-01T17:40:06.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.932+0000 7f3f1e5d0700 1 Processor -- start 2023-01-01T17:40:06.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.932+0000 7f3f1e5d0700 1 -- start start 2023-01-01T17:40:06.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.933+0000 7f3f1e5d0700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3f18071440 0x7f3f181515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:06.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.933+0000 7f3f1e5d0700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3f180c15c0 0x7f3f1806a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:06.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.933+0000 7f3f1e5d0700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f18147ab0 con 0x7f3f1806a8b0 2023-01-01T17:40:06.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.933+0000 7f3f1e5d0700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f18151b90 con 0x7f3f180c15c0 2023-01-01T17:40:06.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.933+0000 7f3f1e5d0700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f18155080 con 0x7f3f18071440 2023-01-01T17:40:06.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.933+0000 7f3f177fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3f180c15c0 0x7f3f1806a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:06.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.933+0000 7f3f177fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3f180c15c0 0x7f3f1806a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46368/0 (socket says 172.21.15.61:46368) 2023-01-01T17:40:06.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.933+0000 7f3f177fe700 1 -- 172.21.15.61:0/1618492181 learned_addr learned my addr 172.21.15.61:0/1618492181 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:06.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.934+0000 7f3f17fff700 1 --2- 172.21.15.61:0/1618492181 >> v2:172.21.15.149:3300/0 conn(0x7f3f18071440 0x7f3f181515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:06.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.934+0000 7f3f177fe700 1 -- 172.21.15.61:0/1618492181 >> v2:172.21.15.149:3300/0 conn(0x7f3f18071440 msgr2=0x7f3f181515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:06.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.934+0000 7f3f177fe700 1 --2- 172.21.15.61:0/1618492181 >> v2:172.21.15.149:3300/0 conn(0x7f3f18071440 0x7f3f181515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:06.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.934+0000 7f3f177fe700 1 -- 172.21.15.61:0/1618492181 >> v1:172.21.15.149:6789/0 conn(0x7f3f1806a8b0 legacy=0x7f3f1806c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:06.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.934+0000 7f3f177fe700 1 -- 172.21.15.61:0/1618492181 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f181542c0 con 0x7f3f180c15c0 2023-01-01T17:40:06.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.934+0000 7f3f177fe700 1 --2- 172.21.15.61:0/1618492181 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f180c15c0 0x7f3f1806a370 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3f180c2d60 tx=0x7f3f08009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b96481c68578e23c server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:06.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.934+0000 7f3f16ffd700 1 -- 172.21.15.61:0/1618492181 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0800b870 con 0x7f3f180c15c0 2023-01-01T17:40:06.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.934+0000 7f3f16ffd700 1 -- 172.21.15.61:0/1618492181 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0800b9d0 con 0x7f3f180c15c0 2023-01-01T17:40:06.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.934+0000 7f3f16ffd700 1 -- 172.21.15.61:0/1618492181 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0800bd60 con 0x7f3f180c15c0 2023-01-01T17:40:06.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.934+0000 7f3f1e5d0700 1 -- 172.21.15.61:0/1618492181 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f180c15c0 msgr2=0x7f3f1806a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:06.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.934+0000 7f3f1e5d0700 1 --2- 172.21.15.61:0/1618492181 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f180c15c0 0x7f3f1806a370 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3f180c2d60 tx=0x7f3f08009bd0 comp rx=0 tx=0).stop 2023-01-01T17:40:06.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.935+0000 7f3f1e5d0700 1 -- 172.21.15.61:0/1618492181 shutdown_connections 2023-01-01T17:40:06.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.935+0000 7f3f1e5d0700 1 --2- 172.21.15.61:0/1618492181 >> v2:172.21.15.149:3300/0 conn(0x7f3f18071440 0x7f3f181515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:06.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.935+0000 7f3f1e5d0700 1 --2- 172.21.15.61:0/1618492181 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f180c15c0 0x7f3f1806a370 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:06.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.935+0000 7f3f1e5d0700 1 -- 172.21.15.61:0/1618492181 >> 172.21.15.61:0/1618492181 conn(0x7f3f180c1f30 msgr2=0x7f3f180c2330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:06.936 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.935+0000 7f3f1e5d0700 1 -- 172.21.15.61:0/1618492181 shutdown_connections 2023-01-01T17:40:06.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.935+0000 7f3f1e5d0700 1 -- 172.21.15.61:0/1618492181 wait complete. 2023-01-01T17:40:06.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.936+0000 7f3f1e5d0700 1 Processor -- start 2023-01-01T17:40:06.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.936+0000 7f3f1e5d0700 1 -- start start 2023-01-01T17:40:06.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.937+0000 7f3f1e5d0700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f1806a8b0 0x7f3f18144cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:06.939 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.937+0000 7f3f1e5d0700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f18071440 0x7f3f180a98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:06.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.937+0000 7f3f1e5d0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f180c15c0 0x7f3f1814b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:06.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.937+0000 7f3f1e5d0700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1814d320 con 0x7f3f1806a8b0 2023-01-01T17:40:06.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.937+0000 7f3f1e5d0700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f180ab1e0 con 0x7f3f180c15c0 2023-01-01T17:40:06.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.937+0000 7f3f1e5d0700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f180a8dd0 con 0x7f3f18071440 2023-01-01T17:40:06.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.937+0000 7f3f17fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f1806a8b0 0x7f3f18144cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:06.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.937+0000 7f3f17fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f1806a8b0 0x7f3f18144cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46372/0 (socket says 172.21.15.61:46372) 2023-01-01T17:40:06.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.937+0000 7f3f17fff700 1 -- 172.21.15.61:0/3447591256 learned_addr learned my addr 172.21.15.61:0/3447591256 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:06.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.937+0000 7f3f1cb6d700 1 --2- 172.21.15.61:0/3447591256 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f180c15c0 0x7f3f1814b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:06.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.937+0000 7f3f177fe700 1 --2- 172.21.15.61:0/3447591256 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f18071440 0x7f3f180a98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:06.940 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.937+0000 7f3f17fff700 1 -- 172.21.15.61:0/3447591256 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f18071440 msgr2=0x7f3f180a98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:06.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.937+0000 7f3f17fff700 1 --2- 172.21.15.61:0/3447591256 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f18071440 0x7f3f180a98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:06.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.937+0000 7f3f17fff700 1 -- 172.21.15.61:0/3447591256 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f180c15c0 msgr2=0x7f3f1814b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:06.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.937+0000 7f3f17fff700 1 --2- 172.21.15.61:0/3447591256 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f180c15c0 0x7f3f1814b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:06.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.937+0000 7f3f17fff700 1 -- 172.21.15.61:0/3447591256 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f08009550 con 0x7f3f1806a8b0 2023-01-01T17:40:06.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.937+0000 7f3f17fff700 1 --2- 172.21.15.61:0/3447591256 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f1806a8b0 0x7f3f18144cb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3f0000e810 tx=0x7f3f0000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:06.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.937+0000 7f3f14ff9700 1 -- 172.21.15.61:0/3447591256 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f00013610 con 0x7f3f1806a8b0 2023-01-01T17:40:06.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.937+0000 7f3f14ff9700 1 -- 172.21.15.61:0/3447591256 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f00013770 con 0x7f3f1806a8b0 2023-01-01T17:40:06.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.937+0000 7f3f1e5d0700 1 -- 172.21.15.61:0/3447591256 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f18154880 con 0x7f3f1806a8b0 2023-01-01T17:40:06.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.937+0000 7f3f14ff9700 1 -- 172.21.15.61:0/3447591256 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f00013b20 con 0x7f3f1806a8b0 2023-01-01T17:40:06.941 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.937+0000 7f3f1e5d0700 1 -- 172.21.15.61:0/3447591256 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f181545a0 con 0x7f3f1806a8b0 2023-01-01T17:40:06.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.938+0000 7f3f1e5d0700 1 -- 172.21.15.61:0/3447591256 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f18154b60 con 0x7f3f1806a8b0 2023-01-01T17:40:06.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.939+0000 7f3f14ff9700 1 -- 172.21.15.61:0/3447591256 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f3f00023070 con 0x7f3f1806a8b0 2023-01-01T17:40:06.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.939+0000 7f3f14ff9700 1 --2- 172.21.15.61:0/3447591256 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3ef8063290 0x7f3ef8065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:06.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.939+0000 7f3f14ff9700 1 -- 172.21.15.61:0/3447591256 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3f0007fa60 con 0x7f3f1806a8b0 2023-01-01T17:40:06.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.939+0000 7f3f177fe700 1 --2- 172.21.15.61:0/3447591256 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3ef8063290 0x7f3ef8065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:06.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.940+0000 7f3f177fe700 1 --2- 172.21.15.61:0/3447591256 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3ef8063290 0x7f3ef8065740 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3f08014040 tx=0x7f3f08008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:06.942 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:06.943+0000 7f3f14ff9700 1 -- 172.21.15.61:0/3447591256 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f3f0004e7a0 con 0x7f3f1806a8b0 2023-01-01T17:40:07.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.149+0000 7f3f1e5d0700 1 -- 172.21.15.61:0/3447591256 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3f180a91c0 con 0x7f3f1806a8b0 2023-01-01T17:40:07.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.150+0000 7f3f14ff9700 1 -- 172.21.15.61:0/3447591256 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3f00051dc0 con 0x7f3f1806a8b0 2023-01-01T17:40:07.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.151+0000 7f3f1e5d0700 1 -- 172.21.15.61:0/3447591256 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3ef8063290 msgr2=0x7f3ef8065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:07.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.151+0000 7f3f1e5d0700 1 --2- 172.21.15.61:0/3447591256 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3ef8063290 0x7f3ef8065740 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3f08014040 tx=0x7f3f08008030 comp rx=0 tx=0).stop 2023-01-01T17:40:07.152 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.151+0000 7f3f1e5d0700 1 -- 172.21.15.61:0/3447591256 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f1806a8b0 msgr2=0x7f3f18144cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:07.152 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.151+0000 7f3f1e5d0700 1 --2- 172.21.15.61:0/3447591256 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f1806a8b0 0x7f3f18144cb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3f0000e810 tx=0x7f3f0000ebd0 comp rx=0 tx=0).stop 2023-01-01T17:40:07.152 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.152+0000 7f3f1e5d0700 1 -- 172.21.15.61:0/3447591256 shutdown_connections 2023-01-01T17:40:07.152 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.152+0000 7f3f1e5d0700 1 --2- 172.21.15.61:0/3447591256 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f180c15c0 0x7f3f1814b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:07.152 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.152+0000 7f3f1e5d0700 1 --2- 172.21.15.61:0/3447591256 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3ef8063290 0x7f3ef8065740 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:07.152 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.152+0000 7f3f1e5d0700 1 --2- 172.21.15.61:0/3447591256 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3f1806a8b0 0x7f3f18144cb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:07.152 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.152+0000 7f3f1e5d0700 1 --2- 172.21.15.61:0/3447591256 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3f18071440 0x7f3f180a98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:07.152 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.152+0000 7f3f1e5d0700 1 -- 172.21.15.61:0/3447591256 >> 172.21.15.61:0/3447591256 conn(0x7f3f180c1f30 msgr2=0x7f3f1814ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:07.152 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.152+0000 7f3f1e5d0700 1 -- 172.21.15.61:0/3447591256 shutdown_connections 2023-01-01T17:40:07.152 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.152+0000 7f3f1e5d0700 1 -- 172.21.15.61:0/3447591256 wait complete. 2023-01-01T17:40:07.153 INFO:teuthology.orchestra.run.smithi061.stderr:listed 0 entries 2023-01-01T17:40:07.163 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi061.front.sepia.ceph.com... 2023-01-01T17:40:07.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:07.163 DEBUG:teuthology.orchestra.run.smithi061:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-01-01T17:40:07.193 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi061.stderr:ceph-fuse[100368]: fuse finished with error 0 and tester_r 0 2023-01-01T17:40:07.195 INFO:teuthology.orchestra.run:waiting for 300 2023-01-01T17:40:07.212 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi061.front.sepia.ceph.com 2023-01-01T17:40:07.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:07.213 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-01-01T17:40:07.274 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-01T17:40:07.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.439+0000 7f8fa27f3700 1 Processor -- start 2023-01-01T17:40:07.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.439+0000 7f8fa27f3700 1 -- start start 2023-01-01T17:40:07.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.440+0000 7f8fa27f3700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f9c06b030 0x7f8f9c0c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:07.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.440+0000 7f8fa27f3700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f9c0c9530 con 0x7f8f9c156490 2023-01-01T17:40:07.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.440+0000 7f8fa27f3700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f9c1530d0 con 0x7f8f9c153bb0 2023-01-01T17:40:07.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.440+0000 7f8fa27f3700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c0c9810 con 0x7f8f9c06b030 2023-01-01T17:40:07.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.440+0000 7f8fa0d90700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f8f9c156490 0x7f8f9c150230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40232/0 (socket says 172.21.15.61:40232) 2023-01-01T17:40:07.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.440+0000 7f8fa0d90700 1 -- 172.21.15.61:0/3309347865 learned_addr learned my addr 172.21.15.61:0/3309347865 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:40:07.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.440+0000 7f8f9bfff700 1 --2- 172.21.15.61:0/3309347865 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f9c06b030 0x7f8f9c0c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:07.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.440+0000 7f8f9affd700 1 -- 172.21.15.61:0/3309347865 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3737856926 0 0) 0x7f8f9c0c9530 con 0x7f8f9c156490 2023-01-01T17:40:07.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.440+0000 7f8f9affd700 1 -- 172.21.15.61:0/3309347865 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f840035b0 con 0x7f8f9c156490 2023-01-01T17:40:07.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.440+0000 7f8f9affd700 1 -- 172.21.15.61:0/3309347865 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1191196824 0 0) 0x7f8f9c1530d0 con 0x7f8f9c153bb0 2023-01-01T17:40:07.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.440+0000 7f8f9affd700 1 -- 172.21.15.61:0/3309347865 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f9c0c9530 con 0x7f8f9c153bb0 2023-01-01T17:40:07.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.440+0000 7f8f9affd700 1 -- 172.21.15.61:0/3309347865 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1069719135 0 0) 0x7f8f840035b0 con 0x7f8f9c156490 2023-01-01T17:40:07.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.440+0000 7f8f9affd700 1 -- 172.21.15.61:0/3309347865 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f9c06b030 msgr2=0x7f8f9c0c4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:07.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.440+0000 7f8f9affd700 1 --2- 172.21.15.61:0/3309347865 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f9c06b030 0x7f8f9c0c4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:07.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.440+0000 7f8f9affd700 1 -- 172.21.15.61:0/3309347865 >> v1:172.21.15.149:6789/0 conn(0x7f8f9c153bb0 legacy=0x7f8f9c06b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:07.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.440+0000 7f8f9affd700 1 -- 172.21.15.61:0/3309347865 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f9c1533b0 con 0x7f8f9c156490 2023-01-01T17:40:07.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.440+0000 7f8f9affd700 1 -- 172.21.15.61:0/3309347865 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586489653 0 0) 0x7f8f940019f0 con 0x7f8f9c156490 2023-01-01T17:40:07.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.440+0000 7f8f9affd700 1 -- 172.21.15.61:0/3309347865 >> v1:172.21.15.61:6789/0 conn(0x7f8f9c156490 legacy=0x7f8f9c150230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:07.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.440+0000 7f8f9affd700 1 --2- 172.21.15.61:0/3309347865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f84003bc0 0x7f8f84003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:07.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.440+0000 7f8f9affd700 1 --2- 172.21.15.61:0/3309347865 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f84004850 0x7f8f84004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:07.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.440+0000 7f8f9affd700 1 --2- 172.21.15.61:0/3309347865 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f9c06b030 0x7f8f84005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:07.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.440+0000 7f8f9affd700 1 -- 172.21.15.61:0/3309347865 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c0c9810 con 0x7f8f84004850 2023-01-01T17:40:07.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.440+0000 7f8f9affd700 1 -- 172.21.15.61:0/3309347865 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8400bac0 con 0x7f8f84003bc0 2023-01-01T17:40:07.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.440+0000 7f8f9affd700 1 -- 172.21.15.61:0/3309347865 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8400bc30 con 0x7f8f9c06b030 2023-01-01T17:40:07.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.441+0000 7f8f9b7fe700 1 --2- 172.21.15.61:0/3309347865 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f84004850 0x7f8f84004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:07.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.441+0000 7f8fa0d90700 1 --2- 172.21.15.61:0/3309347865 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f9c06b030 0x7f8f84005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:07.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.441+0000 7f8f9bfff700 1 --2- 172.21.15.61:0/3309347865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f84003bc0 0x7f8f84003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:07.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.441+0000 7f8f9b7fe700 1 -- 172.21.15.61:0/3309347865 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f9c06b030 msgr2=0x7f8f84005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:07.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.441+0000 7f8f9b7fe700 1 --2- 172.21.15.61:0/3309347865 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f9c06b030 0x7f8f84005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:07.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.441+0000 7f8f9b7fe700 1 -- 172.21.15.61:0/3309347865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f84003bc0 msgr2=0x7f8f84003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:07.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.441+0000 7f8f9b7fe700 1 --2- 172.21.15.61:0/3309347865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f84003bc0 0x7f8f84003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:07.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.441+0000 7f8f9b7fe700 1 -- 172.21.15.61:0/3309347865 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f840035b0 con 0x7f8f84004850 2023-01-01T17:40:07.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.441+0000 7f8f9b7fe700 1 --2- 172.21.15.61:0/3309347865 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f84004850 0x7f8f84004cc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8f90001940 tx=0x7f8f84005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5a62df6eb916581 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:07.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.441+0000 7f8f9affd700 1 -- 172.21.15.61:0/3309347865 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f90001430 con 0x7f8f84004850 2023-01-01T17:40:07.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.441+0000 7f8f9affd700 1 -- 172.21.15.61:0/3309347865 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f90001d70 con 0x7f8f84004850 2023-01-01T17:40:07.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.441+0000 7f8f9affd700 1 -- 172.21.15.61:0/3309347865 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f90005510 con 0x7f8f84004850 2023-01-01T17:40:07.446 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.442+0000 7f8fa27f3700 1 -- 172.21.15.61:0/3309347865 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f84004850 msgr2=0x7f8f84004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:07.446 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.442+0000 7f8fa27f3700 1 --2- 172.21.15.61:0/3309347865 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f84004850 0x7f8f84004cc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8f90001940 tx=0x7f8f84005880 comp rx=0 tx=0).stop 2023-01-01T17:40:07.446 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.442+0000 7f8fa0d90700 1 -- 172.21.15.61:0/3309347865 reap_dead start 2023-01-01T17:40:07.446 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.442+0000 7f8fa27f3700 1 -- 172.21.15.61:0/3309347865 shutdown_connections 2023-01-01T17:40:07.446 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.442+0000 7f8fa27f3700 1 -- 172.21.15.61:0/3309347865 >> 172.21.15.61:0/3309347865 conn(0x7f8f9c070a90 msgr2=0x7f8f9c070e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:07.446 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.442+0000 7f8fa27f3700 1 -- 172.21.15.61:0/3309347865 shutdown_connections 2023-01-01T17:40:07.446 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.442+0000 7f8fa27f3700 1 -- 172.21.15.61:0/3309347865 wait complete. 2023-01-01T17:40:07.446 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.443+0000 7f8fa27f3700 1 Processor -- start 2023-01-01T17:40:07.446 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.443+0000 7f8fa27f3700 1 -- start start 2023-01-01T17:40:07.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.444+0000 7f8fa27f3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f84004850 0x7f8f9c0c7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:07.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.444+0000 7f8fa27f3700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f9c154900 0x7f8f9c154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:07.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.444+0000 7f8fa27f3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f9c1552b0 0x7f8f9c151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:07.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.444+0000 7f8fa27f3700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c0a9d20 con 0x7f8f9c1552b0 2023-01-01T17:40:07.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.444+0000 7f8fa27f3700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c0ac280 con 0x7f8f84004850 2023-01-01T17:40:07.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.444+0000 7f8fa27f3700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c0a9760 con 0x7f8f9c154900 2023-01-01T17:40:07.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.444+0000 7f8fa0d90700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f9c1552b0 0x7f8f9c151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:07.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.444+0000 7f8fa0d90700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f9c1552b0 0x7f8f9c151d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46394/0 (socket says 172.21.15.61:46394) 2023-01-01T17:40:07.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.444+0000 7f8fa0d90700 1 -- 172.21.15.61:0/1501273978 learned_addr learned my addr 172.21.15.61:0/1501273978 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:07.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.444+0000 7f8f9bfff700 1 --2- 172.21.15.61:0/1501273978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f84004850 0x7f8f9c0c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:07.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.444+0000 7f8f9b7fe700 1 --2- 172.21.15.61:0/1501273978 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f9c154900 0x7f8f9c154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:07.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.444+0000 7f8fa0d90700 1 -- 172.21.15.61:0/1501273978 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f9c154900 msgr2=0x7f8f9c154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:07.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.444+0000 7f8fa0d90700 1 --2- 172.21.15.61:0/1501273978 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f9c154900 0x7f8f9c154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:07.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.444+0000 7f8fa0d90700 1 -- 172.21.15.61:0/1501273978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f84004850 msgr2=0x7f8f9c0c7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:07.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.444+0000 7f8fa0d90700 1 --2- 172.21.15.61:0/1501273978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f84004850 0x7f8f9c0c7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:07.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.444+0000 7f8fa0d90700 1 -- 172.21.15.61:0/1501273978 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f9c0c9200 con 0x7f8f9c1552b0 2023-01-01T17:40:07.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.444+0000 7f8fa0d90700 1 --2- 172.21.15.61:0/1501273978 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f9c1552b0 0x7f8f9c151d60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c156860 tx=0x7f8f9400a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:07.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.444+0000 7f8f98ff9700 1 -- 172.21.15.61:0/1501273978 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9400ad30 con 0x7f8f9c1552b0 2023-01-01T17:40:07.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.444+0000 7f8f98ff9700 1 -- 172.21.15.61:0/1501273978 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9400ae90 con 0x7f8f9c1552b0 2023-01-01T17:40:07.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.444+0000 7f8fa27f3700 1 -- 172.21.15.61:0/1501273978 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f9c153690 con 0x7f8f9c1552b0 2023-01-01T17:40:07.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.445+0000 7f8f98ff9700 1 -- 172.21.15.61:0/1501273978 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f94013630 con 0x7f8f9c1552b0 2023-01-01T17:40:07.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.445+0000 7f8fa27f3700 1 -- 172.21.15.61:0/1501273978 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f9c0c3a50 con 0x7f8f9c1552b0 2023-01-01T17:40:07.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.445+0000 7f8fa27f3700 1 -- 172.21.15.61:0/1501273978 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f9c0aef50 con 0x7f8f9c1552b0 2023-01-01T17:40:07.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.446+0000 7f8f98ff9700 1 -- 172.21.15.61:0/1501273978 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f8f94023070 con 0x7f8f9c1552b0 2023-01-01T17:40:07.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.446+0000 7f8f98ff9700 1 --2- 172.21.15.61:0/1501273978 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f8f88063290 0x7f8f88065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:07.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.446+0000 7f8f98ff9700 1 -- 172.21.15.61:0/1501273978 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8f94080770 con 0x7f8f9c1552b0 2023-01-01T17:40:07.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.446+0000 7f8f9bfff700 1 --2- 172.21.15.61:0/1501273978 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f8f88063290 0x7f8f88065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:07.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.447+0000 7f8f9bfff700 1 --2- 172.21.15.61:0/1501273978 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f8f88063290 0x7f8f88065740 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c0a8b60 tx=0x7f8f8c009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:07.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.451+0000 7f8f98ff9700 1 -- 172.21.15.61:0/1501273978 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f8f9404f530 con 0x7f8f9c1552b0 2023-01-01T17:40:07.643 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.644+0000 7f8fa27f3700 1 -- 172.21.15.61:0/1501273978 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f9c1538d0 con 0x7f8f9c1552b0 2023-01-01T17:40:07.644 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.645+0000 7f8f98ff9700 1 -- 172.21.15.61:0/1501273978 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18729 (secure 0 0 0) 0x7f8f94017070 con 0x7f8f9c1552b0 2023-01-01T17:40:07.645 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:40:07.645 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":24,"fsid":"fe0d3d8e-46ee-4ed9-92f8-749741721d01","created":"2023-01-01T17:39:34.752404+0000","modified":"2023-01-01T17:39:57.386830+0000","last_up_change":"2023-01-01T17:39:45.159720+0000","last_in_change":"2023-01-01T17:39:37.293057+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-01-01T17:39:46.110776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-01-01T17:39:46.276625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-01-01T17:39:50.568073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-01-01T17:39:51.915351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-01-01T17:39:54.992107+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5ba13bcd-4407-4cfd-8487-80917501e525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":94349},{"type":"v1","addr":"172.21.15.61:6825","nonce":94349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":94349},{"type":"v1","addr":"172.21.15.61:6827","nonce":94349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":94349},{"type":"v1","addr":"172.21.15.61:6831","nonce":94349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":94349},{"type":"v1","addr":"172.21.15.61:6829","nonce":94349}]},"public_addr":"172.21.15.61:6825/94349","cluster_addr":"172.21.15.61:6827/94349","heartbeat_back_addr":"172.21.15.61:6831/94349","heartbeat_front_addr":"172.21.15.61:6829/94349","state":["exists","up"]},{"osd":1,"uuid":"7dca9f34-ea22-4894-b238-5606b16b9c74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6811","nonce":94348},{"type":"v1","addr":"172.21.15.61:6813","nonce":94348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":94348},{"type":"v1","addr":"172.21.15.61:6816","nonce":94348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6821","nonce":94348},{"type":"v1","addr":"172.21.15.61:6823","nonce":94348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":94348},{"type":"v1","addr":"172.21.15.61:6819","nonce":94348}]},"public_addr":"172.21.15.61:6813/94348","cluster_addr":"172.21.15.61:6816/94348","heartbeat_back_addr":"172.21.15.61:6823/94348","heartbeat_front_addr":"172.21.15.61:6819/94348","state":["exists","up"]},{"osd":2,"uuid":"7b43ea06-a7b6-49f4-a390-18ad14dfe4fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":94350},{"type":"v1","addr":"172.21.15.61:6809","nonce":94350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":94350},{"type":"v1","addr":"172.21.15.61:6812","nonce":94350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":94350},{"type":"v1","addr":"172.21.15.61:6822","nonce":94350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6815","nonce":94350},{"type":"v1","addr":"172.21.15.61:6817","nonce":94350}]},"public_addr":"172.21.15.61:6809/94350","cluster_addr":"172.21.15.61:6812/94350","heartbeat_back_addr":"172.21.15.61:6822/94350","heartbeat_front_addr":"172.21.15.61:6817/94350","state":["exists","up"]},{"osd":3,"uuid":"117c41d8-d40c-4cc0-b0e1-70bca058fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":94347},{"type":"v1","addr":"172.21.15.61:6801","nonce":94347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":94347},{"type":"v1","addr":"172.21.15.61:6803","nonce":94347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":94347},{"type":"v1","addr":"172.21.15.61:6807","nonce":94347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":94347},{"type":"v1","addr":"172.21.15.61:6805","nonce":94347}]},"public_addr":"172.21.15.61:6801/94347","cluster_addr":"172.21.15.61:6803/94347","heartbeat_back_addr":"172.21.15.61:6807/94347","heartbeat_front_addr":"172.21.15.61:6805/94347","state":["exists","up"]},{"osd":4,"uuid":"4073e0e8-c5dd-463f-aa1c-c9515ef09976","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":94711},{"type":"v1","addr":"172.21.15.149:6818","nonce":94711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":94711},{"type":"v1","addr":"172.21.15.149:6822","nonce":94711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":94711},{"type":"v1","addr":"172.21.15.149:6830","nonce":94711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":94711},{"type":"v1","addr":"172.21.15.149:6826","nonce":94711}]},"public_addr":"172.21.15.149:6818/94711","cluster_addr":"172.21.15.149:6822/94711","heartbeat_back_addr":"172.21.15.149:6830/94711","heartbeat_front_addr":"172.21.15.149:6826/94711","state":["exists","up"]},{"osd":5,"uuid":"88aa0c0f-e3c1-4dd3-af8c-61f4bc28504e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":94709},{"type":"v1","addr":"172.21.15.149:6809","nonce":94709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":94709},{"type":"v1","addr":"172.21.15.149:6811","nonce":94709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":94709},{"type":"v1","addr":"172.21.15.149:6815","nonce":94709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":94709},{"type":"v1","addr":"172.21.15.149:6813","nonce":94709}]},"public_addr":"172.21.15.149:6809/94709","cluster_addr":"172.21.15.149:6811/94709","heartbeat_back_addr":"172.21.15.149:6815/94709","heartbeat_front_addr":"172.21.15.149:6813/94709","state":["exists","up"]},{"osd":6,"uuid":"8b13fc0c-5f00-41c7-8923-c4570da77afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":94710},{"type":"v1","addr":"172.21.15.149:6801","nonce":94710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":94710},{"type":"v1","addr":"172.21.15.149:6803","nonce":94710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":94710},{"type":"v1","addr":"172.21.15.149:6807","nonce":94710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":94710},{"type":"v1","addr":"172.21.15.149:6805","nonce":94710}]},"public_addr":"172.21.15.149:6801/94710","cluster_addr":"172.21.15.149:6803/94710","heartbeat_back_addr":"172.21.15.149:6807/94710","heartbeat_front_addr":"172.21.15.149:6805/94710","state":["exists","up"]},{"osd":7,"uuid":"5390c6e5-39e7-4aa6-b73c-642458b2acf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":94734},{"type":"v1","addr":"172.21.15.149:6819","nonce":94734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":94734},{"type":"v1","addr":"172.21.15.149:6823","nonce":94734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":94734},{"type":"v1","addr":"172.21.15.149:6831","nonce":94734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":94734},{"type":"v1","addr":"172.21.15.149:6827","nonce":94734}]},"public_addr":"172.21.15.149:6819/94734","cluster_addr":"172.21.15.149:6823/94734","heartbeat_back_addr":"172.21.15.149:6831/94734","heartbeat_front_addr":"172.21.15.149:6827/94734","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.555826+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.508739+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.515601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.472067+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.535257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.493397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.554910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.552343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-01T17:40:07.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.647+0000 7f8fa27f3700 1 -- 172.21.15.61:0/1501273978 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f8f88063290 msgr2=0x7f8f88065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:07.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.647+0000 7f8fa27f3700 1 --2- 172.21.15.61:0/1501273978 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f8f88063290 0x7f8f88065740 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c0a8b60 tx=0x7f8f8c009210 comp rx=0 tx=0).stop 2023-01-01T17:40:07.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.647+0000 7f8fa27f3700 1 -- 172.21.15.61:0/1501273978 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f9c1552b0 msgr2=0x7f8f9c151d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:07.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.647+0000 7f8fa27f3700 1 --2- 172.21.15.61:0/1501273978 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f9c1552b0 0x7f8f9c151d60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c156860 tx=0x7f8f9400a5b0 comp rx=0 tx=0).stop 2023-01-01T17:40:07.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.647+0000 7f8fa27f3700 1 -- 172.21.15.61:0/1501273978 shutdown_connections 2023-01-01T17:40:07.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.647+0000 7f8fa27f3700 1 --2- 172.21.15.61:0/1501273978 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f8f88063290 0x7f8f88065740 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:07.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.647+0000 7f8fa27f3700 1 --2- 172.21.15.61:0/1501273978 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8f9c1552b0 0x7f8f9c151d60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:07.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.647+0000 7f8fa27f3700 1 --2- 172.21.15.61:0/1501273978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f84004850 0x7f8f9c0c7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:07.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.647+0000 7f8fa27f3700 1 --2- 172.21.15.61:0/1501273978 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8f9c154900 0x7f8f9c154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:07.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.647+0000 7f8fa27f3700 1 -- 172.21.15.61:0/1501273978 >> 172.21.15.61:0/1501273978 conn(0x7f8f9c070a90 msgr2=0x7f8f9c150000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:07.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.647+0000 7f8fa27f3700 1 -- 172.21.15.61:0/1501273978 shutdown_connections 2023-01-01T17:40:07.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.647+0000 7f8fa27f3700 1 -- 172.21.15.61:0/1501273978 wait complete. 2023-01-01T17:40:07.660 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-01T17:40:07.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.785+0000 7fd62756c700 1 Processor -- start 2023-01-01T17:40:07.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.785+0000 7fd62756c700 1 -- start start 2023-01-01T17:40:07.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.786+0000 7fd62756c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd6200695d0 0x7fd620154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:07.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.786+0000 7fd62756c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd6200699a0 0x7fd6201553e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:07.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.786+0000 7fd62756c700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd620155920 0x7fd620156010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:07.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.786+0000 7fd62756c700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6200700a0 con 0x7fd6200699a0 2023-01-01T17:40:07.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.786+0000 7fd62756c700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd620070e80 con 0x7fd6200695d0 2023-01-01T17:40:07.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.786+0000 7fd62756c700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6200705e0 con 0x7fd620155920 2023-01-01T17:40:07.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.786+0000 7fd624b07700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd6200699a0 0x7fd6201553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:07.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.786+0000 7fd624b07700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fd6200699a0 0x7fd6201553e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46398/0 (socket says 172.21.15.61:46398) 2023-01-01T17:40:07.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.786+0000 7fd624b07700 1 -- 172.21.15.61:0/1277702505 learned_addr learned my addr 172.21.15.61:0/1277702505 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:07.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.787+0000 7fd625b09700 1 --2- 172.21.15.61:0/1277702505 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd620155920 0x7fd620156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:07.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.786+0000 7fd625308700 1 --2- 172.21.15.61:0/1277702505 >> v2:172.21.15.149:3300/0 conn(0x7fd6200695d0 0x7fd620154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:07.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.787+0000 7fd624b07700 1 -- 172.21.15.61:0/1277702505 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd620155920 msgr2=0x7fd620156010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:07.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.787+0000 7fd624b07700 1 --2- 172.21.15.61:0/1277702505 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd620155920 0x7fd620156010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:07.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.787+0000 7fd624b07700 1 -- 172.21.15.61:0/1277702505 >> v2:172.21.15.149:3300/0 conn(0x7fd6200695d0 msgr2=0x7fd620154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:07.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.787+0000 7fd624b07700 1 --2- 172.21.15.61:0/1277702505 >> v2:172.21.15.149:3300/0 conn(0x7fd6200695d0 0x7fd620154ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:07.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.787+0000 7fd624b07700 1 -- 172.21.15.61:0/1277702505 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6200708c0 con 0x7fd6200699a0 2023-01-01T17:40:07.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.787+0000 7fd624b07700 1 --2- 172.21.15.61:0/1277702505 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd6200699a0 0x7fd6201553e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd620069e30 tx=0x7fd614009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2da8b1bc85ef2de server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:07.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.787+0000 7fd613fff700 1 -- 172.21.15.61:0/1277702505 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd614011830 con 0x7fd6200699a0 2023-01-01T17:40:07.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.787+0000 7fd613fff700 1 -- 172.21.15.61:0/1277702505 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd614011990 con 0x7fd6200699a0 2023-01-01T17:40:07.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.787+0000 7fd613fff700 1 -- 172.21.15.61:0/1277702505 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd614011d20 con 0x7fd6200699a0 2023-01-01T17:40:07.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.788+0000 7fd62756c700 1 -- 172.21.15.61:0/1277702505 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd6200699a0 msgr2=0x7fd6201553e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:07.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.788+0000 7fd62756c700 1 --2- 172.21.15.61:0/1277702505 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd6200699a0 0x7fd6201553e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd620069e30 tx=0x7fd614009bd0 comp rx=0 tx=0).stop 2023-01-01T17:40:07.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.788+0000 7fd62756c700 1 -- 172.21.15.61:0/1277702505 shutdown_connections 2023-01-01T17:40:07.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.788+0000 7fd62756c700 1 --2- 172.21.15.61:0/1277702505 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd620155920 0x7fd620156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:07.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.788+0000 7fd62756c700 1 --2- 172.21.15.61:0/1277702505 >> v2:172.21.15.149:3300/0 conn(0x7fd6200695d0 0x7fd620154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:07.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.788+0000 7fd62756c700 1 --2- 172.21.15.61:0/1277702505 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd6200699a0 0x7fd6201553e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:07.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.788+0000 7fd62756c700 1 -- 172.21.15.61:0/1277702505 >> 172.21.15.61:0/1277702505 conn(0x7fd62006b100 msgr2=0x7fd6200c5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:07.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.788+0000 7fd62756c700 1 -- 172.21.15.61:0/1277702505 shutdown_connections 2023-01-01T17:40:07.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.788+0000 7fd62756c700 1 -- 172.21.15.61:0/1277702505 wait complete. 2023-01-01T17:40:07.792 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.789+0000 7fd62756c700 1 Processor -- start 2023-01-01T17:40:07.793 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.789+0000 7fd62756c700 1 -- start start 2023-01-01T17:40:07.793 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.790+0000 7fd62756c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd6200695d0 0x7fd6200ab0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:07.793 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.790+0000 7fd62756c700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6200699a0 0x7fd620152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:07.793 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.790+0000 7fd62756c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd620155920 0x7fd6200a7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:07.793 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.790+0000 7fd62756c700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6200a9fd0 con 0x7fd6200695d0 2023-01-01T17:40:07.793 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.790+0000 7fd62756c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6200abb20 con 0x7fd620155920 2023-01-01T17:40:07.793 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.790+0000 7fd62756c700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6201508e0 con 0x7fd6200699a0 2023-01-01T17:40:07.793 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.790+0000 7fd625308700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd6200695d0 0x7fd6200ab0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:07.793 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.790+0000 7fd625308700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd6200695d0 0x7fd6200ab0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46404/0 (socket says 172.21.15.61:46404) 2023-01-01T17:40:07.793 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.790+0000 7fd625308700 1 -- 172.21.15.61:0/2966644607 learned_addr learned my addr 172.21.15.61:0/2966644607 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:07.794 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.790+0000 7fd625b09700 1 --2- 172.21.15.61:0/2966644607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd620155920 0x7fd6200a7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:07.794 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.790+0000 7fd624b07700 1 --2- 172.21.15.61:0/2966644607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6200699a0 0x7fd620152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:07.794 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.790+0000 7fd625308700 1 -- 172.21.15.61:0/2966644607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6200699a0 msgr2=0x7fd620152550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:07.794 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.790+0000 7fd625308700 1 --2- 172.21.15.61:0/2966644607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6200699a0 0x7fd620152550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:07.794 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.790+0000 7fd625308700 1 -- 172.21.15.61:0/2966644607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd620155920 msgr2=0x7fd6200a7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:07.794 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.790+0000 7fd625308700 1 --2- 172.21.15.61:0/2966644607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd620155920 0x7fd6200a7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:07.794 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.790+0000 7fd625308700 1 -- 172.21.15.61:0/2966644607 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd614009550 con 0x7fd6200695d0 2023-01-01T17:40:07.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.790+0000 7fd625b09700 1 --2- 172.21.15.61:0/2966644607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd620155920 0x7fd6200a7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-01-01T17:40:07.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.790+0000 7fd624b07700 1 --2- 172.21.15.61:0/2966644607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6200699a0 0x7fd620152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-01-01T17:40:07.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.790+0000 7fd625308700 1 --2- 172.21.15.61:0/2966644607 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd6200695d0 0x7fd6200ab0b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd61c00e930 tx=0x7fd61c00ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:07.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.790+0000 7fd611ffb700 1 -- 172.21.15.61:0/2966644607 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61c009690 con 0x7fd6200695d0 2023-01-01T17:40:07.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.790+0000 7fd611ffb700 1 -- 172.21.15.61:0/2966644607 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61c00c850 con 0x7fd6200695d0 2023-01-01T17:40:07.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.790+0000 7fd611ffb700 1 -- 172.21.15.61:0/2966644607 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61c00cbe0 con 0x7fd6200695d0 2023-01-01T17:40:07.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.790+0000 7fd62756c700 1 -- 172.21.15.61:0/2966644607 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd620154980 con 0x7fd6200695d0 2023-01-01T17:40:07.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.791+0000 7fd62756c700 1 -- 172.21.15.61:0/2966644607 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd620070ba0 con 0x7fd6200695d0 2023-01-01T17:40:07.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.791+0000 7fd62756c700 1 -- 172.21.15.61:0/2966644607 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd620071420 con 0x7fd6200695d0 2023-01-01T17:40:07.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.792+0000 7fd611ffb700 1 -- 172.21.15.61:0/2966644607 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7fd61c019030 con 0x7fd6200695d0 2023-01-01T17:40:07.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.792+0000 7fd611ffb700 1 --2- 172.21.15.61:0/2966644607 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fd604063290 0x7fd604065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:07.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.792+0000 7fd611ffb700 1 -- 172.21.15.61:0/2966644607 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd61c07fd60 con 0x7fd6200695d0 2023-01-01T17:40:07.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.792+0000 7fd624b07700 1 --2- 172.21.15.61:0/2966644607 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fd604063290 0x7fd604065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:07.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.793+0000 7fd624b07700 1 --2- 172.21.15.61:0/2966644607 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fd604063290 0x7fd604065740 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd62006fa80 tx=0x7fd614008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:07.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.796+0000 7fd611ffb700 1 -- 172.21.15.61:0/2966644607 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7fd61c04ea30 con 0x7fd6200695d0 2023-01-01T17:40:07.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.986+0000 7fd62756c700 1 -- 172.21.15.61:0/2966644607 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd620153d40 con 0x7fd6200695d0 2023-01-01T17:40:07.991 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.987+0000 7fd611ffb700 1 -- 172.21.15.61:0/2966644607 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18729 (secure 0 0 0) 0x7fd61c017090 con 0x7fd6200695d0 2023-01-01T17:40:07.991 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:40:07.992 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":24,"fsid":"fe0d3d8e-46ee-4ed9-92f8-749741721d01","created":"2023-01-01T17:39:34.752404+0000","modified":"2023-01-01T17:39:57.386830+0000","last_up_change":"2023-01-01T17:39:45.159720+0000","last_in_change":"2023-01-01T17:39:37.293057+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-01-01T17:39:46.110776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-01-01T17:39:46.276625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-01-01T17:39:50.568073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-01-01T17:39:51.915351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-01-01T17:39:54.992107+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5ba13bcd-4407-4cfd-8487-80917501e525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":94349},{"type":"v1","addr":"172.21.15.61:6825","nonce":94349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":94349},{"type":"v1","addr":"172.21.15.61:6827","nonce":94349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":94349},{"type":"v1","addr":"172.21.15.61:6831","nonce":94349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":94349},{"type":"v1","addr":"172.21.15.61:6829","nonce":94349}]},"public_addr":"172.21.15.61:6825/94349","cluster_addr":"172.21.15.61:6827/94349","heartbeat_back_addr":"172.21.15.61:6831/94349","heartbeat_front_addr":"172.21.15.61:6829/94349","state":["exists","up"]},{"osd":1,"uuid":"7dca9f34-ea22-4894-b238-5606b16b9c74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6811","nonce":94348},{"type":"v1","addr":"172.21.15.61:6813","nonce":94348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":94348},{"type":"v1","addr":"172.21.15.61:6816","nonce":94348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6821","nonce":94348},{"type":"v1","addr":"172.21.15.61:6823","nonce":94348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":94348},{"type":"v1","addr":"172.21.15.61:6819","nonce":94348}]},"public_addr":"172.21.15.61:6813/94348","cluster_addr":"172.21.15.61:6816/94348","heartbeat_back_addr":"172.21.15.61:6823/94348","heartbeat_front_addr":"172.21.15.61:6819/94348","state":["exists","up"]},{"osd":2,"uuid":"7b43ea06-a7b6-49f4-a390-18ad14dfe4fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":94350},{"type":"v1","addr":"172.21.15.61:6809","nonce":94350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":94350},{"type":"v1","addr":"172.21.15.61:6812","nonce":94350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":94350},{"type":"v1","addr":"172.21.15.61:6822","nonce":94350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6815","nonce":94350},{"type":"v1","addr":"172.21.15.61:6817","nonce":94350}]},"public_addr":"172.21.15.61:6809/94350","cluster_addr":"172.21.15.61:6812/94350","heartbeat_back_addr":"172.21.15.61:6822/94350","heartbeat_front_addr":"172.21.15.61:6817/94350","state":["exists","up"]},{"osd":3,"uuid":"117c41d8-d40c-4cc0-b0e1-70bca058fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":94347},{"type":"v1","addr":"172.21.15.61:6801","nonce":94347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":94347},{"type":"v1","addr":"172.21.15.61:6803","nonce":94347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":94347},{"type":"v1","addr":"172.21.15.61:6807","nonce":94347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":94347},{"type":"v1","addr":"172.21.15.61:6805","nonce":94347}]},"public_addr":"172.21.15.61:6801/94347","cluster_addr":"172.21.15.61:6803/94347","heartbeat_back_addr":"172.21.15.61:6807/94347","heartbeat_front_addr":"172.21.15.61:6805/94347","state":["exists","up"]},{"osd":4,"uuid":"4073e0e8-c5dd-463f-aa1c-c9515ef09976","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":94711},{"type":"v1","addr":"172.21.15.149:6818","nonce":94711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":94711},{"type":"v1","addr":"172.21.15.149:6822","nonce":94711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":94711},{"type":"v1","addr":"172.21.15.149:6830","nonce":94711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":94711},{"type":"v1","addr":"172.21.15.149:6826","nonce":94711}]},"public_addr":"172.21.15.149:6818/94711","cluster_addr":"172.21.15.149:6822/94711","heartbeat_back_addr":"172.21.15.149:6830/94711","heartbeat_front_addr":"172.21.15.149:6826/94711","state":["exists","up"]},{"osd":5,"uuid":"88aa0c0f-e3c1-4dd3-af8c-61f4bc28504e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":94709},{"type":"v1","addr":"172.21.15.149:6809","nonce":94709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":94709},{"type":"v1","addr":"172.21.15.149:6811","nonce":94709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":94709},{"type":"v1","addr":"172.21.15.149:6815","nonce":94709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":94709},{"type":"v1","addr":"172.21.15.149:6813","nonce":94709}]},"public_addr":"172.21.15.149:6809/94709","cluster_addr":"172.21.15.149:6811/94709","heartbeat_back_addr":"172.21.15.149:6815/94709","heartbeat_front_addr":"172.21.15.149:6813/94709","state":["exists","up"]},{"osd":6,"uuid":"8b13fc0c-5f00-41c7-8923-c4570da77afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":94710},{"type":"v1","addr":"172.21.15.149:6801","nonce":94710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":94710},{"type":"v1","addr":"172.21.15.149:6803","nonce":94710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":94710},{"type":"v1","addr":"172.21.15.149:6807","nonce":94710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":94710},{"type":"v1","addr":"172.21.15.149:6805","nonce":94710}]},"public_addr":"172.21.15.149:6801/94710","cluster_addr":"172.21.15.149:6803/94710","heartbeat_back_addr":"172.21.15.149:6807/94710","heartbeat_front_addr":"172.21.15.149:6805/94710","state":["exists","up"]},{"osd":7,"uuid":"5390c6e5-39e7-4aa6-b73c-642458b2acf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":94734},{"type":"v1","addr":"172.21.15.149:6819","nonce":94734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":94734},{"type":"v1","addr":"172.21.15.149:6823","nonce":94734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":94734},{"type":"v1","addr":"172.21.15.149:6831","nonce":94734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":94734},{"type":"v1","addr":"172.21.15.149:6827","nonce":94734}]},"public_addr":"172.21.15.149:6819/94734","cluster_addr":"172.21.15.149:6823/94734","heartbeat_back_addr":"172.21.15.149:6831/94734","heartbeat_front_addr":"172.21.15.149:6827/94734","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.555826+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.508739+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.515601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.472067+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.535257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.493397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.554910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.552343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-01T17:40:07.993 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.989+0000 7fd62756c700 1 -- 172.21.15.61:0/2966644607 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fd604063290 msgr2=0x7fd604065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:07.993 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.989+0000 7fd62756c700 1 --2- 172.21.15.61:0/2966644607 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fd604063290 0x7fd604065740 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd62006fa80 tx=0x7fd614008030 comp rx=0 tx=0).stop 2023-01-01T17:40:07.993 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.989+0000 7fd62756c700 1 -- 172.21.15.61:0/2966644607 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd6200695d0 msgr2=0x7fd6200ab0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:07.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.989+0000 7fd62756c700 1 --2- 172.21.15.61:0/2966644607 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd6200695d0 0x7fd6200ab0b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd61c00e930 tx=0x7fd61c00ecf0 comp rx=0 tx=0).stop 2023-01-01T17:40:07.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.989+0000 7fd62756c700 1 -- 172.21.15.61:0/2966644607 shutdown_connections 2023-01-01T17:40:07.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.989+0000 7fd62756c700 1 --2- 172.21.15.61:0/2966644607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd620155920 0x7fd6200a7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:07.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.989+0000 7fd62756c700 1 --2- 172.21.15.61:0/2966644607 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fd604063290 0x7fd604065740 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:07.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.989+0000 7fd62756c700 1 --2- 172.21.15.61:0/2966644607 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fd6200695d0 0x7fd6200ab0b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:07.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.989+0000 7fd62756c700 1 --2- 172.21.15.61:0/2966644607 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fd6200699a0 0x7fd620152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:07.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.989+0000 7fd62756c700 1 -- 172.21.15.61:0/2966644607 >> 172.21.15.61:0/2966644607 conn(0x7fd62006b100 msgr2=0x7fd6200c2480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:07.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.989+0000 7fd62756c700 1 -- 172.21.15.61:0/2966644607 shutdown_connections 2023-01-01T17:40:07.994 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:07.989+0000 7fd62756c700 1 -- 172.21.15.61:0/2966644607 wait complete. 2023-01-01T17:40:08.001 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-01-01T17:40:08.128 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.128+0000 7f609489f700 1 Processor -- start 2023-01-01T17:40:08.129 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.129+0000 7f609489f700 1 -- start start 2023-01-01T17:40:08.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.129+0000 7f609489f700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f609006cff0 0x7f6090069360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:08.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.129+0000 7f609489f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f60900698a0 0x7f6090152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:08.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.130+0000 7f609489f700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f609006aaa0 con 0x7f609014cf50 2023-01-01T17:40:08.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.130+0000 7f609489f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60900c0930 con 0x7f60900698a0 2023-01-01T17:40:08.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.130+0000 7f609489f700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6090069e90 con 0x7f609006cff0 2023-01-01T17:40:08.131 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.130+0000 7f608dd9b700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f609006cff0 0x7f6090069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:08.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.130+0000 7f608ed9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f60900698a0 0x7f6090152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:08.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.130+0000 7f608dd9b700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f609006cff0 0x7f6090069360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.61:44654/0 (socket says 172.21.15.61:44654) 2023-01-01T17:40:08.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.130+0000 7f608e59c700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f609014cf50 0x7f60900c0220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.61:48736/0 (socket says 172.21.15.61:48736) 2023-01-01T17:40:08.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.130+0000 7f608dd9b700 1 -- 172.21.15.61:0/2962064734 learned_addr learned my addr 172.21.15.61:0/2962064734 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:08.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.130+0000 7f608dd9b700 1 -- 172.21.15.61:0/2962064734 >> v2:172.21.15.149:3300/0 conn(0x7f60900698a0 msgr2=0x7f6090152ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:08.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.130+0000 7f608dd9b700 1 --2- 172.21.15.61:0/2962064734 >> v2:172.21.15.149:3300/0 conn(0x7f60900698a0 0x7f6090152ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:08.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.130+0000 7f608dd9b700 1 -- 172.21.15.61:0/2962064734 >> v1:172.21.15.149:6789/0 conn(0x7f609014cf50 legacy=0x7f60900c0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:08.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.130+0000 7f608dd9b700 1 -- 172.21.15.61:0/2962064734 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609006a170 con 0x7f609006cff0 2023-01-01T17:40:08.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.130+0000 7f608ed9d700 1 --2- 172.21.15.61:0/2962064734 >> v2:172.21.15.149:3300/0 conn(0x7f60900698a0 0x7f6090152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-01-01T17:40:08.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.130+0000 7f608dd9b700 1 --2- 172.21.15.61:0/2962064734 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f609006cff0 0x7f6090069360 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f60780098f0 tx=0x7f6078009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39f4b920fb7a2549 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:08.132 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.130+0000 7f608d59a700 1 -- 172.21.15.61:0/2962064734 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6078011830 con 0x7f609006cff0 2023-01-01T17:40:08.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.131+0000 7f608d59a700 1 -- 172.21.15.61:0/2962064734 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6078011990 con 0x7f609006cff0 2023-01-01T17:40:08.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.131+0000 7f608d59a700 1 -- 172.21.15.61:0/2962064734 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6078011d20 con 0x7f609006cff0 2023-01-01T17:40:08.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.131+0000 7f609489f700 1 -- 172.21.15.61:0/2962064734 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f609006cff0 msgr2=0x7f6090069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:08.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.131+0000 7f609489f700 1 --2- 172.21.15.61:0/2962064734 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f609006cff0 0x7f6090069360 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f60780098f0 tx=0x7f6078009c00 comp rx=0 tx=0).stop 2023-01-01T17:40:08.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.131+0000 7f609489f700 1 -- 172.21.15.61:0/2962064734 shutdown_connections 2023-01-01T17:40:08.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.131+0000 7f609489f700 1 --2- 172.21.15.61:0/2962064734 >> v2:172.21.15.149:3300/0 conn(0x7f60900698a0 0x7f6090152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:08.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.131+0000 7f609489f700 1 --2- 172.21.15.61:0/2962064734 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f609006cff0 0x7f6090069360 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:08.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.131+0000 7f609489f700 1 -- 172.21.15.61:0/2962064734 >> 172.21.15.61:0/2962064734 conn(0x7f60900c1e80 msgr2=0x7f60900c2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:08.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.131+0000 7f609489f700 1 -- 172.21.15.61:0/2962064734 shutdown_connections 2023-01-01T17:40:08.133 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.131+0000 7f609489f700 1 -- 172.21.15.61:0/2962064734 wait complete. 2023-01-01T17:40:08.136 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.132+0000 7f609489f700 1 Processor -- start 2023-01-01T17:40:08.136 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.133+0000 7f609489f700 1 -- start start 2023-01-01T17:40:08.136 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.133+0000 7f609489f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60900698a0 0x7f609014d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:08.136 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.133+0000 7f609489f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f609006cff0 0x7f6090145e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:08.136 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.133+0000 7f609489f700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f609014cf50 0x7f6090146390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:08.136 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.133+0000 7f609489f700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609014dd20 con 0x7f60900698a0 2023-01-01T17:40:08.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.133+0000 7f609489f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6090070860 con 0x7f609006cff0 2023-01-01T17:40:08.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.133+0000 7f609489f700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60900aa010 con 0x7f609014cf50 2023-01-01T17:40:08.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.133+0000 7f608e59c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60900698a0 0x7f609014d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:08.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.133+0000 7f608e59c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60900698a0 0x7f609014d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46418/0 (socket says 172.21.15.61:46418) 2023-01-01T17:40:08.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.133+0000 7f608e59c700 1 -- 172.21.15.61:0/301854968 learned_addr learned my addr 172.21.15.61:0/301854968 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:08.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.134+0000 7f608ed9d700 1 --2- 172.21.15.61:0/301854968 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f609014cf50 0x7f6090146390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:08.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.134+0000 7f608dd9b700 1 --2- 172.21.15.61:0/301854968 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f609006cff0 0x7f6090145e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:08.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.134+0000 7f608e59c700 1 -- 172.21.15.61:0/301854968 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f609014cf50 msgr2=0x7f6090146390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:08.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.134+0000 7f608e59c700 1 --2- 172.21.15.61:0/301854968 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f609014cf50 0x7f6090146390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:08.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.134+0000 7f608e59c700 1 -- 172.21.15.61:0/301854968 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f609006cff0 msgr2=0x7f6090145e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:08.140 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.134+0000 7f608e59c700 1 --2- 172.21.15.61:0/301854968 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f609006cff0 0x7f6090145e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:08.141 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.134+0000 7f608e59c700 1 -- 172.21.15.61:0/301854968 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6088009a70 con 0x7f60900698a0 2023-01-01T17:40:08.141 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.134+0000 7f608e59c700 1 --2- 172.21.15.61:0/301854968 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60900698a0 0x7f609014d640 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f608000c530 tx=0x7f608000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:08.141 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.134+0000 7f6086ffd700 1 -- 172.21.15.61:0/301854968 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6080005cb0 con 0x7f60900698a0 2023-01-01T17:40:08.141 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.134+0000 7f6086ffd700 1 -- 172.21.15.61:0/301854968 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608000ce90 con 0x7f60900698a0 2023-01-01T17:40:08.141 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.134+0000 7f609489f700 1 -- 172.21.15.61:0/301854968 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6078009550 con 0x7f60900698a0 2023-01-01T17:40:08.141 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.134+0000 7f6086ffd700 1 -- 172.21.15.61:0/301854968 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60800072d0 con 0x7f60900698a0 2023-01-01T17:40:08.141 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.134+0000 7f609489f700 1 -- 172.21.15.61:0/301854968 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f609006a730 con 0x7f60900698a0 2023-01-01T17:40:08.141 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.135+0000 7f609489f700 1 -- 172.21.15.61:0/301854968 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f609006a450 con 0x7f60900698a0 2023-01-01T17:40:08.142 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.135+0000 7f6086ffd700 1 -- 172.21.15.61:0/301854968 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f6080019030 con 0x7f60900698a0 2023-01-01T17:40:08.142 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.136+0000 7f6086ffd700 1 --2- 172.21.15.61:0/301854968 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f6070063290 0x7f6070065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:08.142 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.136+0000 7f6086ffd700 1 -- 172.21.15.61:0/301854968 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f608007edb0 con 0x7f60900698a0 2023-01-01T17:40:08.142 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.136+0000 7f608dd9b700 1 --2- 172.21.15.61:0/301854968 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f6070063290 0x7f6070065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:08.142 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.136+0000 7f608dd9b700 1 --2- 172.21.15.61:0/301854968 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f6070063290 0x7f6070065740 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6078000c00 tx=0x7f6078008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:08.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.140+0000 7f6086ffd700 1 -- 172.21.15.61:0/301854968 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f608004aa30 con 0x7f60900698a0 2023-01-01T17:40:08.377 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.376+0000 7f609489f700 1 -- 172.21.15.61:0/301854968 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6090153400 con 0x7f60900698a0 2023-01-01T17:40:08.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.539+0000 7f6086ffd700 1 -- 172.21.15.61:0/301854968 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6080017070 con 0x7f60900698a0 2023-01-01T17:40:08.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.541+0000 7f609489f700 1 -- 172.21.15.61:0/301854968 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f6070063290 msgr2=0x7f6070065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:08.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.541+0000 7f609489f700 1 --2- 172.21.15.61:0/301854968 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f6070063290 0x7f6070065740 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6078000c00 tx=0x7f6078008030 comp rx=0 tx=0).stop 2023-01-01T17:40:08.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.541+0000 7f609489f700 1 -- 172.21.15.61:0/301854968 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60900698a0 msgr2=0x7f609014d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:08.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.541+0000 7f609489f700 1 --2- 172.21.15.61:0/301854968 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60900698a0 0x7f609014d640 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f608000c530 tx=0x7f608000c840 comp rx=0 tx=0).stop 2023-01-01T17:40:08.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.541+0000 7f609489f700 1 -- 172.21.15.61:0/301854968 shutdown_connections 2023-01-01T17:40:08.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.541+0000 7f609489f700 1 --2- 172.21.15.61:0/301854968 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f609014cf50 0x7f6090146390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:08.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.541+0000 7f609489f700 1 --2- 172.21.15.61:0/301854968 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f6070063290 0x7f6070065740 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:08.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.541+0000 7f609489f700 1 --2- 172.21.15.61:0/301854968 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f60900698a0 0x7f609014d640 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:08.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.541+0000 7f609489f700 1 --2- 172.21.15.61:0/301854968 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f609006cff0 0x7f6090145e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:08.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.541+0000 7f609489f700 1 -- 172.21.15.61:0/301854968 >> 172.21.15.61:0/301854968 conn(0x7f60900c1e80 msgr2=0x7f609006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:08.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.541+0000 7f609489f700 1 -- 172.21.15.61:0/301854968 shutdown_connections 2023-01-01T17:40:08.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.541+0000 7f609489f700 1 -- 172.21.15.61:0/301854968 wait complete. 2023-01-01T17:40:08.554 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-01-01T17:40:08.554 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-01-01T17:40:08.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.683+0000 7f5ed15c4700 1 Processor -- start 2023-01-01T17:40:08.683 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.683+0000 7f5ed15c4700 1 -- start start 2023-01-01T17:40:08.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.684+0000 7f5ed15c4700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f5ecc149860 0x7f5ecc0c17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:08.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.684+0000 7f5ed15c4700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f5ecc0c0320 0x7f5ecc069360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:08.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.684+0000 7f5ed15c4700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ecc0c0a80 con 0x7f5ecc06f840 2023-01-01T17:40:08.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.684+0000 7f5ed15c4700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ecc070420 con 0x7f5ecc0c0320 2023-01-01T17:40:08.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.684+0000 7f5ed15c4700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ecc070d30 con 0x7f5ecc149860 2023-01-01T17:40:08.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.684+0000 7f5eca7fc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f5ecc0c0320 0x7f5ecc069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:08.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.684+0000 7f5eca7fc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f5ecc0c0320 0x7f5ecc069360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46426/0 (socket says 172.21.15.61:46426) 2023-01-01T17:40:08.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.684+0000 7f5eca7fc700 1 -- 172.21.15.61:0/3231812781 learned_addr learned my addr 172.21.15.61:0/3231812781 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:08.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.684+0000 7f5ecaffd700 1 --2- 172.21.15.61:0/3231812781 >> v2:172.21.15.149:3300/0 conn(0x7f5ecc149860 0x7f5ecc0c17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:08.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.684+0000 7f5eca7fc700 1 -- 172.21.15.61:0/3231812781 >> v2:172.21.15.149:3300/0 conn(0x7f5ecc149860 msgr2=0x7f5ecc0c17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:08.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.684+0000 7f5eca7fc700 1 --2- 172.21.15.61:0/3231812781 >> v2:172.21.15.149:3300/0 conn(0x7f5ecc149860 0x7f5ecc0c17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:08.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.684+0000 7f5eca7fc700 1 -- 172.21.15.61:0/3231812781 >> v1:172.21.15.149:6789/0 conn(0x7f5ecc06f840 legacy=0x7f5ecc152dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:08.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.685+0000 7f5eca7fc700 1 -- 172.21.15.61:0/3231812781 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ecc1505a0 con 0x7f5ecc0c0320 2023-01-01T17:40:08.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.685+0000 7f5eca7fc700 1 --2- 172.21.15.61:0/3231812781 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ecc0c0320 0x7f5ecc069360 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc06ef40 tx=0x7f5ebc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19bd10d2b043320c server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:08.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.685+0000 7f5ec9ffb700 1 -- 172.21.15.61:0/3231812781 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc00b870 con 0x7f5ecc0c0320 2023-01-01T17:40:08.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.685+0000 7f5ec9ffb700 1 -- 172.21.15.61:0/3231812781 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ebc00b9d0 con 0x7f5ecc0c0320 2023-01-01T17:40:08.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.685+0000 7f5ec9ffb700 1 -- 172.21.15.61:0/3231812781 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc00bd60 con 0x7f5ecc0c0320 2023-01-01T17:40:08.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.685+0000 7f5ed15c4700 1 -- 172.21.15.61:0/3231812781 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ecc0c0320 msgr2=0x7f5ecc069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:08.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.685+0000 7f5ed15c4700 1 --2- 172.21.15.61:0/3231812781 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ecc0c0320 0x7f5ecc069360 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc06ef40 tx=0x7f5ebc009bd0 comp rx=0 tx=0).stop 2023-01-01T17:40:08.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.685+0000 7f5ed15c4700 1 -- 172.21.15.61:0/3231812781 shutdown_connections 2023-01-01T17:40:08.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.685+0000 7f5ed15c4700 1 --2- 172.21.15.61:0/3231812781 >> v2:172.21.15.149:3300/0 conn(0x7f5ecc149860 0x7f5ecc0c17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:08.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.685+0000 7f5ed15c4700 1 --2- 172.21.15.61:0/3231812781 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ecc0c0320 0x7f5ecc069360 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:08.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.685+0000 7f5ed15c4700 1 -- 172.21.15.61:0/3231812781 >> 172.21.15.61:0/3231812781 conn(0x7f5ecc0c1e80 msgr2=0x7f5ecc0c2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:08.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.685+0000 7f5ed15c4700 1 -- 172.21.15.61:0/3231812781 shutdown_connections 2023-01-01T17:40:08.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.686+0000 7f5ed15c4700 1 -- 172.21.15.61:0/3231812781 wait complete. 2023-01-01T17:40:08.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.687+0000 7f5ed15c4700 1 Processor -- start 2023-01-01T17:40:08.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.687+0000 7f5ed15c4700 1 -- start start 2023-01-01T17:40:08.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.687+0000 7f5ed15c4700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ecc06f840 0x7f5ecc0c2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:08.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.687+0000 7f5ed15c4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ecc0c0320 0x7f5ecc1e8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:08.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.687+0000 7f5ed15c4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ecc149860 0x7f5ecc1ebad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:08.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.687+0000 7f5ed15c4700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc0a9210 con 0x7f5ecc0c0320 2023-01-01T17:40:08.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.688+0000 7f5ed15c4700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc0bf670 con 0x7f5ecc149860 2023-01-01T17:40:08.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.688+0000 7f5ed15c4700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc1e8520 con 0x7f5ecc06f840 2023-01-01T17:40:08.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.688+0000 7f5eca7fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ecc0c0320 0x7f5ecc1e8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:08.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.688+0000 7f5eca7fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ecc0c0320 0x7f5ecc1e8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46434/0 (socket says 172.21.15.61:46434) 2023-01-01T17:40:08.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.688+0000 7f5eca7fc700 1 -- 172.21.15.61:0/1372478433 learned_addr learned my addr 172.21.15.61:0/1372478433 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:08.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.688+0000 7f5ecb7fe700 1 --2- 172.21.15.61:0/1372478433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ecc149860 0x7f5ecc1ebad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:08.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.688+0000 7f5ecaffd700 1 --2- 172.21.15.61:0/1372478433 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ecc06f840 0x7f5ecc0c2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:08.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.688+0000 7f5eca7fc700 1 -- 172.21.15.61:0/1372478433 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ecc06f840 msgr2=0x7f5ecc0c2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:08.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.688+0000 7f5eca7fc700 1 --2- 172.21.15.61:0/1372478433 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ecc06f840 0x7f5ecc0c2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:08.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.688+0000 7f5eca7fc700 1 -- 172.21.15.61:0/1372478433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ecc149860 msgr2=0x7f5ecc1ebad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:08.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.688+0000 7f5eca7fc700 1 --2- 172.21.15.61:0/1372478433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ecc149860 0x7f5ecc1ebad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:08.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.688+0000 7f5eca7fc700 1 -- 172.21.15.61:0/1372478433 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ebc009550 con 0x7f5ecc0c0320 2023-01-01T17:40:08.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.688+0000 7f5eca7fc700 1 --2- 172.21.15.61:0/1372478433 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ecc0c0320 0x7f5ecc1e8f30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc000c00 tx=0x7f5ebc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:08.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.688+0000 7f5eb37fe700 1 -- 172.21.15.61:0/1372478433 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc004250 con 0x7f5ecc0c0320 2023-01-01T17:40:08.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.688+0000 7f5eb37fe700 1 -- 172.21.15.61:0/1372478433 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ebc01f070 con 0x7f5ecc0c0320 2023-01-01T17:40:08.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.688+0000 7f5ed15c4700 1 -- 172.21.15.61:0/1372478433 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ecc0c0fb0 con 0x7f5ecc0c0320 2023-01-01T17:40:08.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.688+0000 7f5eb37fe700 1 -- 172.21.15.61:0/1372478433 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc0045b0 con 0x7f5ecc0c0320 2023-01-01T17:40:08.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.688+0000 7f5ed15c4700 1 -- 172.21.15.61:0/1372478433 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ecc0c0cd0 con 0x7f5ecc0c0320 2023-01-01T17:40:08.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.689+0000 7f5ed15c4700 1 -- 172.21.15.61:0/1372478433 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ecc0c1290 con 0x7f5ecc0c0320 2023-01-01T17:40:08.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.690+0000 7f5eb37fe700 1 -- 172.21.15.61:0/1372478433 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f5ebc02a020 con 0x7f5ecc0c0320 2023-01-01T17:40:08.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.690+0000 7f5eb37fe700 1 --2- 172.21.15.61:0/1372478433 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f5eb8063290 0x7f5eb8065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:08.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.690+0000 7f5eb37fe700 1 -- 172.21.15.61:0/1372478433 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5ebc081050 con 0x7f5ecc0c0320 2023-01-01T17:40:08.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.690+0000 7f5ecaffd700 1 --2- 172.21.15.61:0/1372478433 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f5eb8063290 0x7f5eb8065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:08.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.691+0000 7f5ecaffd700 1 --2- 172.21.15.61:0/1372478433 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f5eb8063290 0x7f5eb8065740 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0006b20 tx=0x7f5ec0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:08.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.695+0000 7f5eb37fe700 1 -- 172.21.15.61:0/1372478433 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f5ebc04fe10 con 0x7f5ecc0c0320 2023-01-01T17:40:08.932 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:08.933+0000 7f5ed15c4700 1 -- 172.21.15.61:0/1372478433 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5ecc0668a0 con 0x7f5ecc0c0320 2023-01-01T17:40:09.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.541+0000 7f5eb37fe700 1 -- 172.21.15.61:0/1372478433 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5ebc053430 con 0x7f5ecc0c0320 2023-01-01T17:40:09.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.544+0000 7f5ed15c4700 1 -- 172.21.15.61:0/1372478433 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f5eb8063290 msgr2=0x7f5eb8065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:09.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.544+0000 7f5ed15c4700 1 --2- 172.21.15.61:0/1372478433 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f5eb8063290 0x7f5eb8065740 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0006b20 tx=0x7f5ec0008040 comp rx=0 tx=0).stop 2023-01-01T17:40:09.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.544+0000 7f5ed15c4700 1 -- 172.21.15.61:0/1372478433 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ecc0c0320 msgr2=0x7f5ecc1e8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:09.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.544+0000 7f5ed15c4700 1 --2- 172.21.15.61:0/1372478433 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ecc0c0320 0x7f5ecc1e8f30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc000c00 tx=0x7f5ebc004750 comp rx=0 tx=0).stop 2023-01-01T17:40:09.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.544+0000 7f5ed15c4700 1 -- 172.21.15.61:0/1372478433 shutdown_connections 2023-01-01T17:40:09.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.544+0000 7f5ed15c4700 1 --2- 172.21.15.61:0/1372478433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5ecc149860 0x7f5ecc1ebad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:09.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.544+0000 7f5ed15c4700 1 --2- 172.21.15.61:0/1372478433 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f5ecc06f840 0x7f5ecc0c2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:09.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.544+0000 7f5ed15c4700 1 --2- 172.21.15.61:0/1372478433 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f5eb8063290 0x7f5eb8065740 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:09.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.544+0000 7f5ed15c4700 1 --2- 172.21.15.61:0/1372478433 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f5ecc0c0320 0x7f5ecc1e8f30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:09.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.544+0000 7f5ed15c4700 1 -- 172.21.15.61:0/1372478433 >> 172.21.15.61:0/1372478433 conn(0x7f5ecc0c1e80 msgr2=0x7f5ecc1467b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:09.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.544+0000 7f5ed15c4700 1 -- 172.21.15.61:0/1372478433 shutdown_connections 2023-01-01T17:40:09.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.544+0000 7f5ed15c4700 1 -- 172.21.15.61:0/1372478433 wait complete. 2023-01-01T17:40:09.558 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-01-01T17:40:09.558 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-01-01T17:40:09.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.690+0000 7fa519b54700 1 Processor -- start 2023-01-01T17:40:09.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.690+0000 7fa519b54700 1 -- start start 2023-01-01T17:40:09.692 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.691+0000 7fa519b54700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fa5140c4e20 0x7fa5140c3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:09.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.691+0000 7fa519b54700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa514155010 0x7fa514155410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:09.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.691+0000 7fa519b54700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5140c51f0 con 0x7fa514070440 2023-01-01T17:40:09.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.691+0000 7fa519b54700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5140715b0 con 0x7fa5140c4e20 2023-01-01T17:40:09.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.691+0000 7fa519b54700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5140708c0 con 0x7fa514155010 2023-01-01T17:40:09.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.691+0000 7fa5137fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fa5140c4e20 0x7fa5140c3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:09.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.691+0000 7fa5137fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fa5140c4e20 0x7fa5140c3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46438/0 (socket says 172.21.15.61:46438) 2023-01-01T17:40:09.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.691+0000 7fa5137fe700 1 -- 172.21.15.61:0/129009770 learned_addr learned my addr 172.21.15.61:0/129009770 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:09.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.692+0000 7fa513fff700 1 --2- 172.21.15.61:0/129009770 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa514155010 0x7fa514155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:09.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.692+0000 7fa5137fe700 1 -- 172.21.15.61:0/129009770 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa514155010 msgr2=0x7fa514155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:09.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.692+0000 7fa5137fe700 1 --2- 172.21.15.61:0/129009770 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa514155010 0x7fa514155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:09.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.692+0000 7fa5137fe700 1 -- 172.21.15.61:0/129009770 >> v1:172.21.15.149:6789/0 conn(0x7fa514070440 legacy=0x7fa514069360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:09.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.692+0000 7fa5137fe700 1 -- 172.21.15.61:0/129009770 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa514070b40 con 0x7fa5140c4e20 2023-01-01T17:40:09.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.692+0000 7fa513fff700 1 --2- 172.21.15.61:0/129009770 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa514155010 0x7fa514155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-01T17:40:09.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.692+0000 7fa5137fe700 1 --2- 172.21.15.61:0/129009770 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa5140c4e20 0x7fa5140c3ca0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa5040098f0 tx=0x7fa504009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b2778336bed73ab server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:09.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.692+0000 7fa5127fc700 1 -- 172.21.15.61:0/129009770 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50400b8a0 con 0x7fa5140c4e20 2023-01-01T17:40:09.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.692+0000 7fa5127fc700 1 -- 172.21.15.61:0/129009770 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50400ba00 con 0x7fa5140c4e20 2023-01-01T17:40:09.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.692+0000 7fa5127fc700 1 -- 172.21.15.61:0/129009770 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50400bd90 con 0x7fa5140c4e20 2023-01-01T17:40:09.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.693+0000 7fa519b54700 1 -- 172.21.15.61:0/129009770 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa5140c4e20 msgr2=0x7fa5140c3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:09.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.693+0000 7fa519b54700 1 --2- 172.21.15.61:0/129009770 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa5140c4e20 0x7fa5140c3ca0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa5040098f0 tx=0x7fa504009c00 comp rx=0 tx=0).stop 2023-01-01T17:40:09.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.693+0000 7fa519b54700 1 -- 172.21.15.61:0/129009770 shutdown_connections 2023-01-01T17:40:09.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.693+0000 7fa519b54700 1 --2- 172.21.15.61:0/129009770 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa514155010 0x7fa514155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:09.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.693+0000 7fa519b54700 1 --2- 172.21.15.61:0/129009770 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa5140c4e20 0x7fa5140c3ca0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:09.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.693+0000 7fa519b54700 1 -- 172.21.15.61:0/129009770 >> 172.21.15.61:0/129009770 conn(0x7fa51406b100 msgr2=0x7fa5140c5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:09.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.693+0000 7fa519b54700 1 -- 172.21.15.61:0/129009770 shutdown_connections 2023-01-01T17:40:09.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.693+0000 7fa519b54700 1 -- 172.21.15.61:0/129009770 wait complete. 2023-01-01T17:40:09.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.694+0000 7fa519b54700 1 Processor -- start 2023-01-01T17:40:09.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.694+0000 7fa519b54700 1 -- start start 2023-01-01T17:40:09.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.695+0000 7fa519b54700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa514070440 0x7fa51406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:09.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.695+0000 7fa519b54700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa5140c4e20 0x7fa5140a9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:09.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.695+0000 7fa519b54700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa514155010 0x7fa5140a9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:09.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.695+0000 7fa519b54700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5140be790 con 0x7fa514155010 2023-01-01T17:40:09.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.695+0000 7fa519b54700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5141ec6a0 con 0x7fa5140c4e20 2023-01-01T17:40:09.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.695+0000 7fa519b54700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5141e8760 con 0x7fa514070440 2023-01-01T17:40:09.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.695+0000 7fa513fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa514155010 0x7fa5140a9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:09.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.695+0000 7fa513fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa514155010 0x7fa5140a9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46448/0 (socket says 172.21.15.61:46448) 2023-01-01T17:40:09.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.695+0000 7fa513fff700 1 -- 172.21.15.61:0/534041868 learned_addr learned my addr 172.21.15.61:0/534041868 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:09.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.695+0000 7fa5137fe700 1 --2- 172.21.15.61:0/534041868 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa514070440 0x7fa51406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:09.698 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.695+0000 7fa512ffd700 1 --2- 172.21.15.61:0/534041868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa5140c4e20 0x7fa5140a9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:09.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.695+0000 7fa513fff700 1 -- 172.21.15.61:0/534041868 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa514070440 msgr2=0x7fa51406d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:09.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.695+0000 7fa513fff700 1 --2- 172.21.15.61:0/534041868 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa514070440 0x7fa51406d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:09.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.695+0000 7fa513fff700 1 -- 172.21.15.61:0/534041868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa5140c4e20 msgr2=0x7fa5140a9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:09.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.695+0000 7fa513fff700 1 --2- 172.21.15.61:0/534041868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa5140c4e20 0x7fa5140a9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:09.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.695+0000 7fa513fff700 1 -- 172.21.15.61:0/534041868 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa504009550 con 0x7fa514155010 2023-01-01T17:40:09.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.695+0000 7fa513fff700 1 --2- 172.21.15.61:0/534041868 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa514155010 0x7fa5140a9f90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa50c007ef0 tx=0x7fa50c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:09.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.695+0000 7fa4fbfff700 1 -- 172.21.15.61:0/534041868 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c00de60 con 0x7fa514155010 2023-01-01T17:40:09.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.696+0000 7fa4fbfff700 1 -- 172.21.15.61:0/534041868 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50c00f040 con 0x7fa514155010 2023-01-01T17:40:09.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.696+0000 7fa519b54700 1 -- 172.21.15.61:0/534041868 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa514154810 con 0x7fa514155010 2023-01-01T17:40:09.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.696+0000 7fa4fbfff700 1 -- 172.21.15.61:0/534041868 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c003c60 con 0x7fa514155010 2023-01-01T17:40:09.699 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.696+0000 7fa519b54700 1 -- 172.21.15.61:0/534041868 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa514070e20 con 0x7fa514155010 2023-01-01T17:40:09.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.697+0000 7fa519b54700 1 -- 172.21.15.61:0/534041868 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa514154af0 con 0x7fa514155010 2023-01-01T17:40:09.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.697+0000 7fa4fbfff700 1 -- 172.21.15.61:0/534041868 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7fa50c01c030 con 0x7fa514155010 2023-01-01T17:40:09.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.697+0000 7fa4fbfff700 1 --2- 172.21.15.61:0/534041868 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fa500063290 0x7fa500065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:09.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.697+0000 7fa4fbfff700 1 -- 172.21.15.61:0/534041868 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa50c07fe00 con 0x7fa514155010 2023-01-01T17:40:09.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.697+0000 7fa5137fe700 1 --2- 172.21.15.61:0/534041868 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fa500063290 0x7fa500065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:09.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.698+0000 7fa5137fe700 1 --2- 172.21.15.61:0/534041868 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fa500063290 0x7fa500065740 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa504014040 tx=0x7fa504008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:09.702 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.702+0000 7fa4fbfff700 1 -- 172.21.15.61:0/534041868 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7fa50c04ebc0 con 0x7fa514155010 2023-01-01T17:40:09.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.934+0000 7fa519b54700 1 -- 172.21.15.61:0/534041868 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa5140c09b0 con 0x7fa514155010 2023-01-01T17:40:09.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.935+0000 7fa4fbfff700 1 -- 172.21.15.61:0/534041868 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4634 (secure 0 0 0) 0x7fa50c01a090 con 0x7fa514155010 2023-01-01T17:40:09.934 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:40:09.935 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/671276443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":671276443},{"type":"v1","addr":"172.21.15.149:6835","nonce":671276443}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6836/1287782466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6834","nonce":1287782466},{"type":"v1","addr":"172.21.15.61:6836","nonce":1287782466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/594691675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":594691675},{"type":"v1","addr":"172.21.15.149:6833","nonce":594691675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-01-01T17:39:52.938920+0000","modified":"2023-01-01T17:40:09.538397+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6837/426398173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6835","nonce":426398173},{"type":"v1","addr":"172.21.15.61:6837","nonce":426398173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-01-01T17:40:09.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.937+0000 7fa519b54700 1 -- 172.21.15.61:0/534041868 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fa500063290 msgr2=0x7fa500065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:09.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.937+0000 7fa519b54700 1 --2- 172.21.15.61:0/534041868 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fa500063290 0x7fa500065740 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa504014040 tx=0x7fa504008030 comp rx=0 tx=0).stop 2023-01-01T17:40:09.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.937+0000 7fa519b54700 1 -- 172.21.15.61:0/534041868 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa514155010 msgr2=0x7fa5140a9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:09.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.937+0000 7fa519b54700 1 --2- 172.21.15.61:0/534041868 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa514155010 0x7fa5140a9f90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa50c007ef0 tx=0x7fa50c00d3b0 comp rx=0 tx=0).stop 2023-01-01T17:40:09.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.937+0000 7fa519b54700 1 -- 172.21.15.61:0/534041868 shutdown_connections 2023-01-01T17:40:09.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.937+0000 7fa519b54700 1 --2- 172.21.15.61:0/534041868 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fa500063290 0x7fa500065740 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:09.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.937+0000 7fa519b54700 1 --2- 172.21.15.61:0/534041868 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa514155010 0x7fa5140a9f90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:09.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.937+0000 7fa519b54700 1 --2- 172.21.15.61:0/534041868 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa514070440 0x7fa51406d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:09.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.937+0000 7fa519b54700 1 --2- 172.21.15.61:0/534041868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa5140c4e20 0x7fa5140a9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:09.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.937+0000 7fa519b54700 1 -- 172.21.15.61:0/534041868 >> 172.21.15.61:0/534041868 conn(0x7fa51406b100 msgr2=0x7fa514069360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:09.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.937+0000 7fa519b54700 1 -- 172.21.15.61:0/534041868 shutdown_connections 2023-01-01T17:40:09.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:09.937+0000 7fa519b54700 1 -- 172.21.15.61:0/534041868 wait complete. 2023-01-01T17:40:09.939 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 9 2023-01-01T17:40:09.949 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-01T17:40:10.073 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.074+0000 7fb0d6021700 1 Processor -- start 2023-01-01T17:40:10.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.074+0000 7fb0d6021700 1 -- start start 2023-01-01T17:40:10.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.075+0000 7fb0d6021700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0d00c5630 0x7fb0d006c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:10.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.075+0000 7fb0d6021700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d00c6b60 con 0x7fb0d00a61f0 2023-01-01T17:40:10.077 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.075+0000 7fb0d6021700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d0153550 con 0x7fb0d01539e0 2023-01-01T17:40:10.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.075+0000 7fb0d6021700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d00c6880 con 0x7fb0d00c5630 2023-01-01T17:40:10.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.075+0000 7fb0cffff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fb0d00a61f0 0x7fb0d00c5a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40306/0 (socket says 172.21.15.61:40306) 2023-01-01T17:40:10.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.075+0000 7fb0cffff700 1 -- 172.21.15.61:0/3754675726 learned_addr learned my addr 172.21.15.61:0/3754675726 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:40:10.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.075+0000 7fb0cf7fe700 1 --2- 172.21.15.61:0/3754675726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0d00c5630 0x7fb0d006c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:10.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.075+0000 7fb0ce7fc700 1 -- 172.21.15.61:0/3754675726 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3107608075 0 0) 0x7fb0d00c6b60 con 0x7fb0d00a61f0 2023-01-01T17:40:10.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.075+0000 7fb0ce7fc700 1 -- 172.21.15.61:0/3754675726 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0b80035b0 con 0x7fb0d00a61f0 2023-01-01T17:40:10.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.075+0000 7fb0ce7fc700 1 -- 172.21.15.61:0/3754675726 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4202539361 0 0) 0x7fb0d0153550 con 0x7fb0d01539e0 2023-01-01T17:40:10.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.075+0000 7fb0ce7fc700 1 -- 172.21.15.61:0/3754675726 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0d00c6b60 con 0x7fb0d01539e0 2023-01-01T17:40:10.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.075+0000 7fb0ce7fc700 1 -- 172.21.15.61:0/3754675726 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 712096370 0 0) 0x7fb0b80035b0 con 0x7fb0d00a61f0 2023-01-01T17:40:10.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.075+0000 7fb0ce7fc700 1 -- 172.21.15.61:0/3754675726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0d00c5630 msgr2=0x7fb0d006c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:10.078 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.075+0000 7fb0ce7fc700 1 --2- 172.21.15.61:0/3754675726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0d00c5630 0x7fb0d006c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:10.079 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.075+0000 7fb0ce7fc700 1 -- 172.21.15.61:0/3754675726 >> v1:172.21.15.149:6789/0 conn(0x7fb0d01539e0 legacy=0x7fb0d00c4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:10.079 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.075+0000 7fb0ce7fc700 1 -- 172.21.15.61:0/3754675726 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d0152f00 con 0x7fb0d00a61f0 2023-01-01T17:40:10.079 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.075+0000 7fb0ce7fc700 1 -- 172.21.15.61:0/3754675726 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586489653 0 0) 0x7fb0c80019f0 con 0x7fb0d00a61f0 2023-01-01T17:40:10.079 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.075+0000 7fb0ce7fc700 1 -- 172.21.15.61:0/3754675726 >> v1:172.21.15.61:6789/0 conn(0x7fb0d00a61f0 legacy=0x7fb0d00c5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:10.079 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.075+0000 7fb0ce7fc700 1 --2- 172.21.15.61:0/3754675726 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb0b8003bc0 0x7fb0b8003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:10.079 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.075+0000 7fb0ce7fc700 1 --2- 172.21.15.61:0/3754675726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0d00c5630 0x7fb0b8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:10.079 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.075+0000 7fb0ce7fc700 1 --2- 172.21.15.61:0/3754675726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0b8004d90 0x7fb0b8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:10.079 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.075+0000 7fb0ce7fc700 1 -- 172.21.15.61:0/3754675726 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d00c6880 con 0x7fb0b8003bc0 2023-01-01T17:40:10.079 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.076+0000 7fb0ce7fc700 1 -- 172.21.15.61:0/3754675726 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b800bba0 con 0x7fb0b8004d90 2023-01-01T17:40:10.079 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.076+0000 7fb0ce7fc700 1 -- 172.21.15.61:0/3754675726 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b800bd10 con 0x7fb0d00c5630 2023-01-01T17:40:10.079 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.076+0000 7fb0cf7fe700 1 --2- 172.21.15.61:0/3754675726 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb0b8003bc0 0x7fb0b8003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:10.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.076+0000 7fb0cffff700 1 --2- 172.21.15.61:0/3754675726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0b8004d90 0x7fb0b8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:10.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.076+0000 7fb0ceffd700 1 --2- 172.21.15.61:0/3754675726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0d00c5630 0x7fb0b8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:10.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.076+0000 7fb0cf7fe700 1 -- 172.21.15.61:0/3754675726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0d00c5630 msgr2=0x7fb0b8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:10.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.076+0000 7fb0cf7fe700 1 --2- 172.21.15.61:0/3754675726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0d00c5630 0x7fb0b8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:10.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.076+0000 7fb0cf7fe700 1 -- 172.21.15.61:0/3754675726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0b8004d90 msgr2=0x7fb0b8005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:10.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.076+0000 7fb0cf7fe700 1 --2- 172.21.15.61:0/3754675726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0b8004d90 0x7fb0b8005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:10.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.076+0000 7fb0cf7fe700 1 -- 172.21.15.61:0/3754675726 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b80035b0 con 0x7fb0b8003bc0 2023-01-01T17:40:10.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.076+0000 7fb0cf7fe700 1 --2- 172.21.15.61:0/3754675726 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb0b8003bc0 0x7fb0b8003fb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4009b30 tx=0x7fb0b8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b91ce7b54cefa609 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:10.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.076+0000 7fb0ce7fc700 1 -- 172.21.15.61:0/3754675726 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c400e6c0 con 0x7fb0b8003bc0 2023-01-01T17:40:10.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.076+0000 7fb0ce7fc700 1 -- 172.21.15.61:0/3754675726 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c400e820 con 0x7fb0b8003bc0 2023-01-01T17:40:10.080 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.076+0000 7fb0ce7fc700 1 -- 172.21.15.61:0/3754675726 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c400eb90 con 0x7fb0b8003bc0 2023-01-01T17:40:10.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.077+0000 7fb0d6021700 1 -- 172.21.15.61:0/3754675726 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb0b8003bc0 msgr2=0x7fb0b8003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:10.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.077+0000 7fb0d6021700 1 --2- 172.21.15.61:0/3754675726 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb0b8003bc0 0x7fb0b8003fb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4009b30 tx=0x7fb0b8005880 comp rx=0 tx=0).stop 2023-01-01T17:40:10.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.077+0000 7fb0cffff700 1 -- 172.21.15.61:0/3754675726 reap_dead start 2023-01-01T17:40:10.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.077+0000 7fb0d6021700 1 -- 172.21.15.61:0/3754675726 shutdown_connections 2023-01-01T17:40:10.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.077+0000 7fb0d6021700 1 -- 172.21.15.61:0/3754675726 >> 172.21.15.61:0/3754675726 conn(0x7fb0d00a8900 msgr2=0x7fb0d00a8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:10.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.077+0000 7fb0d6021700 1 -- 172.21.15.61:0/3754675726 shutdown_connections 2023-01-01T17:40:10.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.077+0000 7fb0d6021700 1 -- 172.21.15.61:0/3754675726 wait complete. 2023-01-01T17:40:10.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.078+0000 7fb0d6021700 1 Processor -- start 2023-01-01T17:40:10.081 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.078+0000 7fb0d6021700 1 -- start start 2023-01-01T17:40:10.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.079+0000 7fb0d6021700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0b8003bc0 0x7fb0d0155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:10.084 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.079+0000 7fb0d6021700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb0d00c09e0 0x7fb0d01eb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:10.085 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.079+0000 7fb0d6021700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0d01ebf00 0x7fb0d014e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:10.085 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.079+0000 7fb0d6021700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d00aa140 con 0x7fb0d00c09e0 2023-01-01T17:40:10.085 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.079+0000 7fb0d6021700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d00bff90 con 0x7fb0d01ebf00 2023-01-01T17:40:10.085 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.079+0000 7fb0d6021700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d00aa360 con 0x7fb0b8003bc0 2023-01-01T17:40:10.085 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.079+0000 7fb0ceffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb0d00c09e0 0x7fb0d01eb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:10.085 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.079+0000 7fb0ceffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb0d00c09e0 0x7fb0d01eb9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46466/0 (socket says 172.21.15.61:46466) 2023-01-01T17:40:10.085 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.079+0000 7fb0ceffd700 1 -- 172.21.15.61:0/2943001257 learned_addr learned my addr 172.21.15.61:0/2943001257 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:10.085 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.079+0000 7fb0cf7fe700 1 --2- 172.21.15.61:0/2943001257 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0b8003bc0 0x7fb0d0155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:10.085 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.079+0000 7fb0cffff700 1 --2- 172.21.15.61:0/2943001257 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0d01ebf00 0x7fb0d014e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:10.085 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.079+0000 7fb0ceffd700 1 -- 172.21.15.61:0/2943001257 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0b8003bc0 msgr2=0x7fb0d0155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:10.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.079+0000 7fb0ceffd700 1 --2- 172.21.15.61:0/2943001257 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0b8003bc0 0x7fb0d0155120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:10.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.079+0000 7fb0ceffd700 1 -- 172.21.15.61:0/2943001257 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0d01ebf00 msgr2=0x7fb0d014e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:10.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.079+0000 7fb0ceffd700 1 --2- 172.21.15.61:0/2943001257 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0d01ebf00 0x7fb0d014e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:10.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.079+0000 7fb0ceffd700 1 -- 172.21.15.61:0/2943001257 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d00c5320 con 0x7fb0d00c09e0 2023-01-01T17:40:10.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.079+0000 7fb0cffff700 1 --2- 172.21.15.61:0/2943001257 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0d01ebf00 0x7fb0d014e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-01-01T17:40:10.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.079+0000 7fb0cf7fe700 1 --2- 172.21.15.61:0/2943001257 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0b8003bc0 0x7fb0d0155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-01-01T17:40:10.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.079+0000 7fb0ceffd700 1 --2- 172.21.15.61:0/2943001257 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb0d00c09e0 0x7fb0d01eb9c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb0c000f830 tx=0x7fb0c000fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:10.086 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.079+0000 7fb0b7fff700 1 -- 172.21.15.61:0/2943001257 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c00052e0 con 0x7fb0d00c09e0 2023-01-01T17:40:10.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.079+0000 7fb0b7fff700 1 -- 172.21.15.61:0/2943001257 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c0005440 con 0x7fb0d00c09e0 2023-01-01T17:40:10.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.080+0000 7fb0d6021700 1 -- 172.21.15.61:0/2943001257 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d01531e0 con 0x7fb0d00c09e0 2023-01-01T17:40:10.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.080+0000 7fb0b7fff700 1 -- 172.21.15.61:0/2943001257 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c00038c0 con 0x7fb0d00c09e0 2023-01-01T17:40:10.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.080+0000 7fb0d6021700 1 -- 172.21.15.61:0/2943001257 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d00c6110 con 0x7fb0d00c09e0 2023-01-01T17:40:10.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.081+0000 7fb0d6021700 1 -- 172.21.15.61:0/2943001257 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0d00aa850 con 0x7fb0d00c09e0 2023-01-01T17:40:10.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.081+0000 7fb0b7fff700 1 -- 172.21.15.61:0/2943001257 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7fb0c0003a20 con 0x7fb0d00c09e0 2023-01-01T17:40:10.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.081+0000 7fb0b7fff700 1 --2- 172.21.15.61:0/2943001257 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fb0bc063290 0x7fb0bc065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:10.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.081+0000 7fb0b7fff700 1 -- 172.21.15.61:0/2943001257 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb0c007fde0 con 0x7fb0d00c09e0 2023-01-01T17:40:10.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.081+0000 7fb0cf7fe700 1 --2- 172.21.15.61:0/2943001257 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fb0bc063290 0x7fb0bc065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:10.087 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.082+0000 7fb0cf7fe700 1 --2- 172.21.15.61:0/2943001257 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fb0bc063290 0x7fb0bc065740 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb0d00c5fd0 tx=0x7fb0c4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:10.088 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.086+0000 7fb0b7fff700 1 -- 172.21.15.61:0/2943001257 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7fb0c004eba0 con 0x7fb0d00c09e0 2023-01-01T17:40:10.276 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.277+0000 7fb0d6021700 1 -- 172.21.15.61:0/2943001257 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0d00668a0 con 0x7fb0d00c09e0 2023-01-01T17:40:10.277 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.278+0000 7fb0b7fff700 1 -- 172.21.15.61:0/2943001257 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18729 (secure 0 0 0) 0x7fb0c0003cb0 con 0x7fb0d00c09e0 2023-01-01T17:40:10.278 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:40:10.278 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":24,"fsid":"fe0d3d8e-46ee-4ed9-92f8-749741721d01","created":"2023-01-01T17:39:34.752404+0000","modified":"2023-01-01T17:39:57.386830+0000","last_up_change":"2023-01-01T17:39:45.159720+0000","last_in_change":"2023-01-01T17:39:37.293057+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-01-01T17:39:46.110776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-01-01T17:39:46.276625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-01-01T17:39:50.568073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-01-01T17:39:51.915351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-01-01T17:39:54.992107+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5ba13bcd-4407-4cfd-8487-80917501e525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":94349},{"type":"v1","addr":"172.21.15.61:6825","nonce":94349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":94349},{"type":"v1","addr":"172.21.15.61:6827","nonce":94349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":94349},{"type":"v1","addr":"172.21.15.61:6831","nonce":94349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":94349},{"type":"v1","addr":"172.21.15.61:6829","nonce":94349}]},"public_addr":"172.21.15.61:6825/94349","cluster_addr":"172.21.15.61:6827/94349","heartbeat_back_addr":"172.21.15.61:6831/94349","heartbeat_front_addr":"172.21.15.61:6829/94349","state":["exists","up"]},{"osd":1,"uuid":"7dca9f34-ea22-4894-b238-5606b16b9c74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6811","nonce":94348},{"type":"v1","addr":"172.21.15.61:6813","nonce":94348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":94348},{"type":"v1","addr":"172.21.15.61:6816","nonce":94348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6821","nonce":94348},{"type":"v1","addr":"172.21.15.61:6823","nonce":94348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":94348},{"type":"v1","addr":"172.21.15.61:6819","nonce":94348}]},"public_addr":"172.21.15.61:6813/94348","cluster_addr":"172.21.15.61:6816/94348","heartbeat_back_addr":"172.21.15.61:6823/94348","heartbeat_front_addr":"172.21.15.61:6819/94348","state":["exists","up"]},{"osd":2,"uuid":"7b43ea06-a7b6-49f4-a390-18ad14dfe4fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":94350},{"type":"v1","addr":"172.21.15.61:6809","nonce":94350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":94350},{"type":"v1","addr":"172.21.15.61:6812","nonce":94350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":94350},{"type":"v1","addr":"172.21.15.61:6822","nonce":94350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6815","nonce":94350},{"type":"v1","addr":"172.21.15.61:6817","nonce":94350}]},"public_addr":"172.21.15.61:6809/94350","cluster_addr":"172.21.15.61:6812/94350","heartbeat_back_addr":"172.21.15.61:6822/94350","heartbeat_front_addr":"172.21.15.61:6817/94350","state":["exists","up"]},{"osd":3,"uuid":"117c41d8-d40c-4cc0-b0e1-70bca058fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":94347},{"type":"v1","addr":"172.21.15.61:6801","nonce":94347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":94347},{"type":"v1","addr":"172.21.15.61:6803","nonce":94347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":94347},{"type":"v1","addr":"172.21.15.61:6807","nonce":94347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":94347},{"type":"v1","addr":"172.21.15.61:6805","nonce":94347}]},"public_addr":"172.21.15.61:6801/94347","cluster_addr":"172.21.15.61:6803/94347","heartbeat_back_addr":"172.21.15.61:6807/94347","heartbeat_front_addr":"172.21.15.61:6805/94347","state":["exists","up"]},{"osd":4,"uuid":"4073e0e8-c5dd-463f-aa1c-c9515ef09976","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":94711},{"type":"v1","addr":"172.21.15.149:6818","nonce":94711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":94711},{"type":"v1","addr":"172.21.15.149:6822","nonce":94711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":94711},{"type":"v1","addr":"172.21.15.149:6830","nonce":94711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":94711},{"type":"v1","addr":"172.21.15.149:6826","nonce":94711}]},"public_addr":"172.21.15.149:6818/94711","cluster_addr":"172.21.15.149:6822/94711","heartbeat_back_addr":"172.21.15.149:6830/94711","heartbeat_front_addr":"172.21.15.149:6826/94711","state":["exists","up"]},{"osd":5,"uuid":"88aa0c0f-e3c1-4dd3-af8c-61f4bc28504e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":94709},{"type":"v1","addr":"172.21.15.149:6809","nonce":94709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":94709},{"type":"v1","addr":"172.21.15.149:6811","nonce":94709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":94709},{"type":"v1","addr":"172.21.15.149:6815","nonce":94709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":94709},{"type":"v1","addr":"172.21.15.149:6813","nonce":94709}]},"public_addr":"172.21.15.149:6809/94709","cluster_addr":"172.21.15.149:6811/94709","heartbeat_back_addr":"172.21.15.149:6815/94709","heartbeat_front_addr":"172.21.15.149:6813/94709","state":["exists","up"]},{"osd":6,"uuid":"8b13fc0c-5f00-41c7-8923-c4570da77afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":94710},{"type":"v1","addr":"172.21.15.149:6801","nonce":94710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":94710},{"type":"v1","addr":"172.21.15.149:6803","nonce":94710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":94710},{"type":"v1","addr":"172.21.15.149:6807","nonce":94710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":94710},{"type":"v1","addr":"172.21.15.149:6805","nonce":94710}]},"public_addr":"172.21.15.149:6801/94710","cluster_addr":"172.21.15.149:6803/94710","heartbeat_back_addr":"172.21.15.149:6807/94710","heartbeat_front_addr":"172.21.15.149:6805/94710","state":["exists","up"]},{"osd":7,"uuid":"5390c6e5-39e7-4aa6-b73c-642458b2acf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":94734},{"type":"v1","addr":"172.21.15.149:6819","nonce":94734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":94734},{"type":"v1","addr":"172.21.15.149:6823","nonce":94734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":94734},{"type":"v1","addr":"172.21.15.149:6831","nonce":94734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":94734},{"type":"v1","addr":"172.21.15.149:6827","nonce":94734}]},"public_addr":"172.21.15.149:6819/94734","cluster_addr":"172.21.15.149:6823/94734","heartbeat_back_addr":"172.21.15.149:6831/94734","heartbeat_front_addr":"172.21.15.149:6827/94734","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.555826+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.508739+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.515601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.472067+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.535257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.493397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.554910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.552343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-01T17:40:10.279 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.280+0000 7fb0d6021700 1 -- 172.21.15.61:0/2943001257 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fb0bc063290 msgr2=0x7fb0bc065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:10.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.280+0000 7fb0d6021700 1 --2- 172.21.15.61:0/2943001257 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fb0bc063290 0x7fb0bc065740 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb0d00c5fd0 tx=0x7fb0c4008030 comp rx=0 tx=0).stop 2023-01-01T17:40:10.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.280+0000 7fb0d6021700 1 -- 172.21.15.61:0/2943001257 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb0d00c09e0 msgr2=0x7fb0d01eb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:10.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.280+0000 7fb0d6021700 1 --2- 172.21.15.61:0/2943001257 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb0d00c09e0 0x7fb0d01eb9c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb0c000f830 tx=0x7fb0c000fbf0 comp rx=0 tx=0).stop 2023-01-01T17:40:10.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.280+0000 7fb0d6021700 1 -- 172.21.15.61:0/2943001257 shutdown_connections 2023-01-01T17:40:10.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.280+0000 7fb0d6021700 1 --2- 172.21.15.61:0/2943001257 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0d01ebf00 0x7fb0d014e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:10.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.280+0000 7fb0d6021700 1 --2- 172.21.15.61:0/2943001257 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0b8003bc0 0x7fb0d0155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:10.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.280+0000 7fb0d6021700 1 --2- 172.21.15.61:0/2943001257 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fb0bc063290 0x7fb0bc065740 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:10.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.280+0000 7fb0d6021700 1 --2- 172.21.15.61:0/2943001257 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb0d00c09e0 0x7fb0d01eb9c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:10.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.280+0000 7fb0d6021700 1 -- 172.21.15.61:0/2943001257 >> 172.21.15.61:0/2943001257 conn(0x7fb0d00a8900 msgr2=0x7fb0d00a6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:10.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.280+0000 7fb0d6021700 1 -- 172.21.15.61:0/2943001257 shutdown_connections 2023-01-01T17:40:10.280 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.280+0000 7fb0d6021700 1 -- 172.21.15.61:0/2943001257 wait complete. 2023-01-01T17:40:10.292 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-01-01T17:40:10.292 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-01T17:40:10.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.417+0000 7fed73a47700 1 Processor -- start 2023-01-01T17:40:10.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.418+0000 7fed73a47700 1 -- start start 2023-01-01T17:40:10.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.418+0000 7fed73a47700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fed6c0a41b0 0x7fed6c06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:10.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.418+0000 7fed73a47700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed6c0c4340 0x7fed6c070320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:10.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.418+0000 7fed73a47700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed6c06f780 con 0x7fed6c06c2c0 2023-01-01T17:40:10.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.418+0000 7fed73a47700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed6c06f450 con 0x7fed6c0a41b0 2023-01-01T17:40:10.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.418+0000 7fed73a47700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed6c0c39b0 con 0x7fed6c0c4340 2023-01-01T17:40:10.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.419+0000 7fed71fe4700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed6c0c4340 0x7fed6c070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:10.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.419+0000 7fed71fe4700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed6c0c4340 0x7fed6c070320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.61:44716/0 (socket says 172.21.15.61:44716) 2023-01-01T17:40:10.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.419+0000 7fed71fe4700 1 -- 172.21.15.61:0/1683732185 learned_addr learned my addr 172.21.15.61:0/1683732185 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:10.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.419+0000 7fed717e3700 1 --2- 172.21.15.61:0/1683732185 >> v2:172.21.15.149:3300/0 conn(0x7fed6c0a41b0 0x7fed6c06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:10.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.419+0000 7fed71fe4700 1 -- 172.21.15.61:0/1683732185 >> v2:172.21.15.149:3300/0 conn(0x7fed6c0a41b0 msgr2=0x7fed6c06bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:10.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.419+0000 7fed71fe4700 1 --2- 172.21.15.61:0/1683732185 >> v2:172.21.15.149:3300/0 conn(0x7fed6c0a41b0 0x7fed6c06bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:10.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.419+0000 7fed71fe4700 1 -- 172.21.15.61:0/1683732185 >> v1:172.21.15.149:6789/0 conn(0x7fed6c06c2c0 legacy=0x7fed6c06fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:10.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.419+0000 7fed71fe4700 1 -- 172.21.15.61:0/1683732185 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6c0c3c90 con 0x7fed6c0c4340 2023-01-01T17:40:10.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.419+0000 7fed71fe4700 1 --2- 172.21.15.61:0/1683732185 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed6c0c4340 0x7fed6c070320 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fed6400d180 tx=0x7fed6400d490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b75e1f122b2f6aa server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:10.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.419+0000 7fed5ffff700 1 -- 172.21.15.61:0/1683732185 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed64010070 con 0x7fed6c0c4340 2023-01-01T17:40:10.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.419+0000 7fed5ffff700 1 -- 172.21.15.61:0/1683732185 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed6400dd00 con 0x7fed6c0c4340 2023-01-01T17:40:10.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.419+0000 7fed5ffff700 1 -- 172.21.15.61:0/1683732185 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6400b310 con 0x7fed6c0c4340 2023-01-01T17:40:10.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.420+0000 7fed73a47700 1 -- 172.21.15.61:0/1683732185 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed6c0c4340 msgr2=0x7fed6c070320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:10.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.420+0000 7fed73a47700 1 --2- 172.21.15.61:0/1683732185 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed6c0c4340 0x7fed6c070320 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fed6400d180 tx=0x7fed6400d490 comp rx=0 tx=0).stop 2023-01-01T17:40:10.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.420+0000 7fed73a47700 1 -- 172.21.15.61:0/1683732185 shutdown_connections 2023-01-01T17:40:10.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.420+0000 7fed73a47700 1 --2- 172.21.15.61:0/1683732185 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed6c0c4340 0x7fed6c070320 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:10.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.420+0000 7fed73a47700 1 --2- 172.21.15.61:0/1683732185 >> v2:172.21.15.149:3300/0 conn(0x7fed6c0a41b0 0x7fed6c06bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:10.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.420+0000 7fed73a47700 1 -- 172.21.15.61:0/1683732185 >> 172.21.15.61:0/1683732185 conn(0x7fed6c0a6740 msgr2=0x7fed6c0a6b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:10.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.420+0000 7fed73a47700 1 -- 172.21.15.61:0/1683732185 shutdown_connections 2023-01-01T17:40:10.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.420+0000 7fed73a47700 1 -- 172.21.15.61:0/1683732185 wait complete. 2023-01-01T17:40:10.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.421+0000 7fed73a47700 1 Processor -- start 2023-01-01T17:40:10.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.421+0000 7fed73a47700 1 -- start start 2023-01-01T17:40:10.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.422+0000 7fed73a47700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed6c06c2c0 0x7fed6c14df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:10.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.422+0000 7fed73a47700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed6c0a41b0 0x7fed6c1dbb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:10.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.422+0000 7fed73a47700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed6c0c4340 0x7fed6c14d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:10.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.422+0000 7fed73a47700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6c1dad50 con 0x7fed6c06c2c0 2023-01-01T17:40:10.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.422+0000 7fed73a47700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6c1d9df0 con 0x7fed6c0c4340 2023-01-01T17:40:10.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.422+0000 7fed73a47700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed6c1da0d0 con 0x7fed6c0a41b0 2023-01-01T17:40:10.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.422+0000 7fed717e3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed6c06c2c0 0x7fed6c14df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:10.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.422+0000 7fed717e3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed6c06c2c0 0x7fed6c14df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46478/0 (socket says 172.21.15.61:46478) 2023-01-01T17:40:10.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.422+0000 7fed717e3700 1 -- 172.21.15.61:0/4016344877 learned_addr learned my addr 172.21.15.61:0/4016344877 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:10.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.422+0000 7fed70fe2700 1 --2- 172.21.15.61:0/4016344877 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed6c0a41b0 0x7fed6c1dbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:10.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.422+0000 7fed71fe4700 1 --2- 172.21.15.61:0/4016344877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed6c0c4340 0x7fed6c14d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:10.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.422+0000 7fed717e3700 1 -- 172.21.15.61:0/4016344877 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed6c0a41b0 msgr2=0x7fed6c1dbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:10.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.422+0000 7fed717e3700 1 --2- 172.21.15.61:0/4016344877 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed6c0a41b0 0x7fed6c1dbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:10.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.422+0000 7fed717e3700 1 -- 172.21.15.61:0/4016344877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed6c0c4340 msgr2=0x7fed6c14d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:10.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.422+0000 7fed717e3700 1 --2- 172.21.15.61:0/4016344877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed6c0c4340 0x7fed6c14d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:10.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.422+0000 7fed717e3700 1 -- 172.21.15.61:0/4016344877 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6400bd40 con 0x7fed6c06c2c0 2023-01-01T17:40:10.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.422+0000 7fed71fe4700 1 --2- 172.21.15.61:0/4016344877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed6c0c4340 0x7fed6c14d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-01T17:40:10.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.422+0000 7fed70fe2700 1 --2- 172.21.15.61:0/4016344877 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed6c0a41b0 0x7fed6c1dbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-01T17:40:10.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.423+0000 7fed717e3700 1 --2- 172.21.15.61:0/4016344877 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed6c06c2c0 0x7fed6c14df10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fed6800e9b0 tx=0x7fed6800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:10.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.423+0000 7fed5dffb700 1 -- 172.21.15.61:0/4016344877 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed68009710 con 0x7fed6c06c2c0 2023-01-01T17:40:10.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.423+0000 7fed5dffb700 1 -- 172.21.15.61:0/4016344877 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed6800c850 con 0x7fed6c06c2c0 2023-01-01T17:40:10.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.423+0000 7fed5dffb700 1 -- 172.21.15.61:0/4016344877 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6800cbc0 con 0x7fed6c06c2c0 2023-01-01T17:40:10.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.423+0000 7fed73a47700 1 -- 172.21.15.61:0/4016344877 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed6c070860 con 0x7fed6c06c2c0 2023-01-01T17:40:10.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.423+0000 7fed73a47700 1 -- 172.21.15.61:0/4016344877 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed6c0c3f70 con 0x7fed6c06c2c0 2023-01-01T17:40:10.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.424+0000 7fed73a47700 1 -- 172.21.15.61:0/4016344877 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed6c0bf590 con 0x7fed6c06c2c0 2023-01-01T17:40:10.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.424+0000 7fed5dffb700 1 -- 172.21.15.61:0/4016344877 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7fed68019030 con 0x7fed6c06c2c0 2023-01-01T17:40:10.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.425+0000 7fed5dffb700 1 --2- 172.21.15.61:0/4016344877 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fed50063290 0x7fed50065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:10.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.425+0000 7fed5dffb700 1 -- 172.21.15.61:0/4016344877 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fed6807fe60 con 0x7fed6c06c2c0 2023-01-01T17:40:10.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.425+0000 7fed70fe2700 1 --2- 172.21.15.61:0/4016344877 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fed50063290 0x7fed50065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:10.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.425+0000 7fed70fe2700 1 --2- 172.21.15.61:0/4016344877 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fed50063290 0x7fed50065740 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fed6c1dc3e0 tx=0x7fed60009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:10.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.429+0000 7fed5dffb700 1 -- 172.21.15.61:0/4016344877 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7fed6804eab0 con 0x7fed6c06c2c0 2023-01-01T17:40:10.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.617+0000 7fed73a47700 1 -- 172.21.15.61:0/4016344877 --> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fed6c066190 con 0x7fed50063290 2023-01-01T17:40:10.627 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.628+0000 7fed5dffb700 1 -- 172.21.15.61:0/4016344877 <== mgr.4101 v2:172.21.15.61:6832/94075 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367575 (secure 0 0 0) 0x7fed6c066190 con 0x7fed50063290 2023-01-01T17:40:10.631 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:40:10.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.631+0000 7fed73a47700 1 -- 172.21.15.61:0/4016344877 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fed50063290 msgr2=0x7fed50065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:10.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.631+0000 7fed73a47700 1 --2- 172.21.15.61:0/4016344877 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fed50063290 0x7fed50065740 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fed6c1dc3e0 tx=0x7fed60009040 comp rx=0 tx=0).stop 2023-01-01T17:40:10.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.631+0000 7fed73a47700 1 -- 172.21.15.61:0/4016344877 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed6c06c2c0 msgr2=0x7fed6c14df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:10.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.631+0000 7fed73a47700 1 --2- 172.21.15.61:0/4016344877 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed6c06c2c0 0x7fed6c14df10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fed6800e9b0 tx=0x7fed6800ed70 comp rx=0 tx=0).stop 2023-01-01T17:40:10.634 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.631+0000 7fed73a47700 1 -- 172.21.15.61:0/4016344877 shutdown_connections 2023-01-01T17:40:10.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.631+0000 7fed73a47700 1 --2- 172.21.15.61:0/4016344877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed6c0c4340 0x7fed6c14d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:10.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.631+0000 7fed73a47700 1 --2- 172.21.15.61:0/4016344877 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fed50063290 0x7fed50065740 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:10.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.631+0000 7fed73a47700 1 --2- 172.21.15.61:0/4016344877 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fed6c06c2c0 0x7fed6c14df10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:10.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.631+0000 7fed73a47700 1 --2- 172.21.15.61:0/4016344877 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fed6c0a41b0 0x7fed6c1dbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:10.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.631+0000 7fed73a47700 1 -- 172.21.15.61:0/4016344877 >> 172.21.15.61:0/4016344877 conn(0x7fed6c0a6740 msgr2=0x7fed6c06b650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:10.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.631+0000 7fed73a47700 1 -- 172.21.15.61:0/4016344877 shutdown_connections 2023-01-01T17:40:10.635 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.632+0000 7fed73a47700 1 -- 172.21.15.61:0/4016344877 wait complete. 2023-01-01T17:40:10.635 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-01-01T17:40:10.644 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2023-01-01T17:40:10.226616+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":68672,"kb_used_data":2176,"kb_used_omap":0,"kb_used_meta":66432,"kb_avail":754906048,"statfs":{"total":773094113280,"available":773023793152,"internally_reserved":0,"allocated":2228224,"data_stored":2027542,"data_compressed":64598,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":68026368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002575"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966937+0000","last_change":"2023-01-01T17:39:52.963330+0000","last_active":"2023-01-01T17:39:56.966937+0000","last_peered":"2023-01-01T17:39:56.966937+0000","last_clean":"2023-01-01T17:39:56.966937+0000","last_became_active":"2023-01-01T17:39:52.962891+0000","last_became_peered":"2023-01-01T17:39:52.962891+0000","last_unstale":"2023-01-01T17:39:56.966937+0000","last_undegraded":"2023-01-01T17:39:56.966937+0000","last_fullsized":"2023-01-01T17:39:56.966937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:04:10.357667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971778+0000","last_change":"2023-01-01T17:39:52.971796+0000","last_active":"2023-01-01T17:39:56.971778+0000","last_peered":"2023-01-01T17:39:56.971778+0000","last_clean":"2023-01-01T17:39:56.971778+0000","last_became_active":"2023-01-01T17:39:52.971531+0000","last_became_peered":"2023-01-01T17:39:52.971531+0000","last_unstale":"2023-01-01T17:39:56.971778+0000","last_undegraded":"2023-01-01T17:39:56.971778+0000","last_fullsized":"2023-01-01T17:39:56.971778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:27:49.306438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.973554+0000","last_change":"2023-01-01T17:39:52.964674+0000","last_active":"2023-01-01T17:39:56.973554+0000","last_peered":"2023-01-01T17:39:56.973554+0000","last_clean":"2023-01-01T17:39:56.973554+0000","last_became_active":"2023-01-01T17:39:52.964407+0000","last_became_peered":"2023-01-01T17:39:52.964407+0000","last_unstale":"2023-01-01T17:39:56.973554+0000","last_undegraded":"2023-01-01T17:39:56.973554+0000","last_fullsized":"2023-01-01T17:39:56.973554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:04:29.930818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.980904+0000","last_change":"2023-01-01T17:39:52.961108+0000","last_active":"2023-01-01T17:39:56.980904+0000","last_peered":"2023-01-01T17:39:56.980904+0000","last_clean":"2023-01-01T17:39:56.980904+0000","last_became_active":"2023-01-01T17:39:52.960846+0000","last_became_peered":"2023-01-01T17:39:52.960846+0000","last_unstale":"2023-01-01T17:39:56.980904+0000","last_undegraded":"2023-01-01T17:39:56.980904+0000","last_fullsized":"2023-01-01T17:39:56.980904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:04:29.980357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.969138+0000","last_change":"2023-01-01T17:39:52.968144+0000","last_active":"2023-01-01T17:39:56.969138+0000","last_peered":"2023-01-01T17:39:56.969138+0000","last_clean":"2023-01-01T17:39:56.969138+0000","last_became_active":"2023-01-01T17:39:52.965674+0000","last_became_peered":"2023-01-01T17:39:52.965674+0000","last_unstale":"2023-01-01T17:39:56.969138+0000","last_undegraded":"2023-01-01T17:39:56.969138+0000","last_fullsized":"2023-01-01T17:39:56.969138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:38:10.525560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.974768+0000","last_change":"2023-01-01T17:39:52.964599+0000","last_active":"2023-01-01T17:39:56.974768+0000","last_peered":"2023-01-01T17:39:56.974768+0000","last_clean":"2023-01-01T17:39:56.974768+0000","last_became_active":"2023-01-01T17:39:52.964336+0000","last_became_peered":"2023-01-01T17:39:52.964336+0000","last_unstale":"2023-01-01T17:39:56.974768+0000","last_undegraded":"2023-01-01T17:39:56.974768+0000","last_fullsized":"2023-01-01T17:39:56.974768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:02:42.190753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966415+0000","last_change":"2023-01-01T17:39:52.960039+0000","last_active":"2023-01-01T17:39:56.966415+0000","last_peered":"2023-01-01T17:39:56.966415+0000","last_clean":"2023-01-01T17:39:56.966415+0000","last_became_active":"2023-01-01T17:39:52.959724+0000","last_became_peered":"2023-01-01T17:39:52.959724+0000","last_unstale":"2023-01-01T17:39:56.966415+0000","last_undegraded":"2023-01-01T17:39:56.966415+0000","last_fullsized":"2023-01-01T17:39:56.966415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T22:42:37.419622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.970407+0000","last_change":"2023-01-01T17:39:52.963027+0000","last_active":"2023-01-01T17:39:56.970407+0000","last_peered":"2023-01-01T17:39:56.970407+0000","last_clean":"2023-01-01T17:39:56.970407+0000","last_became_active":"2023-01-01T17:39:52.962713+0000","last_became_peered":"2023-01-01T17:39:52.962713+0000","last_unstale":"2023-01-01T17:39:56.970407+0000","last_undegraded":"2023-01-01T17:39:56.970407+0000","last_fullsized":"2023-01-01T17:39:56.970407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T22:42:37.419622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966304+0000","last_change":"2023-01-01T17:39:52.967957+0000","last_active":"2023-01-01T17:39:56.966304+0000","last_peered":"2023-01-01T17:39:56.966304+0000","last_clean":"2023-01-01T17:39:56.966304+0000","last_became_active":"2023-01-01T17:39:52.967249+0000","last_became_peered":"2023-01-01T17:39:52.967249+0000","last_unstale":"2023-01-01T17:39:56.966304+0000","last_undegraded":"2023-01-01T17:39:56.966304+0000","last_fullsized":"2023-01-01T17:39:56.966304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:39:12.933552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971966+0000","last_change":"2023-01-01T17:39:52.966701+0000","last_active":"2023-01-01T17:39:56.971966+0000","last_peered":"2023-01-01T17:39:56.971966+0000","last_clean":"2023-01-01T17:39:56.971966+0000","last_became_active":"2023-01-01T17:39:52.966423+0000","last_became_peered":"2023-01-01T17:39:52.966423+0000","last_unstale":"2023-01-01T17:39:56.971966+0000","last_undegraded":"2023-01-01T17:39:56.971966+0000","last_fullsized":"2023-01-01T17:39:56.971966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:12:40.598666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.972841+0000","last_change":"2023-01-01T17:39:52.961555+0000","last_active":"2023-01-01T17:39:56.972841+0000","last_peered":"2023-01-01T17:39:56.972841+0000","last_clean":"2023-01-01T17:39:56.972841+0000","last_became_active":"2023-01-01T17:39:52.961192+0000","last_became_peered":"2023-01-01T17:39:52.961192+0000","last_unstale":"2023-01-01T17:39:56.972841+0000","last_undegraded":"2023-01-01T17:39:56.972841+0000","last_fullsized":"2023-01-01T17:39:56.972841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:37:22.833792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966452+0000","last_change":"2023-01-01T17:39:52.959421+0000","last_active":"2023-01-01T17:39:56.966452+0000","last_peered":"2023-01-01T17:39:56.966452+0000","last_clean":"2023-01-01T17:39:56.966452+0000","last_became_active":"2023-01-01T17:39:52.959094+0000","last_became_peered":"2023-01-01T17:39:52.959094+0000","last_unstale":"2023-01-01T17:39:56.966452+0000","last_undegraded":"2023-01-01T17:39:56.966452+0000","last_fullsized":"2023-01-01T17:39:56.966452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:06:59.618607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.967485+0000","last_change":"2023-01-01T17:39:52.957064+0000","last_active":"2023-01-01T17:39:56.967485+0000","last_peered":"2023-01-01T17:39:56.967485+0000","last_clean":"2023-01-01T17:39:56.967485+0000","last_became_active":"2023-01-01T17:39:52.956770+0000","last_became_peered":"2023-01-01T17:39:52.956770+0000","last_unstale":"2023-01-01T17:39:56.967485+0000","last_undegraded":"2023-01-01T17:39:56.967485+0000","last_fullsized":"2023-01-01T17:39:56.967485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:05:32.452823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.970532+0000","last_change":"2023-01-01T17:39:52.964133+0000","last_active":"2023-01-01T17:39:56.970532+0000","last_peered":"2023-01-01T17:39:56.970532+0000","last_clean":"2023-01-01T17:39:56.970532+0000","last_became_active":"2023-01-01T17:39:52.963864+0000","last_became_peered":"2023-01-01T17:39:52.963864+0000","last_unstale":"2023-01-01T17:39:56.970532+0000","last_undegraded":"2023-01-01T17:39:56.970532+0000","last_fullsized":"2023-01-01T17:39:56.970532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:21:06.881543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966333+0000","last_change":"2023-01-01T17:39:52.960044+0000","last_active":"2023-01-01T17:39:56.966333+0000","last_peered":"2023-01-01T17:39:56.966333+0000","last_clean":"2023-01-01T17:39:56.966333+0000","last_became_active":"2023-01-01T17:39:52.959767+0000","last_became_peered":"2023-01-01T17:39:52.959767+0000","last_unstale":"2023-01-01T17:39:56.966333+0000","last_undegraded":"2023-01-01T17:39:56.966333+0000","last_fullsized":"2023-01-01T17:39:56.966333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:17:10.326486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.978656+0000","last_change":"2023-01-01T17:39:52.964688+0000","last_active":"2023-01-01T17:39:56.978656+0000","last_peered":"2023-01-01T17:39:56.978656+0000","last_clean":"2023-01-01T17:39:56.978656+0000","last_became_active":"2023-01-01T17:39:52.964376+0000","last_became_peered":"2023-01-01T17:39:52.964376+0000","last_unstale":"2023-01-01T17:39:56.978656+0000","last_undegraded":"2023-01-01T17:39:56.978656+0000","last_fullsized":"2023-01-01T17:39:56.978656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T02:02:52.710038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966403+0000","last_change":"2023-01-01T17:39:52.967459+0000","last_active":"2023-01-01T17:39:56.966403+0000","last_peered":"2023-01-01T17:39:56.966403+0000","last_clean":"2023-01-01T17:39:56.966403+0000","last_became_active":"2023-01-01T17:39:52.965683+0000","last_became_peered":"2023-01-01T17:39:52.965683+0000","last_unstale":"2023-01-01T17:39:56.966403+0000","last_undegraded":"2023-01-01T17:39:56.966403+0000","last_fullsized":"2023-01-01T17:39:56.966403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:17:10.326486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.972847+0000","last_change":"2023-01-01T17:39:52.961461+0000","last_active":"2023-01-01T17:39:56.972847+0000","last_peered":"2023-01-01T17:39:56.972847+0000","last_clean":"2023-01-01T17:39:56.972847+0000","last_became_active":"2023-01-01T17:39:52.961145+0000","last_became_peered":"2023-01-01T17:39:52.961145+0000","last_unstale":"2023-01-01T17:39:56.972847+0000","last_undegraded":"2023-01-01T17:39:56.972847+0000","last_fullsized":"2023-01-01T17:39:56.972847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:20:30.823975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.967766+0000","last_change":"2023-01-01T17:39:52.958062+0000","last_active":"2023-01-01T17:39:56.967766+0000","last_peered":"2023-01-01T17:39:56.967766+0000","last_clean":"2023-01-01T17:39:56.967766+0000","last_became_active":"2023-01-01T17:39:52.957780+0000","last_became_peered":"2023-01-01T17:39:52.957780+0000","last_unstale":"2023-01-01T17:39:56.967766+0000","last_undegraded":"2023-01-01T17:39:56.967766+0000","last_fullsized":"2023-01-01T17:39:56.967766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:47:32.933861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971406+0000","last_change":"2023-01-01T17:39:52.965920+0000","last_active":"2023-01-01T17:39:56.971406+0000","last_peered":"2023-01-01T17:39:56.971406+0000","last_clean":"2023-01-01T17:39:56.971406+0000","last_became_active":"2023-01-01T17:39:52.965681+0000","last_became_peered":"2023-01-01T17:39:52.965681+0000","last_unstale":"2023-01-01T17:39:56.971406+0000","last_undegraded":"2023-01-01T17:39:56.971406+0000","last_fullsized":"2023-01-01T17:39:56.971406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:28:47.766864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.967121+0000","last_change":"2023-01-01T17:39:52.955931+0000","last_active":"2023-01-01T17:39:56.967121+0000","last_peered":"2023-01-01T17:39:56.967121+0000","last_clean":"2023-01-01T17:39:56.967121+0000","last_became_active":"2023-01-01T17:39:52.955405+0000","last_became_peered":"2023-01-01T17:39:52.955405+0000","last_unstale":"2023-01-01T17:39:56.967121+0000","last_undegraded":"2023-01-01T17:39:56.967121+0000","last_fullsized":"2023-01-01T17:39:56.967121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:39:12.933552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966623+0000","last_change":"2023-01-01T17:39:52.972351+0000","last_active":"2023-01-01T17:39:56.966623+0000","last_peered":"2023-01-01T17:39:56.966623+0000","last_clean":"2023-01-01T17:39:56.966623+0000","last_became_active":"2023-01-01T17:39:52.972060+0000","last_became_peered":"2023-01-01T17:39:52.972060+0000","last_unstale":"2023-01-01T17:39:56.966623+0000","last_undegraded":"2023-01-01T17:39:56.966623+0000","last_fullsized":"2023-01-01T17:39:56.966623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:13:17.225019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971864+0000","last_change":"2023-01-01T17:39:52.959545+0000","last_active":"2023-01-01T17:39:56.971864+0000","last_peered":"2023-01-01T17:39:56.971864+0000","last_clean":"2023-01-01T17:39:56.971864+0000","last_became_active":"2023-01-01T17:39:52.959020+0000","last_became_peered":"2023-01-01T17:39:52.959020+0000","last_unstale":"2023-01-01T17:39:56.971864+0000","last_undegraded":"2023-01-01T17:39:56.971864+0000","last_fullsized":"2023-01-01T17:39:56.971864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:20:51.060158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966447+0000","last_change":"2023-01-01T17:39:52.959152+0000","last_active":"2023-01-01T17:39:56.966447+0000","last_peered":"2023-01-01T17:39:56.966447+0000","last_clean":"2023-01-01T17:39:56.966447+0000","last_became_active":"2023-01-01T17:39:52.958925+0000","last_became_peered":"2023-01-01T17:39:52.958925+0000","last_unstale":"2023-01-01T17:39:56.966447+0000","last_undegraded":"2023-01-01T17:39:56.966447+0000","last_fullsized":"2023-01-01T17:39:56.966447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:27:49.306438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.981469+0000","last_change":"2023-01-01T17:39:52.970401+0000","last_active":"2023-01-01T17:39:56.981469+0000","last_peered":"2023-01-01T17:39:56.981469+0000","last_clean":"2023-01-01T17:39:56.981469+0000","last_became_active":"2023-01-01T17:39:52.970123+0000","last_became_peered":"2023-01-01T17:39:52.970123+0000","last_unstale":"2023-01-01T17:39:56.981469+0000","last_undegraded":"2023-01-01T17:39:56.981469+0000","last_fullsized":"2023-01-01T17:39:56.981469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T22:42:37.419622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.981509+0000","last_change":"2023-01-01T17:39:52.966659+0000","last_active":"2023-01-01T17:39:56.981509+0000","last_peered":"2023-01-01T17:39:56.981509+0000","last_clean":"2023-01-01T17:39:56.981509+0000","last_became_active":"2023-01-01T17:39:52.966510+0000","last_became_peered":"2023-01-01T17:39:52.966510+0000","last_unstale":"2023-01-01T17:39:56.981509+0000","last_undegraded":"2023-01-01T17:39:56.981509+0000","last_fullsized":"2023-01-01T17:39:56.981509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:21:06.881543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971060+0000","last_change":"2023-01-01T17:39:52.965968+0000","last_active":"2023-01-01T17:39:56.971060+0000","last_peered":"2023-01-01T17:39:56.971060+0000","last_clean":"2023-01-01T17:39:56.971060+0000","last_became_active":"2023-01-01T17:39:52.965515+0000","last_became_peered":"2023-01-01T17:39:52.965515+0000","last_unstale":"2023-01-01T17:39:56.971060+0000","last_undegraded":"2023-01-01T17:39:56.971060+0000","last_fullsized":"2023-01-01T17:39:56.971060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:39:12.933552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.832942+0000","last_change":"2023-01-01T17:39:56.985909+0000","last_active":"2023-01-01T17:39:58.832942+0000","last_peered":"2023-01-01T17:39:58.832942+0000","last_clean":"2023-01-01T17:39:58.832942+0000","last_became_active":"2023-01-01T17:39:56.985529+0000","last_became_peered":"2023-01-01T17:39:56.985529+0000","last_unstale":"2023-01-01T17:39:58.832942+0000","last_undegraded":"2023-01-01T17:39:58.832942+0000","last_fullsized":"2023-01-01T17:39:58.832942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:52:49.314145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.973444+0000","last_change":"2023-01-01T17:39:52.544503+0000","last_active":"2023-01-01T17:39:56.973444+0000","last_peered":"2023-01-01T17:39:56.973444+0000","last_clean":"2023-01-01T17:39:56.973444+0000","last_became_active":"2023-01-01T17:39:52.544174+0000","last_became_peered":"2023-01-01T17:39:52.544174+0000","last_unstale":"2023-01-01T17:39:56.973444+0000","last_undegraded":"2023-01-01T17:39:56.973444+0000","last_fullsized":"2023-01-01T17:39:56.973444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:04:09.352850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.975913+0000","last_change":"2023-01-01T17:39:52.961218+0000","last_active":"2023-01-01T17:39:56.975913+0000","last_peered":"2023-01-01T17:39:56.975913+0000","last_clean":"2023-01-01T17:39:56.975913+0000","last_became_active":"2023-01-01T17:39:52.960909+0000","last_became_peered":"2023-01-01T17:39:52.960909+0000","last_unstale":"2023-01-01T17:39:56.975913+0000","last_undegraded":"2023-01-01T17:39:56.975913+0000","last_fullsized":"2023-01-01T17:39:56.975913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:27:49.306438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.397722+0000","last_change":"2023-01-01T17:39:56.983018+0000","last_active":"2023-01-01T17:39:57.397722+0000","last_peered":"2023-01-01T17:39:57.397722+0000","last_clean":"2023-01-01T17:39:57.397722+0000","last_became_active":"2023-01-01T17:39:56.981943+0000","last_became_peered":"2023-01-01T17:39:56.981943+0000","last_unstale":"2023-01-01T17:39:57.397722+0000","last_undegraded":"2023-01-01T17:39:57.397722+0000","last_fullsized":"2023-01-01T17:39:57.397722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:53:49.928875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.980811+0000","last_change":"2023-01-01T17:39:52.548955+0000","last_active":"2023-01-01T17:39:56.980811+0000","last_peered":"2023-01-01T17:39:56.980811+0000","last_clean":"2023-01-01T17:39:56.980811+0000","last_became_active":"2023-01-01T17:39:52.548746+0000","last_became_peered":"2023-01-01T17:39:52.548746+0000","last_unstale":"2023-01-01T17:39:56.980811+0000","last_undegraded":"2023-01-01T17:39:56.980811+0000","last_fullsized":"2023-01-01T17:39:56.980811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:48:45.787227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.968330+0000","last_change":"2023-01-01T17:39:52.967463+0000","last_active":"2023-01-01T17:39:56.968330+0000","last_peered":"2023-01-01T17:39:56.968330+0000","last_clean":"2023-01-01T17:39:56.968330+0000","last_became_active":"2023-01-01T17:39:52.965478+0000","last_became_peered":"2023-01-01T17:39:52.965478+0000","last_unstale":"2023-01-01T17:39:56.968330+0000","last_undegraded":"2023-01-01T17:39:56.968330+0000","last_fullsized":"2023-01-01T17:39:56.968330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T05:06:34.299709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.437445+0000","last_change":"2023-01-01T17:39:56.986080+0000","last_active":"2023-01-01T17:39:57.437445+0000","last_peered":"2023-01-01T17:39:57.437445+0000","last_clean":"2023-01-01T17:39:57.437445+0000","last_became_active":"2023-01-01T17:39:56.985584+0000","last_became_peered":"2023-01-01T17:39:56.985584+0000","last_unstale":"2023-01-01T17:39:57.437445+0000","last_undegraded":"2023-01-01T17:39:57.437445+0000","last_fullsized":"2023-01-01T17:39:57.437445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:14:54.324576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971939+0000","last_change":"2023-01-01T17:39:52.542192+0000","last_active":"2023-01-01T17:39:56.971939+0000","last_peered":"2023-01-01T17:39:56.971939+0000","last_clean":"2023-01-01T17:39:56.971939+0000","last_became_active":"2023-01-01T17:39:52.541722+0000","last_became_peered":"2023-01-01T17:39:52.541722+0000","last_unstale":"2023-01-01T17:39:56.971939+0000","last_undegraded":"2023-01-01T17:39:56.971939+0000","last_fullsized":"2023-01-01T17:39:56.971939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:05:31.448005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.981286+0000","last_change":"2023-01-01T17:39:52.963441+0000","last_active":"2023-01-01T17:39:56.981286+0000","last_peered":"2023-01-01T17:39:56.981286+0000","last_clean":"2023-01-01T17:39:56.981286+0000","last_became_active":"2023-01-01T17:39:52.963185+0000","last_became_peered":"2023-01-01T17:39:52.963185+0000","last_unstale":"2023-01-01T17:39:56.981286+0000","last_undegraded":"2023-01-01T17:39:56.981286+0000","last_fullsized":"2023-01-01T17:39:56.981286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:51:02.120858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.397417+0000","last_change":"2023-01-01T17:39:56.986618+0000","last_active":"2023-01-01T17:39:57.397417+0000","last_peered":"2023-01-01T17:39:57.397417+0000","last_clean":"2023-01-01T17:39:57.397417+0000","last_became_active":"2023-01-01T17:39:56.986194+0000","last_became_peered":"2023-01-01T17:39:56.986194+0000","last_unstale":"2023-01-01T17:39:57.397417+0000","last_undegraded":"2023-01-01T17:39:57.397417+0000","last_fullsized":"2023-01-01T17:39:57.397417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:20:54.495809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966504+0000","last_change":"2023-01-01T17:39:52.549532+0000","last_active":"2023-01-01T17:39:56.966504+0000","last_peered":"2023-01-01T17:39:56.966504+0000","last_clean":"2023-01-01T17:39:56.966504+0000","last_became_active":"2023-01-01T17:39:52.546547+0000","last_became_peered":"2023-01-01T17:39:52.546547+0000","last_unstale":"2023-01-01T17:39:56.966504+0000","last_undegraded":"2023-01-01T17:39:56.966504+0000","last_fullsized":"2023-01-01T17:39:56.966504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:04:09.352850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971830+0000","last_change":"2023-01-01T17:39:52.958851+0000","last_active":"2023-01-01T17:39:56.971830+0000","last_peered":"2023-01-01T17:39:56.971830+0000","last_clean":"2023-01-01T17:39:56.971830+0000","last_became_active":"2023-01-01T17:39:52.958452+0000","last_became_peered":"2023-01-01T17:39:52.958452+0000","last_unstale":"2023-01-01T17:39:56.971830+0000","last_undegraded":"2023-01-01T17:39:56.971830+0000","last_fullsized":"2023-01-01T17:39:56.971830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:53:46.493224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.895404+0000","last_change":"2023-01-01T17:39:56.984155+0000","last_active":"2023-01-01T17:39:58.895404+0000","last_peered":"2023-01-01T17:39:58.895404+0000","last_clean":"2023-01-01T17:39:58.895404+0000","last_became_active":"2023-01-01T17:39:56.983766+0000","last_became_peered":"2023-01-01T17:39:56.983766+0000","last_unstale":"2023-01-01T17:39:58.895404+0000","last_undegraded":"2023-01-01T17:39:58.895404+0000","last_fullsized":"2023-01-01T17:39:58.895404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:27:23.085160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971866+0000","last_change":"2023-01-01T17:39:52.543588+0000","last_active":"2023-01-01T17:39:56.971866+0000","last_peered":"2023-01-01T17:39:56.971866+0000","last_clean":"2023-01-01T17:39:56.971866+0000","last_became_active":"2023-01-01T17:39:52.543119+0000","last_became_peered":"2023-01-01T17:39:52.543119+0000","last_unstale":"2023-01-01T17:39:56.971866+0000","last_undegraded":"2023-01-01T17:39:56.971866+0000","last_fullsized":"2023-01-01T17:39:56.971866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:04:09.352850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971673+0000","last_change":"2023-01-01T17:39:52.949406+0000","last_active":"2023-01-01T17:39:56.971673+0000","last_peered":"2023-01-01T17:39:56.971673+0000","last_clean":"2023-01-01T17:39:56.971673+0000","last_became_active":"2023-01-01T17:39:52.949198+0000","last_became_peered":"2023-01-01T17:39:52.949198+0000","last_unstale":"2023-01-01T17:39:56.971673+0000","last_undegraded":"2023-01-01T17:39:56.971673+0000","last_fullsized":"2023-01-01T17:39:56.971673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:39:12.933552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.396744+0000","last_change":"2023-01-01T17:39:56.988325+0000","last_active":"2023-01-01T17:39:57.396744+0000","last_peered":"2023-01-01T17:39:57.396744+0000","last_clean":"2023-01-01T17:39:57.396744+0000","last_became_active":"2023-01-01T17:39:56.987892+0000","last_became_peered":"2023-01-01T17:39:56.987892+0000","last_unstale":"2023-01-01T17:39:57.396744+0000","last_undegraded":"2023-01-01T17:39:57.396744+0000","last_fullsized":"2023-01-01T17:39:57.396744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:59:18.287257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966680+0000","last_change":"2023-01-01T17:39:52.551693+0000","last_active":"2023-01-01T17:39:56.966680+0000","last_peered":"2023-01-01T17:39:56.966680+0000","last_clean":"2023-01-01T17:39:56.966680+0000","last_became_active":"2023-01-01T17:39:52.551402+0000","last_became_peered":"2023-01-01T17:39:52.551402+0000","last_unstale":"2023-01-01T17:39:56.966680+0000","last_undegraded":"2023-01-01T17:39:56.966680+0000","last_fullsized":"2023-01-01T17:39:56.966680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:56:28.713641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.981128+0000","last_change":"2023-01-01T17:39:52.972567+0000","last_active":"2023-01-01T17:39:56.981128+0000","last_peered":"2023-01-01T17:39:56.981128+0000","last_clean":"2023-01-01T17:39:56.981128+0000","last_became_active":"2023-01-01T17:39:52.971771+0000","last_became_peered":"2023-01-01T17:39:52.971771+0000","last_unstale":"2023-01-01T17:39:56.981128+0000","last_undegraded":"2023-01-01T17:39:56.981128+0000","last_fullsized":"2023-01-01T17:39:56.981128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T22:26:50.173884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.439549+0000","last_change":"2023-01-01T17:39:56.984259+0000","last_active":"2023-01-01T17:39:57.439549+0000","last_peered":"2023-01-01T17:39:57.439549+0000","last_clean":"2023-01-01T17:39:57.439549+0000","last_became_active":"2023-01-01T17:39:56.983826+0000","last_became_peered":"2023-01-01T17:39:56.983826+0000","last_unstale":"2023-01-01T17:39:57.439549+0000","last_undegraded":"2023-01-01T17:39:57.439549+0000","last_fullsized":"2023-01-01T17:39:57.439549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T05:23:20.710125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:40:01.425525+0000","last_change":"2023-01-01T17:39:52.542307+0000","last_active":"2023-01-01T17:40:01.425525+0000","last_peered":"2023-01-01T17:40:01.425525+0000","last_clean":"2023-01-01T17:40:01.425525+0000","last_became_active":"2023-01-01T17:39:52.542004+0000","last_became_peered":"2023-01-01T17:39:52.542004+0000","last_unstale":"2023-01-01T17:40:01.425525+0000","last_undegraded":"2023-01-01T17:40:01.425525+0000","last_fullsized":"2023-01-01T17:40:01.425525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:34:48.096366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.973005+0000","last_change":"2023-01-01T17:39:52.965551+0000","last_active":"2023-01-01T17:39:56.973005+0000","last_peered":"2023-01-01T17:39:56.973005+0000","last_clean":"2023-01-01T17:39:56.973005+0000","last_became_active":"2023-01-01T17:39:52.965295+0000","last_became_peered":"2023-01-01T17:39:52.965295+0000","last_unstale":"2023-01-01T17:39:56.973005+0000","last_undegraded":"2023-01-01T17:39:56.973005+0000","last_fullsized":"2023-01-01T17:39:56.973005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:45:24.963723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.474391+0000","last_change":"2023-01-01T17:39:56.988193+0000","last_active":"2023-01-01T17:39:58.474391+0000","last_peered":"2023-01-01T17:39:58.474391+0000","last_clean":"2023-01-01T17:39:58.474391+0000","last_became_active":"2023-01-01T17:39:56.987742+0000","last_became_peered":"2023-01-01T17:39:56.987742+0000","last_unstale":"2023-01-01T17:39:58.474391+0000","last_undegraded":"2023-01-01T17:39:58.474391+0000","last_fullsized":"2023-01-01T17:39:58.474391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:02:01.149781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.967223+0000","last_change":"2023-01-01T17:39:52.544115+0000","last_active":"2023-01-01T17:39:56.967223+0000","last_peered":"2023-01-01T17:39:56.967223+0000","last_clean":"2023-01-01T17:39:56.967223+0000","last_became_active":"2023-01-01T17:39:52.543262+0000","last_became_peered":"2023-01-01T17:39:52.543262+0000","last_unstale":"2023-01-01T17:39:56.967223+0000","last_undegraded":"2023-01-01T17:39:56.967223+0000","last_fullsized":"2023-01-01T17:39:56.967223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:04:28.975539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.976885+0000","last_change":"2023-01-01T17:39:52.961302+0000","last_active":"2023-01-01T17:39:56.976885+0000","last_peered":"2023-01-01T17:39:56.976885+0000","last_clean":"2023-01-01T17:39:56.976885+0000","last_became_active":"2023-01-01T17:39:52.960989+0000","last_became_peered":"2023-01-01T17:39:52.960989+0000","last_unstale":"2023-01-01T17:39:56.976885+0000","last_undegraded":"2023-01-01T17:39:56.976885+0000","last_fullsized":"2023-01-01T17:39:56.976885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:12:40.598666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.396961+0000","last_change":"2023-01-01T17:39:56.991710+0000","last_active":"2023-01-01T17:39:57.396961+0000","last_peered":"2023-01-01T17:39:57.396961+0000","last_clean":"2023-01-01T17:39:57.396961+0000","last_became_active":"2023-01-01T17:39:56.990850+0000","last_became_peered":"2023-01-01T17:39:56.990850+0000","last_unstale":"2023-01-01T17:39:57.396961+0000","last_undegraded":"2023-01-01T17:39:57.396961+0000","last_fullsized":"2023-01-01T17:39:57.396961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:02:01.149781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966815+0000","last_change":"2023-01-01T17:39:52.545791+0000","last_active":"2023-01-01T17:39:56.966815+0000","last_peered":"2023-01-01T17:39:56.966815+0000","last_clean":"2023-01-01T17:39:56.966815+0000","last_became_active":"2023-01-01T17:39:52.545488+0000","last_became_peered":"2023-01-01T17:39:52.545488+0000","last_unstale":"2023-01-01T17:39:56.966815+0000","last_undegraded":"2023-01-01T17:39:56.966815+0000","last_fullsized":"2023-01-01T17:39:56.966815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:56:28.713641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971022+0000","last_change":"2023-01-01T17:39:52.965778+0000","last_active":"2023-01-01T17:39:56.971022+0000","last_peered":"2023-01-01T17:39:56.971022+0000","last_clean":"2023-01-01T17:39:56.971022+0000","last_became_active":"2023-01-01T17:39:52.965147+0000","last_became_peered":"2023-01-01T17:39:52.965147+0000","last_unstale":"2023-01-01T17:39:56.971022+0000","last_undegraded":"2023-01-01T17:39:56.971022+0000","last_fullsized":"2023-01-01T17:39:56.971022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:17:10.326486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.396845+0000","last_change":"2023-01-01T17:39:56.986717+0000","last_active":"2023-01-01T17:39:57.396845+0000","last_peered":"2023-01-01T17:39:57.396845+0000","last_clean":"2023-01-01T17:39:57.396845+0000","last_became_active":"2023-01-01T17:39:56.986276+0000","last_became_peered":"2023-01-01T17:39:56.986276+0000","last_unstale":"2023-01-01T17:39:57.396845+0000","last_undegraded":"2023-01-01T17:39:57.396845+0000","last_fullsized":"2023-01-01T17:39:57.396845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:04:46.047782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966234+0000","last_change":"2023-01-01T17:39:52.544050+0000","last_active":"2023-01-01T17:39:56.966234+0000","last_peered":"2023-01-01T17:39:56.966234+0000","last_clean":"2023-01-01T17:39:56.966234+0000","last_became_active":"2023-01-01T17:39:52.543519+0000","last_became_peered":"2023-01-01T17:39:52.543519+0000","last_unstale":"2023-01-01T17:39:56.966234+0000","last_undegraded":"2023-01-01T17:39:56.966234+0000","last_fullsized":"2023-01-01T17:39:56.966234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T22:26:49.169066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.968604+0000","last_change":"2023-01-01T17:39:52.967678+0000","last_active":"2023-01-01T17:39:56.968604+0000","last_peered":"2023-01-01T17:39:56.968604+0000","last_clean":"2023-01-01T17:39:56.968604+0000","last_became_active":"2023-01-01T17:39:52.965616+0000","last_became_peered":"2023-01-01T17:39:52.965616+0000","last_unstale":"2023-01-01T17:39:56.968604+0000","last_undegraded":"2023-01-01T17:39:56.968604+0000","last_fullsized":"2023-01-01T17:39:56.968604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T22:42:37.419622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.474167+0000","last_change":"2023-01-01T17:39:56.987972+0000","last_active":"2023-01-01T17:39:58.474167+0000","last_peered":"2023-01-01T17:39:58.474167+0000","last_clean":"2023-01-01T17:39:58.474167+0000","last_became_active":"2023-01-01T17:39:56.987575+0000","last_became_peered":"2023-01-01T17:39:56.987575+0000","last_unstale":"2023-01-01T17:39:58.474167+0000","last_undegraded":"2023-01-01T17:39:58.474167+0000","last_fullsized":"2023-01-01T17:39:58.474167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T22:56:37.998610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.979048+0000","last_change":"2023-01-01T17:39:52.553331+0000","last_active":"2023-01-01T17:39:56.979048+0000","last_peered":"2023-01-01T17:39:56.979048+0000","last_clean":"2023-01-01T17:39:56.979048+0000","last_became_active":"2023-01-01T17:39:52.553030+0000","last_became_peered":"2023-01-01T17:39:52.553030+0000","last_unstale":"2023-01-01T17:39:56.979048+0000","last_undegraded":"2023-01-01T17:39:56.979048+0000","last_fullsized":"2023-01-01T17:39:56.979048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:21:53.166663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.975027+0000","last_change":"2023-01-01T17:39:52.949026+0000","last_active":"2023-01-01T17:39:56.975027+0000","last_peered":"2023-01-01T17:39:56.975027+0000","last_clean":"2023-01-01T17:39:56.975027+0000","last_became_active":"2023-01-01T17:39:52.948779+0000","last_became_peered":"2023-01-01T17:39:52.948779+0000","last_unstale":"2023-01-01T17:39:56.975027+0000","last_undegraded":"2023-01-01T17:39:56.975027+0000","last_fullsized":"2023-01-01T17:39:56.975027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T05:06:34.299709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.895796+0000","last_change":"2023-01-01T17:39:56.983900+0000","last_active":"2023-01-01T17:39:58.895796+0000","last_peered":"2023-01-01T17:39:58.895796+0000","last_clean":"2023-01-01T17:39:58.895796+0000","last_became_active":"2023-01-01T17:39:56.983523+0000","last_became_peered":"2023-01-01T17:39:56.983523+0000","last_unstale":"2023-01-01T17:39:58.895796+0000","last_undegraded":"2023-01-01T17:39:58.895796+0000","last_fullsized":"2023-01-01T17:39:58.895796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:45:28.399373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.968788+0000","last_change":"2023-01-01T17:39:52.543689+0000","last_active":"2023-01-01T17:39:56.968788+0000","last_peered":"2023-01-01T17:39:56.968788+0000","last_clean":"2023-01-01T17:39:56.968788+0000","last_became_active":"2023-01-01T17:39:52.543296+0000","last_became_peered":"2023-01-01T17:39:52.543296+0000","last_unstale":"2023-01-01T17:39:56.968788+0000","last_undegraded":"2023-01-01T17:39:56.968788+0000","last_fullsized":"2023-01-01T17:39:56.968788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T02:44:27.478991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.970314+0000","last_change":"2023-01-01T17:39:52.965596+0000","last_active":"2023-01-01T17:39:56.970314+0000","last_peered":"2023-01-01T17:39:56.970314+0000","last_clean":"2023-01-01T17:39:56.970314+0000","last_became_active":"2023-01-01T17:39:52.965299+0000","last_became_peered":"2023-01-01T17:39:52.965299+0000","last_unstale":"2023-01-01T17:39:56.970314+0000","last_undegraded":"2023-01-01T17:39:56.970314+0000","last_fullsized":"2023-01-01T17:39:56.970314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:29:27.193367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.393206+0000","last_change":"2023-01-01T17:39:56.985023+0000","last_active":"2023-01-01T17:39:57.393206+0000","last_peered":"2023-01-01T17:39:57.393206+0000","last_clean":"2023-01-01T17:39:57.393206+0000","last_became_active":"2023-01-01T17:39:56.984658+0000","last_became_peered":"2023-01-01T17:39:56.984658+0000","last_unstale":"2023-01-01T17:39:57.393206+0000","last_undegraded":"2023-01-01T17:39:57.393206+0000","last_fullsized":"2023-01-01T17:39:57.393206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:20:54.495809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.968602+0000","last_change":"2023-01-01T17:39:52.544983+0000","last_active":"2023-01-01T17:39:56.968602+0000","last_peered":"2023-01-01T17:39:56.968602+0000","last_clean":"2023-01-01T17:39:56.968602+0000","last_became_active":"2023-01-01T17:39:52.543540+0000","last_became_peered":"2023-01-01T17:39:52.543540+0000","last_unstale":"2023-01-01T17:39:56.968602+0000","last_undegraded":"2023-01-01T17:39:56.968602+0000","last_fullsized":"2023-01-01T17:39:56.968602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:51:01.116040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.975618+0000","last_change":"2023-01-01T17:39:52.961386+0000","last_active":"2023-01-01T17:39:56.975618+0000","last_peered":"2023-01-01T17:39:56.975618+0000","last_clean":"2023-01-01T17:39:56.975618+0000","last_became_active":"2023-01-01T17:39:52.961095+0000","last_became_peered":"2023-01-01T17:39:52.961095+0000","last_unstale":"2023-01-01T17:39:56.975618+0000","last_undegraded":"2023-01-01T17:39:56.975618+0000","last_fullsized":"2023-01-01T17:39:56.975618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:02:40.763669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.393555+0000","last_change":"2023-01-01T17:39:56.986859+0000","last_active":"2023-01-01T17:39:57.393555+0000","last_peered":"2023-01-01T17:39:57.393555+0000","last_clean":"2023-01-01T17:39:57.393555+0000","last_became_active":"2023-01-01T17:39:56.986501+0000","last_became_peered":"2023-01-01T17:39:56.986501+0000","last_unstale":"2023-01-01T17:39:57.393555+0000","last_undegraded":"2023-01-01T17:39:57.393555+0000","last_fullsized":"2023-01-01T17:39:57.393555+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:37:26.269443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966564+0000","last_change":"2023-01-01T17:39:52.547827+0000","last_active":"2023-01-01T17:39:56.966564+0000","last_peered":"2023-01-01T17:39:56.966564+0000","last_clean":"2023-01-01T17:39:56.966564+0000","last_became_active":"2023-01-01T17:39:52.547578+0000","last_became_peered":"2023-01-01T17:39:52.547578+0000","last_unstale":"2023-01-01T17:39:56.966564+0000","last_undegraded":"2023-01-01T17:39:56.966564+0000","last_fullsized":"2023-01-01T17:39:56.966564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:32:00.585258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.979287+0000","last_change":"2023-01-01T17:39:52.972609+0000","last_active":"2023-01-01T17:39:56.979287+0000","last_peered":"2023-01-01T17:39:56.979287+0000","last_clean":"2023-01-01T17:39:56.979287+0000","last_became_active":"2023-01-01T17:39:52.972412+0000","last_became_peered":"2023-01-01T17:39:52.972412+0000","last_unstale":"2023-01-01T17:39:56.979287+0000","last_undegraded":"2023-01-01T17:39:56.979287+0000","last_fullsized":"2023-01-01T17:39:56.979287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T02:44:28.483809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.393419+0000","last_change":"2023-01-01T17:39:56.982521+0000","last_active":"2023-01-01T17:39:57.393419+0000","last_peered":"2023-01-01T17:39:57.393419+0000","last_clean":"2023-01-01T17:39:57.393419+0000","last_became_active":"2023-01-01T17:39:56.982193+0000","last_became_peered":"2023-01-01T17:39:56.982193+0000","last_unstale":"2023-01-01T17:39:57.393419+0000","last_undegraded":"2023-01-01T17:39:57.393419+0000","last_fullsized":"2023-01-01T17:39:57.393419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:53:49.928875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.970959+0000","last_change":"2023-01-01T17:39:52.551778+0000","last_active":"2023-01-01T17:39:56.970959+0000","last_peered":"2023-01-01T17:39:56.970959+0000","last_clean":"2023-01-01T17:39:56.970959+0000","last_became_active":"2023-01-01T17:39:52.551372+0000","last_became_peered":"2023-01-01T17:39:52.551372+0000","last_unstale":"2023-01-01T17:39:56.970959+0000","last_undegraded":"2023-01-01T17:39:56.970959+0000","last_fullsized":"2023-01-01T17:39:56.970959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:06:58.613789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.968874+0000","last_change":"2023-01-01T17:39:52.958663+0000","last_active":"2023-01-01T17:39:56.968874+0000","last_peered":"2023-01-01T17:39:56.968874+0000","last_clean":"2023-01-01T17:39:56.968874+0000","last_became_active":"2023-01-01T17:39:52.958380+0000","last_became_peered":"2023-01-01T17:39:52.958380+0000","last_unstale":"2023-01-01T17:39:56.968874+0000","last_undegraded":"2023-01-01T17:39:56.968874+0000","last_fullsized":"2023-01-01T17:39:56.968874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:12:40.598666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.393440+0000","last_change":"2023-01-01T17:39:56.984062+0000","last_active":"2023-01-01T17:39:57.393440+0000","last_peered":"2023-01-01T17:39:57.393440+0000","last_clean":"2023-01-01T17:39:57.393440+0000","last_became_active":"2023-01-01T17:39:56.983629+0000","last_became_peered":"2023-01-01T17:39:56.983629+0000","last_unstale":"2023-01-01T17:39:57.393440+0000","last_undegraded":"2023-01-01T17:39:57.393440+0000","last_fullsized":"2023-01-01T17:39:57.393440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:13:20.660670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.974416+0000","last_change":"2023-01-01T17:39:52.543859+0000","last_active":"2023-01-01T17:39:56.974416+0000","last_peered":"2023-01-01T17:39:56.974416+0000","last_clean":"2023-01-01T17:39:56.974416+0000","last_became_active":"2023-01-01T17:39:52.543608+0000","last_became_peered":"2023-01-01T17:39:52.543608+0000","last_unstale":"2023-01-01T17:39:56.974416+0000","last_undegraded":"2023-01-01T17:39:56.974416+0000","last_fullsized":"2023-01-01T17:39:56.974416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:32:00.585258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971221+0000","last_change":"2023-01-01T17:39:52.955020+0000","last_active":"2023-01-01T17:39:56.971221+0000","last_peered":"2023-01-01T17:39:56.971221+0000","last_clean":"2023-01-01T17:39:56.971221+0000","last_became_active":"2023-01-01T17:39:52.954761+0000","last_became_peered":"2023-01-01T17:39:52.954761+0000","last_unstale":"2023-01-01T17:39:56.971221+0000","last_undegraded":"2023-01-01T17:39:56.971221+0000","last_fullsized":"2023-01-01T17:39:56.971221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:38:10.525560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.439777+0000","last_change":"2023-01-01T17:39:56.987402+0000","last_active":"2023-01-01T17:39:57.439777+0000","last_peered":"2023-01-01T17:39:57.439777+0000","last_clean":"2023-01-01T17:39:57.439777+0000","last_became_active":"2023-01-01T17:39:56.986985+0000","last_became_peered":"2023-01-01T17:39:56.986985+0000","last_unstale":"2023-01-01T17:39:57.439777+0000","last_undegraded":"2023-01-01T17:39:57.439777+0000","last_fullsized":"2023-01-01T17:39:57.439777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T02:27:56.672313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.980601+0000","last_change":"2023-01-01T17:39:52.545685+0000","last_active":"2023-01-01T17:39:56.980601+0000","last_peered":"2023-01-01T17:39:56.980601+0000","last_clean":"2023-01-01T17:39:56.980601+0000","last_became_active":"2023-01-01T17:39:52.545424+0000","last_became_peered":"2023-01-01T17:39:52.545424+0000","last_unstale":"2023-01-01T17:39:56.980601+0000","last_undegraded":"2023-01-01T17:39:56.980601+0000","last_fullsized":"2023-01-01T17:39:56.980601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:48:45.787227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.972715+0000","last_change":"2023-01-01T17:39:52.961138+0000","last_active":"2023-01-01T17:39:56.972715+0000","last_peered":"2023-01-01T17:39:56.972715+0000","last_clean":"2023-01-01T17:39:56.972715+0000","last_became_active":"2023-01-01T17:39:52.960867+0000","last_became_peered":"2023-01-01T17:39:52.960867+0000","last_unstale":"2023-01-01T17:39:56.972715+0000","last_undegraded":"2023-01-01T17:39:56.972715+0000","last_fullsized":"2023-01-01T17:39:56.972715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:53:46.493224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.474381+0000","last_change":"2023-01-01T17:39:56.984187+0000","last_active":"2023-01-01T17:39:58.474381+0000","last_peered":"2023-01-01T17:39:58.474381+0000","last_clean":"2023-01-01T17:39:58.474381+0000","last_became_active":"2023-01-01T17:39:56.983771+0000","last_became_peered":"2023-01-01T17:39:56.983771+0000","last_unstale":"2023-01-01T17:39:58.474381+0000","last_undegraded":"2023-01-01T17:39:58.474381+0000","last_fullsized":"2023-01-01T17:39:58.474381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:02:45.626404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.975453+0000","last_change":"2023-01-01T17:39:52.541917+0000","last_active":"2023-01-01T17:39:56.975453+0000","last_peered":"2023-01-01T17:39:56.975453+0000","last_clean":"2023-01-01T17:39:56.975453+0000","last_became_active":"2023-01-01T17:39:52.541656+0000","last_became_peered":"2023-01-01T17:39:52.541656+0000","last_unstale":"2023-01-01T17:39:56.975453+0000","last_undegraded":"2023-01-01T17:39:56.975453+0000","last_fullsized":"2023-01-01T17:39:56.975453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:47:31.929043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.972945+0000","last_change":"2023-01-01T17:39:52.960351+0000","last_active":"2023-01-01T17:39:56.972945+0000","last_peered":"2023-01-01T17:39:56.972945+0000","last_clean":"2023-01-01T17:39:56.972945+0000","last_became_active":"2023-01-01T17:39:52.960106+0000","last_became_peered":"2023-01-01T17:39:52.960106+0000","last_unstale":"2023-01-01T17:39:56.972945+0000","last_undegraded":"2023-01-01T17:39:56.972945+0000","last_fullsized":"2023-01-01T17:39:56.972945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:10:33.122278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.832775+0000","last_change":"2023-01-01T17:39:56.986969+0000","last_active":"2023-01-01T17:39:58.832775+0000","last_peered":"2023-01-01T17:39:58.832775+0000","last_clean":"2023-01-01T17:39:58.832775+0000","last_became_active":"2023-01-01T17:39:56.986612+0000","last_became_peered":"2023-01-01T17:39:56.986612+0000","last_unstale":"2023-01-01T17:39:58.832775+0000","last_undegraded":"2023-01-01T17:39:58.832775+0000","last_fullsized":"2023-01-01T17:39:58.832775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:59:32.743399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971705+0000","last_change":"2023-01-01T17:39:52.544178+0000","last_active":"2023-01-01T17:39:56.971705+0000","last_peered":"2023-01-01T17:39:56.971705+0000","last_clean":"2023-01-01T17:39:56.971705+0000","last_became_active":"2023-01-01T17:39:52.543259+0000","last_became_peered":"2023-01-01T17:39:52.543259+0000","last_unstale":"2023-01-01T17:39:56.971705+0000","last_undegraded":"2023-01-01T17:39:56.971705+0000","last_fullsized":"2023-01-01T17:39:56.971705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:04:09.352850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.981647+0000","last_change":"2023-01-01T17:39:52.966905+0000","last_active":"2023-01-01T17:39:56.981647+0000","last_peered":"2023-01-01T17:39:56.981647+0000","last_clean":"2023-01-01T17:39:56.981647+0000","last_became_active":"2023-01-01T17:39:52.966652+0000","last_became_peered":"2023-01-01T17:39:52.966652+0000","last_unstale":"2023-01-01T17:39:56.981647+0000","last_undegraded":"2023-01-01T17:39:56.981647+0000","last_fullsized":"2023-01-01T17:39:56.981647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:33:57.337802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.832482+0000","last_change":"2023-01-01T17:39:56.992320+0000","last_active":"2023-01-01T17:39:58.832482+0000","last_peered":"2023-01-01T17:39:58.832482+0000","last_clean":"2023-01-01T17:39:58.832482+0000","last_became_active":"2023-01-01T17:39:56.991958+0000","last_became_peered":"2023-01-01T17:39:56.991958+0000","last_unstale":"2023-01-01T17:39:58.832482+0000","last_undegraded":"2023-01-01T17:39:58.832482+0000","last_fullsized":"2023-01-01T17:39:58.832482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:44:25.204625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.974879+0000","last_change":"2023-01-01T17:39:52.542402+0000","last_active":"2023-01-01T17:39:56.974879+0000","last_peered":"2023-01-01T17:39:56.974879+0000","last_clean":"2023-01-01T17:39:56.974879+0000","last_became_active":"2023-01-01T17:39:52.541828+0000","last_became_peered":"2023-01-01T17:39:52.541828+0000","last_unstale":"2023-01-01T17:39:56.974879+0000","last_undegraded":"2023-01-01T17:39:56.974879+0000","last_fullsized":"2023-01-01T17:39:56.974879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:47:31.929043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.972864+0000","last_change":"2023-01-01T17:39:47.373285+0000","last_active":"2023-01-01T17:39:56.972864+0000","last_peered":"2023-01-01T17:39:56.972864+0000","last_clean":"2023-01-01T17:39:56.972864+0000","last_became_active":"2023-01-01T17:39:47.372956+0000","last_became_peered":"2023-01-01T17:39:47.372956+0000","last_unstale":"2023-01-01T17:39:56.972864+0000","last_undegraded":"2023-01-01T17:39:56.972864+0000","last_fullsized":"2023-01-01T17:39:56.972864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_clean_scrub_stamp":"2023-01-01T17:39:46.276990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:49:32.017195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971616+0000","last_change":"2023-01-01T17:39:52.949304+0000","last_active":"2023-01-01T17:39:56.971616+0000","last_peered":"2023-01-01T17:39:56.971616+0000","last_clean":"2023-01-01T17:39:56.971616+0000","last_became_active":"2023-01-01T17:39:52.949049+0000","last_became_peered":"2023-01-01T17:39:52.949049+0000","last_unstale":"2023-01-01T17:39:56.971616+0000","last_undegraded":"2023-01-01T17:39:56.971616+0000","last_fullsized":"2023-01-01T17:39:56.971616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:38:17.390301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.396068+0000","last_change":"2023-01-01T17:39:56.986230+0000","last_active":"2023-01-01T17:39:57.396068+0000","last_peered":"2023-01-01T17:39:57.396068+0000","last_clean":"2023-01-01T17:39:57.396068+0000","last_became_active":"2023-01-01T17:39:56.985563+0000","last_became_peered":"2023-01-01T17:39:56.985563+0000","last_unstale":"2023-01-01T17:39:57.396068+0000","last_undegraded":"2023-01-01T17:39:57.396068+0000","last_fullsized":"2023-01-01T17:39:57.396068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T05:39:37.898528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.975799+0000","last_change":"2023-01-01T17:39:47.302896+0000","last_active":"2023-01-01T17:39:56.975799+0000","last_peered":"2023-01-01T17:39:56.975799+0000","last_clean":"2023-01-01T17:39:56.975799+0000","last_became_active":"2023-01-01T17:39:47.302559+0000","last_became_peered":"2023-01-01T17:39:47.302559+0000","last_unstale":"2023-01-01T17:39:56.975799+0000","last_undegraded":"2023-01-01T17:39:56.975799+0000","last_fullsized":"2023-01-01T17:39:56.975799+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_clean_scrub_stamp":"2023-01-01T17:39:46.276990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:49:32.017195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.437307+0000","last_change":"2023-01-01T17:39:52.546050+0000","last_active":"2023-01-01T17:39:57.437307+0000","last_peered":"2023-01-01T17:39:57.437307+0000","last_clean":"2023-01-01T17:39:57.437307+0000","last_became_active":"2023-01-01T17:39:52.545801+0000","last_became_peered":"2023-01-01T17:39:52.545801+0000","last_unstale":"2023-01-01T17:39:57.437307+0000","last_undegraded":"2023-01-01T17:39:57.437307+0000","last_fullsized":"2023-01-01T17:39:57.437307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:34:48.096366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.975540+0000","last_change":"2023-01-01T17:39:52.963646+0000","last_active":"2023-01-01T17:39:56.975540+0000","last_peered":"2023-01-01T17:39:56.975540+0000","last_clean":"2023-01-01T17:39:56.975540+0000","last_became_active":"2023-01-01T17:39:52.963372+0000","last_became_peered":"2023-01-01T17:39:52.963372+0000","last_unstale":"2023-01-01T17:39:56.975540+0000","last_undegraded":"2023-01-01T17:39:56.975540+0000","last_fullsized":"2023-01-01T17:39:56.975540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:20:51.060158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.474248+0000","last_change":"2023-01-01T17:39:56.985447+0000","last_active":"2023-01-01T17:39:58.474248+0000","last_peered":"2023-01-01T17:39:58.474248+0000","last_clean":"2023-01-01T17:39:58.474248+0000","last_became_active":"2023-01-01T17:39:56.985061+0000","last_became_peered":"2023-01-01T17:39:56.985061+0000","last_unstale":"2023-01-01T17:39:58.474248+0000","last_undegraded":"2023-01-01T17:39:58.474248+0000","last_fullsized":"2023-01-01T17:39:58.474248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:40:46.122449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.981389+0000","last_change":"2023-01-01T17:39:47.304031+0000","last_active":"2023-01-01T17:39:56.981389+0000","last_peered":"2023-01-01T17:39:56.981389+0000","last_clean":"2023-01-01T17:39:56.981389+0000","last_became_active":"2023-01-01T17:39:47.303722+0000","last_became_peered":"2023-01-01T17:39:47.303722+0000","last_unstale":"2023-01-01T17:39:56.981389+0000","last_undegraded":"2023-01-01T17:39:56.981389+0000","last_fullsized":"2023-01-01T17:39:56.981389+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_clean_scrub_stamp":"2023-01-01T17:39:46.276990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:35:16.549190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966543+0000","last_change":"2023-01-01T17:39:47.305762+0000","last_active":"2023-01-01T17:39:56.966543+0000","last_peered":"2023-01-01T17:39:56.966543+0000","last_clean":"2023-01-01T17:39:56.966543+0000","last_became_active":"2023-01-01T17:39:47.304987+0000","last_became_peered":"2023-01-01T17:39:47.304987+0000","last_unstale":"2023-01-01T17:39:56.966543+0000","last_undegraded":"2023-01-01T17:39:56.966543+0000","last_fullsized":"2023-01-01T17:39:56.966543+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_clean_scrub_stamp":"2023-01-01T17:39:46.276990+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:21:04.167413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966426+0000","last_change":"2023-01-01T17:39:52.545184+0000","last_active":"2023-01-01T17:39:56.966426+0000","last_peered":"2023-01-01T17:39:56.966426+0000","last_clean":"2023-01-01T17:39:56.966426+0000","last_became_active":"2023-01-01T17:39:52.544797+0000","last_became_peered":"2023-01-01T17:39:52.544797+0000","last_unstale":"2023-01-01T17:39:56.966426+0000","last_undegraded":"2023-01-01T17:39:56.966426+0000","last_fullsized":"2023-01-01T17:39:56.966426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:32:00.585258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.968517+0000","last_change":"2023-01-01T17:39:52.972606+0000","last_active":"2023-01-01T17:39:56.968517+0000","last_peered":"2023-01-01T17:39:56.968517+0000","last_clean":"2023-01-01T17:39:56.968517+0000","last_became_active":"2023-01-01T17:39:52.972366+0000","last_became_peered":"2023-01-01T17:39:52.972366+0000","last_unstale":"2023-01-01T17:39:56.968517+0000","last_undegraded":"2023-01-01T17:39:56.968517+0000","last_fullsized":"2023-01-01T17:39:56.968517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:20:30.823975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.393598+0000","last_change":"2023-01-01T17:39:56.984925+0000","last_active":"2023-01-01T17:39:57.393598+0000","last_peered":"2023-01-01T17:39:57.393598+0000","last_clean":"2023-01-01T17:39:57.393598+0000","last_became_active":"2023-01-01T17:39:56.984572+0000","last_became_peered":"2023-01-01T17:39:56.984572+0000","last_unstale":"2023-01-01T17:39:57.393598+0000","last_undegraded":"2023-01-01T17:39:57.393598+0000","last_fullsized":"2023-01-01T17:39:57.393598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T05:06:37.735359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966941+0000","last_change":"2023-01-01T17:39:47.365630+0000","last_active":"2023-01-01T17:39:56.966941+0000","last_peered":"2023-01-01T17:39:56.966941+0000","last_clean":"2023-01-01T17:39:56.966941+0000","last_became_active":"2023-01-01T17:39:47.365306+0000","last_became_peered":"2023-01-01T17:39:47.365306+0000","last_unstale":"2023-01-01T17:39:56.966941+0000","last_undegraded":"2023-01-01T17:39:56.966941+0000","last_fullsized":"2023-01-01T17:39:56.966941+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_clean_scrub_stamp":"2023-01-01T17:39:46.276990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T02:18:31.270261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.980681+0000","last_change":"2023-01-01T17:39:52.548241+0000","last_active":"2023-01-01T17:39:56.980681+0000","last_peered":"2023-01-01T17:39:56.980681+0000","last_clean":"2023-01-01T17:39:56.980681+0000","last_became_active":"2023-01-01T17:39:52.547960+0000","last_became_peered":"2023-01-01T17:39:52.547960+0000","last_unstale":"2023-01-01T17:39:56.980681+0000","last_undegraded":"2023-01-01T17:39:56.980681+0000","last_fullsized":"2023-01-01T17:39:56.980681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:21:53.166663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.981566+0000","last_change":"2023-01-01T17:39:52.970894+0000","last_active":"2023-01-01T17:39:56.981566+0000","last_peered":"2023-01-01T17:39:56.981566+0000","last_clean":"2023-01-01T17:39:56.981566+0000","last_became_active":"2023-01-01T17:39:52.970617+0000","last_became_peered":"2023-01-01T17:39:52.970617+0000","last_unstale":"2023-01-01T17:39:56.981566+0000","last_undegraded":"2023-01-01T17:39:56.981566+0000","last_fullsized":"2023-01-01T17:39:56.981566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:29:27.193367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.895750+0000","last_change":"2023-01-01T17:39:56.979186+0000","last_active":"2023-01-01T17:39:58.895750+0000","last_peered":"2023-01-01T17:39:58.895750+0000","last_clean":"2023-01-01T17:39:58.895750+0000","last_became_active":"2023-01-01T17:39:56.978779+0000","last_became_peered":"2023-01-01T17:39:56.978779+0000","last_unstale":"2023-01-01T17:39:58.895750+0000","last_undegraded":"2023-01-01T17:39:58.895750+0000","last_fullsized":"2023-01-01T17:39:58.895750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:28:51.202515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966352+0000","last_change":"2023-01-01T17:39:47.365687+0000","last_active":"2023-01-01T17:39:56.966352+0000","last_peered":"2023-01-01T17:39:56.966352+0000","last_clean":"2023-01-01T17:39:56.966352+0000","last_became_active":"2023-01-01T17:39:47.365433+0000","last_became_peered":"2023-01-01T17:39:47.365433+0000","last_unstale":"2023-01-01T17:39:56.966352+0000","last_undegraded":"2023-01-01T17:39:56.966352+0000","last_fullsized":"2023-01-01T17:39:56.966352+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_clean_scrub_stamp":"2023-01-01T17:39:46.276990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:05:23.068625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971494+0000","last_change":"2023-01-01T17:39:52.542938+0000","last_active":"2023-01-01T17:39:56.971494+0000","last_peered":"2023-01-01T17:39:56.971494+0000","last_clean":"2023-01-01T17:39:56.971494+0000","last_became_active":"2023-01-01T17:39:52.542480+0000","last_became_peered":"2023-01-01T17:39:52.542480+0000","last_unstale":"2023-01-01T17:39:56.971494+0000","last_undegraded":"2023-01-01T17:39:56.971494+0000","last_fullsized":"2023-01-01T17:39:56.971494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:34:48.096366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.980422+0000","last_change":"2023-01-01T17:39:52.957732+0000","last_active":"2023-01-01T17:39:56.980422+0000","last_peered":"2023-01-01T17:39:56.980422+0000","last_clean":"2023-01-01T17:39:56.980422+0000","last_became_active":"2023-01-01T17:39:52.957531+0000","last_became_peered":"2023-01-01T17:39:52.957531+0000","last_unstale":"2023-01-01T17:39:56.980422+0000","last_undegraded":"2023-01-01T17:39:56.980422+0000","last_fullsized":"2023-01-01T17:39:56.980422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T03:53:15.558910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.437415+0000","last_change":"2023-01-01T17:39:56.985580+0000","last_active":"2023-01-01T17:39:57.437415+0000","last_peered":"2023-01-01T17:39:57.437415+0000","last_clean":"2023-01-01T17:39:57.437415+0000","last_became_active":"2023-01-01T17:39:56.985166+0000","last_became_peered":"2023-01-01T17:39:56.985166+0000","last_unstale":"2023-01-01T17:39:57.437415+0000","last_undegraded":"2023-01-01T17:39:57.437415+0000","last_fullsized":"2023-01-01T17:39:57.437415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:27:23.085160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.970225+0000","last_change":"2023-01-01T17:39:47.367908+0000","last_active":"2023-01-01T17:39:56.970225+0000","last_peered":"2023-01-01T17:39:56.970225+0000","last_clean":"2023-01-01T17:39:56.970225+0000","last_became_active":"2023-01-01T17:39:47.367631+0000","last_became_peered":"2023-01-01T17:39:47.367631+0000","last_unstale":"2023-01-01T17:39:56.970225+0000","last_undegraded":"2023-01-01T17:39:56.970225+0000","last_fullsized":"2023-01-01T17:39:56.970225+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_clean_scrub_stamp":"2023-01-01T17:39:46.276990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:35:16.549190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.973094+0000","last_change":"2023-01-01T17:39:52.546724+0000","last_active":"2023-01-01T17:39:56.973094+0000","last_peered":"2023-01-01T17:39:56.973094+0000","last_clean":"2023-01-01T17:39:56.973094+0000","last_became_active":"2023-01-01T17:39:52.546514+0000","last_became_peered":"2023-01-01T17:39:52.546514+0000","last_unstale":"2023-01-01T17:39:56.973094+0000","last_undegraded":"2023-01-01T17:39:56.973094+0000","last_fullsized":"2023-01-01T17:39:56.973094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:05:31.448005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.980812+0000","last_change":"2023-01-01T17:39:52.965004+0000","last_active":"2023-01-01T17:39:56.980812+0000","last_peered":"2023-01-01T17:39:56.980812+0000","last_clean":"2023-01-01T17:39:56.980812+0000","last_became_active":"2023-01-01T17:39:52.964483+0000","last_became_peered":"2023-01-01T17:39:52.964483+0000","last_unstale":"2023-01-01T17:39:56.980812+0000","last_undegraded":"2023-01-01T17:39:56.980812+0000","last_fullsized":"2023-01-01T17:39:56.980812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:26:59.346786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.397683+0000","last_change":"2023-01-01T17:39:56.994936+0000","last_active":"2023-01-01T17:39:57.397683+0000","last_peered":"2023-01-01T17:39:57.397683+0000","last_clean":"2023-01-01T17:39:57.397683+0000","last_became_active":"2023-01-01T17:39:56.994480+0000","last_became_peered":"2023-01-01T17:39:56.994480+0000","last_unstale":"2023-01-01T17:39:57.397683+0000","last_undegraded":"2023-01-01T17:39:57.397683+0000","last_fullsized":"2023-01-01T17:39:57.397683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:37:26.269443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.980561+0000","last_change":"2023-01-01T17:39:47.365528+0000","last_active":"2023-01-01T17:39:56.980561+0000","last_peered":"2023-01-01T17:39:56.980561+0000","last_clean":"2023-01-01T17:39:56.980561+0000","last_became_active":"2023-01-01T17:39:47.365239+0000","last_became_peered":"2023-01-01T17:39:47.365239+0000","last_unstale":"2023-01-01T17:39:56.980561+0000","last_undegraded":"2023-01-01T17:39:56.980561+0000","last_fullsized":"2023-01-01T17:39:56.980561+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_clean_scrub_stamp":"2023-01-01T17:39:46.276990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:21:04.167413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.981073+0000","last_change":"2023-01-01T17:39:52.542456+0000","last_active":"2023-01-01T17:39:56.981073+0000","last_peered":"2023-01-01T17:39:56.981073+0000","last_clean":"2023-01-01T17:39:56.981073+0000","last_became_active":"2023-01-01T17:39:52.542154+0000","last_became_peered":"2023-01-01T17:39:52.542154+0000","last_unstale":"2023-01-01T17:39:56.981073+0000","last_undegraded":"2023-01-01T17:39:56.981073+0000","last_fullsized":"2023-01-01T17:39:56.981073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:06:58.613789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.969042+0000","last_change":"2023-01-01T17:39:52.968138+0000","last_active":"2023-01-01T17:39:56.969042+0000","last_peered":"2023-01-01T17:39:56.969042+0000","last_clean":"2023-01-01T17:39:56.969042+0000","last_became_active":"2023-01-01T17:39:52.967887+0000","last_became_peered":"2023-01-01T17:39:52.967887+0000","last_unstale":"2023-01-01T17:39:56.969042+0000","last_undegraded":"2023-01-01T17:39:56.969042+0000","last_fullsized":"2023-01-01T17:39:56.969042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:38:17.390301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.436948+0000","last_change":"2023-01-01T17:39:56.992991+0000","last_active":"2023-01-01T17:39:57.436948+0000","last_peered":"2023-01-01T17:39:57.436948+0000","last_clean":"2023-01-01T17:39:57.436948+0000","last_became_active":"2023-01-01T17:39:56.986739+0000","last_became_peered":"2023-01-01T17:39:56.986739+0000","last_unstale":"2023-01-01T17:39:57.436948+0000","last_undegraded":"2023-01-01T17:39:57.436948+0000","last_fullsized":"2023-01-01T17:39:57.436948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:45:28.399373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.981191+0000","last_change":"2023-01-01T17:39:47.305897+0000","last_active":"2023-01-01T17:39:56.981191+0000","last_peered":"2023-01-01T17:39:56.981191+0000","last_clean":"2023-01-01T17:39:56.981191+0000","last_became_active":"2023-01-01T17:39:47.305590+0000","last_became_peered":"2023-01-01T17:39:47.305590+0000","last_unstale":"2023-01-01T17:39:56.981191+0000","last_undegraded":"2023-01-01T17:39:56.981191+0000","last_fullsized":"2023-01-01T17:39:56.981191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_clean_scrub_stamp":"2023-01-01T17:39:46.276990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:35:16.549190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.970834+0000","last_change":"2023-01-01T17:39:52.551958+0000","last_active":"2023-01-01T17:39:56.970834+0000","last_peered":"2023-01-01T17:39:56.970834+0000","last_clean":"2023-01-01T17:39:56.970834+0000","last_became_active":"2023-01-01T17:39:52.551432+0000","last_became_peered":"2023-01-01T17:39:52.551432+0000","last_unstale":"2023-01-01T17:39:56.970834+0000","last_undegraded":"2023-01-01T17:39:56.970834+0000","last_fullsized":"2023-01-01T17:39:56.970834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:34:48.096366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.980860+0000","last_change":"2023-01-01T17:39:52.970343+0000","last_active":"2023-01-01T17:39:56.980860+0000","last_peered":"2023-01-01T17:39:56.980860+0000","last_clean":"2023-01-01T17:39:56.980860+0000","last_became_active":"2023-01-01T17:39:52.970055+0000","last_became_peered":"2023-01-01T17:39:52.970055+0000","last_unstale":"2023-01-01T17:39:56.980860+0000","last_undegraded":"2023-01-01T17:39:56.980860+0000","last_fullsized":"2023-01-01T17:39:56.980860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:17:10.326486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.439827+0000","last_change":"2023-01-01T17:39:56.994930+0000","last_active":"2023-01-01T17:39:57.439827+0000","last_peered":"2023-01-01T17:39:57.439827+0000","last_clean":"2023-01-01T17:39:57.439827+0000","last_became_active":"2023-01-01T17:39:56.994469+0000","last_became_peered":"2023-01-01T17:39:56.994469+0000","last_unstale":"2023-01-01T17:39:57.439827+0000","last_undegraded":"2023-01-01T17:39:57.439827+0000","last_fullsized":"2023-01-01T17:39:57.439827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:27:23.085160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.969397+0000","last_change":"2023-01-01T17:39:52.553058+0000","last_active":"2023-01-01T17:39:56.969397+0000","last_peered":"2023-01-01T17:39:56.969397+0000","last_clean":"2023-01-01T17:39:56.969397+0000","last_became_active":"2023-01-01T17:39:52.552766+0000","last_became_peered":"2023-01-01T17:39:52.552766+0000","last_unstale":"2023-01-01T17:39:56.969397+0000","last_undegraded":"2023-01-01T17:39:56.969397+0000","last_fullsized":"2023-01-01T17:39:56.969397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:47:31.929043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.967297+0000","last_change":"2023-01-01T17:39:52.961138+0000","last_active":"2023-01-01T17:39:56.967297+0000","last_peered":"2023-01-01T17:39:56.967297+0000","last_clean":"2023-01-01T17:39:56.967297+0000","last_became_active":"2023-01-01T17:39:52.960885+0000","last_became_peered":"2023-01-01T17:39:52.960885+0000","last_unstale":"2023-01-01T17:39:56.967297+0000","last_undegraded":"2023-01-01T17:39:56.967297+0000","last_fullsized":"2023-01-01T17:39:56.967297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:34:49.101183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.895602+0000","last_change":"2023-01-01T17:39:56.985985+0000","last_active":"2023-01-01T17:39:58.895602+0000","last_peered":"2023-01-01T17:39:58.895602+0000","last_clean":"2023-01-01T17:39:58.895602+0000","last_became_active":"2023-01-01T17:39:56.985568+0000","last_became_peered":"2023-01-01T17:39:56.985568+0000","last_unstale":"2023-01-01T17:39:58.895602+0000","last_undegraded":"2023-01-01T17:39:58.895602+0000","last_fullsized":"2023-01-01T17:39:58.895602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:02:45.626404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.970839+0000","last_change":"2023-01-01T17:39:52.543976+0000","last_active":"2023-01-01T17:39:56.970839+0000","last_peered":"2023-01-01T17:39:56.970839+0000","last_clean":"2023-01-01T17:39:56.970839+0000","last_became_active":"2023-01-01T17:39:52.543744+0000","last_became_peered":"2023-01-01T17:39:52.543744+0000","last_unstale":"2023-01-01T17:39:56.970839+0000","last_undegraded":"2023-01-01T17:39:56.970839+0000","last_fullsized":"2023-01-01T17:39:56.970839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:32:00.585258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.972793+0000","last_change":"2023-01-01T17:39:52.957073+0000","last_active":"2023-01-01T17:39:56.972793+0000","last_peered":"2023-01-01T17:39:56.972793+0000","last_clean":"2023-01-01T17:39:56.972793+0000","last_became_active":"2023-01-01T17:39:52.956802+0000","last_became_peered":"2023-01-01T17:39:52.956802+0000","last_unstale":"2023-01-01T17:39:56.972793+0000","last_undegraded":"2023-01-01T17:39:56.972793+0000","last_fullsized":"2023-01-01T17:39:56.972793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:38:17.390301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.474123+0000","last_change":"2023-01-01T17:39:56.985478+0000","last_active":"2023-01-01T17:39:58.474123+0000","last_peered":"2023-01-01T17:39:58.474123+0000","last_clean":"2023-01-01T17:39:58.474123+0000","last_became_active":"2023-01-01T17:39:56.985070+0000","last_became_peered":"2023-01-01T17:39:56.985070+0000","last_unstale":"2023-01-01T17:39:58.474123+0000","last_undegraded":"2023-01-01T17:39:58.474123+0000","last_fullsized":"2023-01-01T17:39:58.474123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:50:42.814791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.970934+0000","last_change":"2023-01-01T17:39:52.546754+0000","last_active":"2023-01-01T17:39:56.970934+0000","last_peered":"2023-01-01T17:39:56.970934+0000","last_clean":"2023-01-01T17:39:56.970934+0000","last_became_active":"2023-01-01T17:39:52.546448+0000","last_became_peered":"2023-01-01T17:39:52.546448+0000","last_unstale":"2023-01-01T17:39:56.970934+0000","last_undegraded":"2023-01-01T17:39:56.970934+0000","last_fullsized":"2023-01-01T17:39:56.970934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:05:31.448005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.973286+0000","last_change":"2023-01-01T17:39:52.961694+0000","last_active":"2023-01-01T17:39:56.973286+0000","last_peered":"2023-01-01T17:39:56.973286+0000","last_clean":"2023-01-01T17:39:56.973286+0000","last_became_active":"2023-01-01T17:39:52.961316+0000","last_became_peered":"2023-01-01T17:39:52.961316+0000","last_unstale":"2023-01-01T17:39:56.973286+0000","last_undegraded":"2023-01-01T17:39:56.973286+0000","last_fullsized":"2023-01-01T17:39:56.973286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T05:06:34.299709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.832171+0000","last_change":"2023-01-01T17:39:56.998170+0000","last_active":"2023-01-01T17:39:58.832171+0000","last_peered":"2023-01-01T17:39:58.832171+0000","last_clean":"2023-01-01T17:39:58.832171+0000","last_became_active":"2023-01-01T17:39:56.997838+0000","last_became_peered":"2023-01-01T17:39:56.997838+0000","last_unstale":"2023-01-01T17:39:58.832171+0000","last_undegraded":"2023-01-01T17:39:58.832171+0000","last_fullsized":"2023-01-01T17:39:58.832171+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:19:24.610726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.975082+0000","last_change":"2023-01-01T17:39:52.545957+0000","last_active":"2023-01-01T17:39:56.975082+0000","last_peered":"2023-01-01T17:39:56.975082+0000","last_clean":"2023-01-01T17:39:56.975082+0000","last_became_active":"2023-01-01T17:39:52.545673+0000","last_became_peered":"2023-01-01T17:39:52.545673+0000","last_unstale":"2023-01-01T17:39:56.975082+0000","last_undegraded":"2023-01-01T17:39:56.975082+0000","last_fullsized":"2023-01-01T17:39:56.975082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:56:28.713641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971764+0000","last_change":"2023-01-01T17:39:52.959871+0000","last_active":"2023-01-01T17:39:56.971764+0000","last_peered":"2023-01-01T17:39:56.971764+0000","last_clean":"2023-01-01T17:39:56.971764+0000","last_became_active":"2023-01-01T17:39:52.959385+0000","last_became_peered":"2023-01-01T17:39:52.959385+0000","last_unstale":"2023-01-01T17:39:56.971764+0000","last_undegraded":"2023-01-01T17:39:56.971764+0000","last_fullsized":"2023-01-01T17:39:56.971764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:13:17.225019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.439450+0000","last_change":"2023-01-01T17:39:56.986617+0000","last_active":"2023-01-01T17:39:57.439450+0000","last_peered":"2023-01-01T17:39:57.439450+0000","last_clean":"2023-01-01T17:39:57.439450+0000","last_became_active":"2023-01-01T17:39:56.986236+0000","last_became_peered":"2023-01-01T17:39:56.986236+0000","last_unstale":"2023-01-01T17:39:57.439450+0000","last_undegraded":"2023-01-01T17:39:57.439450+0000","last_fullsized":"2023-01-01T17:39:57.439450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:45:28.399373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966603+0000","last_change":"2023-01-01T17:39:52.552957+0000","last_active":"2023-01-01T17:39:56.966603+0000","last_peered":"2023-01-01T17:39:56.966603+0000","last_clean":"2023-01-01T17:39:56.966603+0000","last_became_active":"2023-01-01T17:39:52.552694+0000","last_became_peered":"2023-01-01T17:39:52.552694+0000","last_unstale":"2023-01-01T17:39:56.966603+0000","last_undegraded":"2023-01-01T17:39:56.966603+0000","last_fullsized":"2023-01-01T17:39:56.966603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:05:31.448005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.978572+0000","last_change":"2023-01-01T17:39:52.959416+0000","last_active":"2023-01-01T17:39:56.978572+0000","last_peered":"2023-01-01T17:39:56.978572+0000","last_clean":"2023-01-01T17:39:56.978572+0000","last_became_active":"2023-01-01T17:39:52.959092+0000","last_became_peered":"2023-01-01T17:39:52.959092+0000","last_unstale":"2023-01-01T17:39:56.978572+0000","last_undegraded":"2023-01-01T17:39:56.978572+0000","last_fullsized":"2023-01-01T17:39:56.978572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T05:23:17.274474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.979030+0000","last_change":"2023-01-01T17:39:52.960401+0000","last_active":"2023-01-01T17:39:56.979030+0000","last_peered":"2023-01-01T17:39:56.979030+0000","last_clean":"2023-01-01T17:39:56.979030+0000","last_became_active":"2023-01-01T17:39:52.960104+0000","last_became_peered":"2023-01-01T17:39:52.960104+0000","last_unstale":"2023-01-01T17:39:56.979030+0000","last_undegraded":"2023-01-01T17:39:56.979030+0000","last_fullsized":"2023-01-01T17:39:56.979030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T22:26:50.173884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971956+0000","last_change":"2023-01-01T17:39:52.961844+0000","last_active":"2023-01-01T17:39:56.971956+0000","last_peered":"2023-01-01T17:39:56.971956+0000","last_clean":"2023-01-01T17:39:56.971956+0000","last_became_active":"2023-01-01T17:39:52.961588+0000","last_became_peered":"2023-01-01T17:39:52.961588+0000","last_unstale":"2023-01-01T17:39:56.971956+0000","last_undegraded":"2023-01-01T17:39:56.971956+0000","last_fullsized":"2023-01-01T17:39:56.971956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:38:10.525560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.974677+0000","last_change":"2023-01-01T17:39:52.965441+0000","last_active":"2023-01-01T17:39:56.974677+0000","last_peered":"2023-01-01T17:39:56.974677+0000","last_clean":"2023-01-01T17:39:56.974677+0000","last_became_active":"2023-01-01T17:39:52.965156+0000","last_became_peered":"2023-01-01T17:39:52.965156+0000","last_unstale":"2023-01-01T17:39:56.974677+0000","last_undegraded":"2023-01-01T17:39:56.974677+0000","last_fullsized":"2023-01-01T17:39:56.974677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:57:37.343251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.974315+0000","last_change":"2023-01-01T17:39:52.949007+0000","last_active":"2023-01-01T17:39:56.974315+0000","last_peered":"2023-01-01T17:39:56.974315+0000","last_clean":"2023-01-01T17:39:56.974315+0000","last_became_active":"2023-01-01T17:39:52.948731+0000","last_became_peered":"2023-01-01T17:39:52.948731+0000","last_unstale":"2023-01-01T17:39:56.974315+0000","last_undegraded":"2023-01-01T17:39:56.974315+0000","last_fullsized":"2023-01-01T17:39:56.974315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:20:30.823975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.980912+0000","last_change":"2023-01-01T17:39:52.966309+0000","last_active":"2023-01-01T17:39:56.980912+0000","last_peered":"2023-01-01T17:39:56.980912+0000","last_clean":"2023-01-01T17:39:56.980912+0000","last_became_active":"2023-01-01T17:39:52.966028+0000","last_became_peered":"2023-01-01T17:39:52.966028+0000","last_unstale":"2023-01-01T17:39:56.980912+0000","last_undegraded":"2023-01-01T17:39:56.980912+0000","last_fullsized":"2023-01-01T17:39:56.980912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:04:29.980357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64598,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9052,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362788,"statfs":{"total":96636764160,"available":96627494912,"internally_reserved":0,"allocated":348160,"data_stored":699011,"data_compressed":32299,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8384,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363456,"statfs":{"total":96636764160,"available":96628178944,"internally_reserved":0,"allocated":253952,"data_stored":104726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8960,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362880,"statfs":{"total":96636764160,"available":96627589120,"internally_reserved":0,"allocated":319488,"data_stored":695094,"data_compressed":32299,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.246}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8452,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363388,"statfs":{"total":96636764160,"available":96628109312,"internally_reserved":0,"allocated":258048,"data_stored":105308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8384,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363456,"statfs":{"total":96636764160,"available":96628178944,"internally_reserved":0,"allocated":253952,"data_stored":104726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8452,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363388,"statfs":{"total":96636764160,"available":96628109312,"internally_reserved":0,"allocated":258048,"data_stored":104816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8532,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363308,"statfs":{"total":96636764160,"available":96628027392,"internally_reserved":0,"allocated":274432,"data_stored":108483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8456,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363384,"statfs":{"total":96636764160,"available":96628105216,"internally_reserved":0,"allocated":262144,"data_stored":105378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32299,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32299,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-01T17:40:10.653 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-01T17:40:10.809 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.809+0000 7f750c450700 1 Processor -- start 2023-01-01T17:40:10.809 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.809+0000 7f750c450700 1 -- start start 2023-01-01T17:40:10.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.810+0000 7f750c450700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f75040715d0 0x7f75041515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:10.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.810+0000 7f750c450700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f750406c980 0x7f750406cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:10.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.810+0000 7f750c450700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7504147ab0 con 0x7f75040c15c0 2023-01-01T17:40:10.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.810+0000 7f750c450700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7504151b90 con 0x7f750406c980 2023-01-01T17:40:10.812 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.810+0000 7f750c450700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7504155080 con 0x7f75040715d0 2023-01-01T17:40:10.812 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.810+0000 7f750a9ed700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f750406c980 0x7f750406cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:10.812 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.810+0000 7f750a9ed700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f750406c980 0x7f750406cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46490/0 (socket says 172.21.15.61:46490) 2023-01-01T17:40:10.812 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.810+0000 7f750a9ed700 1 -- 172.21.15.61:0/1333156829 learned_addr learned my addr 172.21.15.61:0/1333156829 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:10.812 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.810+0000 7f750a1ec700 1 --2- 172.21.15.61:0/1333156829 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f75040715d0 0x7f75041515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:10.812 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.811+0000 7f750a9ed700 1 -- 172.21.15.61:0/1333156829 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f75040715d0 msgr2=0x7f75041515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:10.812 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.811+0000 7f750a9ed700 1 --2- 172.21.15.61:0/1333156829 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f75040715d0 0x7f75041515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:10.812 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.811+0000 7f750a9ed700 1 -- 172.21.15.61:0/1333156829 >> v1:172.21.15.149:6789/0 conn(0x7f75040c15c0 legacy=0x7f750406a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:10.812 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.811+0000 7f750a9ed700 1 -- 172.21.15.61:0/1333156829 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75041542c0 con 0x7f750406c980 2023-01-01T17:40:10.813 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.811+0000 7f750a1ec700 1 --2- 172.21.15.61:0/1333156829 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f75040715d0 0x7f75041515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-01T17:40:10.813 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.811+0000 7f750a9ed700 1 --2- 172.21.15.61:0/1333156829 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f750406c980 0x7f750406cde0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f74fc009e50 tx=0x7f74fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5616fccda6039ace server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:10.813 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.811+0000 7f75091ea700 1 -- 172.21.15.61:0/1333156829 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc00e070 con 0x7f750406c980 2023-01-01T17:40:10.813 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.811+0000 7f75091ea700 1 -- 172.21.15.61:0/1333156829 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74fc00b9c0 con 0x7f750406c980 2023-01-01T17:40:10.813 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.811+0000 7f75091ea700 1 -- 172.21.15.61:0/1333156829 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc00bd70 con 0x7f750406c980 2023-01-01T17:40:10.813 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.811+0000 7f750c450700 1 -- 172.21.15.61:0/1333156829 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f750406c980 msgr2=0x7f750406cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:10.813 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.811+0000 7f750c450700 1 --2- 172.21.15.61:0/1333156829 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f750406c980 0x7f750406cde0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f74fc009e50 tx=0x7f74fc00b330 comp rx=0 tx=0).stop 2023-01-01T17:40:10.813 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.812+0000 7f750c450700 1 -- 172.21.15.61:0/1333156829 shutdown_connections 2023-01-01T17:40:10.813 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.812+0000 7f750c450700 1 --2- 172.21.15.61:0/1333156829 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f750406c980 0x7f750406cde0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:10.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.812+0000 7f750c450700 1 --2- 172.21.15.61:0/1333156829 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f75040715d0 0x7f75041515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:10.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.812+0000 7f750c450700 1 -- 172.21.15.61:0/1333156829 >> 172.21.15.61:0/1333156829 conn(0x7f75040c1f30 msgr2=0x7f75040c2330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:10.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.812+0000 7f750c450700 1 -- 172.21.15.61:0/1333156829 shutdown_connections 2023-01-01T17:40:10.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.812+0000 7f750c450700 1 -- 172.21.15.61:0/1333156829 wait complete. 2023-01-01T17:40:10.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.813+0000 7f750c450700 1 Processor -- start 2023-01-01T17:40:10.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.813+0000 7f750c450700 1 -- start start 2023-01-01T17:40:10.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.813+0000 7f750c450700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f750406c980 0x7f75040aaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:10.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.813+0000 7f750c450700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75040715d0 0x7f75040ba3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:10.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.813+0000 7f750c450700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f75040c15c0 0x7f75041531e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:10.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.813+0000 7f750c450700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75040ba900 con 0x7f750406c980 2023-01-01T17:40:10.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.814+0000 7f750c450700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75041ec9d0 con 0x7f75040715d0 2023-01-01T17:40:10.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.814+0000 7f750c450700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75040c5290 con 0x7f75040c15c0 2023-01-01T17:40:10.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.814+0000 7f750a1ec700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f750406c980 0x7f75040aaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:10.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.814+0000 7f750a1ec700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f750406c980 0x7f75040aaeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46494/0 (socket says 172.21.15.61:46494) 2023-01-01T17:40:10.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.814+0000 7f750a1ec700 1 -- 172.21.15.61:0/1209615097 learned_addr learned my addr 172.21.15.61:0/1209615097 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:10.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.814+0000 7f750a9ed700 1 --2- 172.21.15.61:0/1209615097 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f75040c15c0 0x7f75041531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:10.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.814+0000 7f75099eb700 1 --2- 172.21.15.61:0/1209615097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75040715d0 0x7f75040ba3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:10.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.814+0000 7f750a1ec700 1 -- 172.21.15.61:0/1209615097 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f75040c15c0 msgr2=0x7f75041531e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:10.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.814+0000 7f750a1ec700 1 --2- 172.21.15.61:0/1209615097 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f75040c15c0 0x7f75041531e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:10.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.814+0000 7f750a1ec700 1 -- 172.21.15.61:0/1209615097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75040715d0 msgr2=0x7f75040ba3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:10.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.814+0000 7f750a1ec700 1 --2- 172.21.15.61:0/1209615097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75040715d0 0x7f75040ba3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:10.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.814+0000 7f750a1ec700 1 -- 172.21.15.61:0/1209615097 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74fc009b30 con 0x7f750406c980 2023-01-01T17:40:10.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.814+0000 7f750a1ec700 1 --2- 172.21.15.61:0/1209615097 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f750406c980 0x7f75040aaeb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f74f400e810 tx=0x7f74f400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:10.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.814+0000 7f74faffd700 1 -- 172.21.15.61:0/1209615097 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f400c070 con 0x7f750406c980 2023-01-01T17:40:10.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.814+0000 7f74faffd700 1 -- 172.21.15.61:0/1209615097 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f4004230 con 0x7f750406c980 2023-01-01T17:40:10.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.814+0000 7f750c450700 1 -- 172.21.15.61:0/1209615097 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7504154880 con 0x7f750406c980 2023-01-01T17:40:10.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.814+0000 7f74faffd700 1 -- 172.21.15.61:0/1209615097 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f40036a0 con 0x7f750406c980 2023-01-01T17:40:10.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.814+0000 7f750c450700 1 -- 172.21.15.61:0/1209615097 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75041545a0 con 0x7f750406c980 2023-01-01T17:40:10.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.815+0000 7f750c450700 1 -- 172.21.15.61:0/1209615097 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7504154b60 con 0x7f750406c980 2023-01-01T17:40:10.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.816+0000 7f74faffd700 1 -- 172.21.15.61:0/1209615097 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f74f4019020 con 0x7f750406c980 2023-01-01T17:40:10.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.816+0000 7f74faffd700 1 --2- 172.21.15.61:0/1209615097 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f74e8063290 0x7f74e8065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:10.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.816+0000 7f75099eb700 1 --2- 172.21.15.61:0/1209615097 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f74e8063290 0x7f74e8065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:10.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.816+0000 7f74faffd700 1 -- 172.21.15.61:0/1209615097 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f74f407fa40 con 0x7f750406c980 2023-01-01T17:40:10.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.817+0000 7f75099eb700 1 --2- 172.21.15.61:0/1209615097 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f74e8063290 0x7f74e8065740 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f75040aae60 tx=0x7f7500009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:10.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:10.820+0000 7f74faffd700 1 -- 172.21.15.61:0/1209615097 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f74f404e800 con 0x7f750406c980 2023-01-01T17:40:11.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.005+0000 7f750c450700 1 -- 172.21.15.61:0/1209615097 --> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f750406f460 con 0x7f74e8063290 2023-01-01T17:40:11.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.015+0000 7f74faffd700 1 -- 172.21.15.61:0/1209615097 <== mgr.4101 v2:172.21.15.61:6832/94075 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367575 (secure 0 0 0) 0x7f750406f460 con 0x7f74e8063290 2023-01-01T17:40:11.020 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:40:11.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.018+0000 7f750c450700 1 -- 172.21.15.61:0/1209615097 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f74e8063290 msgr2=0x7f74e8065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:11.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.018+0000 7f750c450700 1 --2- 172.21.15.61:0/1209615097 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f74e8063290 0x7f74e8065740 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f75040aae60 tx=0x7f7500009040 comp rx=0 tx=0).stop 2023-01-01T17:40:11.023 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.018+0000 7f750c450700 1 -- 172.21.15.61:0/1209615097 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f750406c980 msgr2=0x7f75040aaeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:11.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.018+0000 7f750c450700 1 --2- 172.21.15.61:0/1209615097 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f750406c980 0x7f75040aaeb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f74f400e810 tx=0x7f74f400eb20 comp rx=0 tx=0).stop 2023-01-01T17:40:11.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.019+0000 7f750c450700 1 -- 172.21.15.61:0/1209615097 shutdown_connections 2023-01-01T17:40:11.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.019+0000 7f750c450700 1 --2- 172.21.15.61:0/1209615097 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f75040c15c0 0x7f75041531e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:11.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.019+0000 7f750c450700 1 --2- 172.21.15.61:0/1209615097 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f74e8063290 0x7f74e8065740 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:11.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.019+0000 7f750c450700 1 --2- 172.21.15.61:0/1209615097 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f750406c980 0x7f75040aaeb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:11.024 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.019+0000 7f750c450700 1 --2- 172.21.15.61:0/1209615097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f75040715d0 0x7f75040ba3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:11.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.019+0000 7f750c450700 1 -- 172.21.15.61:0/1209615097 >> 172.21.15.61:0/1209615097 conn(0x7f75040c1f30 msgr2=0x7f7504147190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:11.025 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.019+0000 7f750c450700 1 -- 172.21.15.61:0/1209615097 shutdown_connections 2023-01-01T17:40:11.026 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.019+0000 7f750c450700 1 -- 172.21.15.61:0/1209615097 wait complete. 2023-01-01T17:40:11.026 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-01-01T17:40:11.031 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2023-01-01T17:40:10.226616+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594867,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":68672,"kb_used_data":2176,"kb_used_omap":0,"kb_used_meta":66432,"kb_avail":754906048,"statfs":{"total":773094113280,"available":773023793152,"internally_reserved":0,"allocated":2228224,"data_stored":2027542,"data_compressed":64598,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":68026368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002575"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966937+0000","last_change":"2023-01-01T17:39:52.963330+0000","last_active":"2023-01-01T17:39:56.966937+0000","last_peered":"2023-01-01T17:39:56.966937+0000","last_clean":"2023-01-01T17:39:56.966937+0000","last_became_active":"2023-01-01T17:39:52.962891+0000","last_became_peered":"2023-01-01T17:39:52.962891+0000","last_unstale":"2023-01-01T17:39:56.966937+0000","last_undegraded":"2023-01-01T17:39:56.966937+0000","last_fullsized":"2023-01-01T17:39:56.966937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:04:10.357667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971778+0000","last_change":"2023-01-01T17:39:52.971796+0000","last_active":"2023-01-01T17:39:56.971778+0000","last_peered":"2023-01-01T17:39:56.971778+0000","last_clean":"2023-01-01T17:39:56.971778+0000","last_became_active":"2023-01-01T17:39:52.971531+0000","last_became_peered":"2023-01-01T17:39:52.971531+0000","last_unstale":"2023-01-01T17:39:56.971778+0000","last_undegraded":"2023-01-01T17:39:56.971778+0000","last_fullsized":"2023-01-01T17:39:56.971778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:27:49.306438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.973554+0000","last_change":"2023-01-01T17:39:52.964674+0000","last_active":"2023-01-01T17:39:56.973554+0000","last_peered":"2023-01-01T17:39:56.973554+0000","last_clean":"2023-01-01T17:39:56.973554+0000","last_became_active":"2023-01-01T17:39:52.964407+0000","last_became_peered":"2023-01-01T17:39:52.964407+0000","last_unstale":"2023-01-01T17:39:56.973554+0000","last_undegraded":"2023-01-01T17:39:56.973554+0000","last_fullsized":"2023-01-01T17:39:56.973554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:04:29.930818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.980904+0000","last_change":"2023-01-01T17:39:52.961108+0000","last_active":"2023-01-01T17:39:56.980904+0000","last_peered":"2023-01-01T17:39:56.980904+0000","last_clean":"2023-01-01T17:39:56.980904+0000","last_became_active":"2023-01-01T17:39:52.960846+0000","last_became_peered":"2023-01-01T17:39:52.960846+0000","last_unstale":"2023-01-01T17:39:56.980904+0000","last_undegraded":"2023-01-01T17:39:56.980904+0000","last_fullsized":"2023-01-01T17:39:56.980904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:04:29.980357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.969138+0000","last_change":"2023-01-01T17:39:52.968144+0000","last_active":"2023-01-01T17:39:56.969138+0000","last_peered":"2023-01-01T17:39:56.969138+0000","last_clean":"2023-01-01T17:39:56.969138+0000","last_became_active":"2023-01-01T17:39:52.965674+0000","last_became_peered":"2023-01-01T17:39:52.965674+0000","last_unstale":"2023-01-01T17:39:56.969138+0000","last_undegraded":"2023-01-01T17:39:56.969138+0000","last_fullsized":"2023-01-01T17:39:56.969138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:38:10.525560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.974768+0000","last_change":"2023-01-01T17:39:52.964599+0000","last_active":"2023-01-01T17:39:56.974768+0000","last_peered":"2023-01-01T17:39:56.974768+0000","last_clean":"2023-01-01T17:39:56.974768+0000","last_became_active":"2023-01-01T17:39:52.964336+0000","last_became_peered":"2023-01-01T17:39:52.964336+0000","last_unstale":"2023-01-01T17:39:56.974768+0000","last_undegraded":"2023-01-01T17:39:56.974768+0000","last_fullsized":"2023-01-01T17:39:56.974768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:02:42.190753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966415+0000","last_change":"2023-01-01T17:39:52.960039+0000","last_active":"2023-01-01T17:39:56.966415+0000","last_peered":"2023-01-01T17:39:56.966415+0000","last_clean":"2023-01-01T17:39:56.966415+0000","last_became_active":"2023-01-01T17:39:52.959724+0000","last_became_peered":"2023-01-01T17:39:52.959724+0000","last_unstale":"2023-01-01T17:39:56.966415+0000","last_undegraded":"2023-01-01T17:39:56.966415+0000","last_fullsized":"2023-01-01T17:39:56.966415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T22:42:37.419622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.970407+0000","last_change":"2023-01-01T17:39:52.963027+0000","last_active":"2023-01-01T17:39:56.970407+0000","last_peered":"2023-01-01T17:39:56.970407+0000","last_clean":"2023-01-01T17:39:56.970407+0000","last_became_active":"2023-01-01T17:39:52.962713+0000","last_became_peered":"2023-01-01T17:39:52.962713+0000","last_unstale":"2023-01-01T17:39:56.970407+0000","last_undegraded":"2023-01-01T17:39:56.970407+0000","last_fullsized":"2023-01-01T17:39:56.970407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T22:42:37.419622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966304+0000","last_change":"2023-01-01T17:39:52.967957+0000","last_active":"2023-01-01T17:39:56.966304+0000","last_peered":"2023-01-01T17:39:56.966304+0000","last_clean":"2023-01-01T17:39:56.966304+0000","last_became_active":"2023-01-01T17:39:52.967249+0000","last_became_peered":"2023-01-01T17:39:52.967249+0000","last_unstale":"2023-01-01T17:39:56.966304+0000","last_undegraded":"2023-01-01T17:39:56.966304+0000","last_fullsized":"2023-01-01T17:39:56.966304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:39:12.933552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971966+0000","last_change":"2023-01-01T17:39:52.966701+0000","last_active":"2023-01-01T17:39:56.971966+0000","last_peered":"2023-01-01T17:39:56.971966+0000","last_clean":"2023-01-01T17:39:56.971966+0000","last_became_active":"2023-01-01T17:39:52.966423+0000","last_became_peered":"2023-01-01T17:39:52.966423+0000","last_unstale":"2023-01-01T17:39:56.971966+0000","last_undegraded":"2023-01-01T17:39:56.971966+0000","last_fullsized":"2023-01-01T17:39:56.971966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:12:40.598666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.972841+0000","last_change":"2023-01-01T17:39:52.961555+0000","last_active":"2023-01-01T17:39:56.972841+0000","last_peered":"2023-01-01T17:39:56.972841+0000","last_clean":"2023-01-01T17:39:56.972841+0000","last_became_active":"2023-01-01T17:39:52.961192+0000","last_became_peered":"2023-01-01T17:39:52.961192+0000","last_unstale":"2023-01-01T17:39:56.972841+0000","last_undegraded":"2023-01-01T17:39:56.972841+0000","last_fullsized":"2023-01-01T17:39:56.972841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:37:22.833792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966452+0000","last_change":"2023-01-01T17:39:52.959421+0000","last_active":"2023-01-01T17:39:56.966452+0000","last_peered":"2023-01-01T17:39:56.966452+0000","last_clean":"2023-01-01T17:39:56.966452+0000","last_became_active":"2023-01-01T17:39:52.959094+0000","last_became_peered":"2023-01-01T17:39:52.959094+0000","last_unstale":"2023-01-01T17:39:56.966452+0000","last_undegraded":"2023-01-01T17:39:56.966452+0000","last_fullsized":"2023-01-01T17:39:56.966452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:06:59.618607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.967485+0000","last_change":"2023-01-01T17:39:52.957064+0000","last_active":"2023-01-01T17:39:56.967485+0000","last_peered":"2023-01-01T17:39:56.967485+0000","last_clean":"2023-01-01T17:39:56.967485+0000","last_became_active":"2023-01-01T17:39:52.956770+0000","last_became_peered":"2023-01-01T17:39:52.956770+0000","last_unstale":"2023-01-01T17:39:56.967485+0000","last_undegraded":"2023-01-01T17:39:56.967485+0000","last_fullsized":"2023-01-01T17:39:56.967485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:05:32.452823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.970532+0000","last_change":"2023-01-01T17:39:52.964133+0000","last_active":"2023-01-01T17:39:56.970532+0000","last_peered":"2023-01-01T17:39:56.970532+0000","last_clean":"2023-01-01T17:39:56.970532+0000","last_became_active":"2023-01-01T17:39:52.963864+0000","last_became_peered":"2023-01-01T17:39:52.963864+0000","last_unstale":"2023-01-01T17:39:56.970532+0000","last_undegraded":"2023-01-01T17:39:56.970532+0000","last_fullsized":"2023-01-01T17:39:56.970532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:21:06.881543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966333+0000","last_change":"2023-01-01T17:39:52.960044+0000","last_active":"2023-01-01T17:39:56.966333+0000","last_peered":"2023-01-01T17:39:56.966333+0000","last_clean":"2023-01-01T17:39:56.966333+0000","last_became_active":"2023-01-01T17:39:52.959767+0000","last_became_peered":"2023-01-01T17:39:52.959767+0000","last_unstale":"2023-01-01T17:39:56.966333+0000","last_undegraded":"2023-01-01T17:39:56.966333+0000","last_fullsized":"2023-01-01T17:39:56.966333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:17:10.326486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.978656+0000","last_change":"2023-01-01T17:39:52.964688+0000","last_active":"2023-01-01T17:39:56.978656+0000","last_peered":"2023-01-01T17:39:56.978656+0000","last_clean":"2023-01-01T17:39:56.978656+0000","last_became_active":"2023-01-01T17:39:52.964376+0000","last_became_peered":"2023-01-01T17:39:52.964376+0000","last_unstale":"2023-01-01T17:39:56.978656+0000","last_undegraded":"2023-01-01T17:39:56.978656+0000","last_fullsized":"2023-01-01T17:39:56.978656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T02:02:52.710038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966403+0000","last_change":"2023-01-01T17:39:52.967459+0000","last_active":"2023-01-01T17:39:56.966403+0000","last_peered":"2023-01-01T17:39:56.966403+0000","last_clean":"2023-01-01T17:39:56.966403+0000","last_became_active":"2023-01-01T17:39:52.965683+0000","last_became_peered":"2023-01-01T17:39:52.965683+0000","last_unstale":"2023-01-01T17:39:56.966403+0000","last_undegraded":"2023-01-01T17:39:56.966403+0000","last_fullsized":"2023-01-01T17:39:56.966403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:17:10.326486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.972847+0000","last_change":"2023-01-01T17:39:52.961461+0000","last_active":"2023-01-01T17:39:56.972847+0000","last_peered":"2023-01-01T17:39:56.972847+0000","last_clean":"2023-01-01T17:39:56.972847+0000","last_became_active":"2023-01-01T17:39:52.961145+0000","last_became_peered":"2023-01-01T17:39:52.961145+0000","last_unstale":"2023-01-01T17:39:56.972847+0000","last_undegraded":"2023-01-01T17:39:56.972847+0000","last_fullsized":"2023-01-01T17:39:56.972847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:20:30.823975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.967766+0000","last_change":"2023-01-01T17:39:52.958062+0000","last_active":"2023-01-01T17:39:56.967766+0000","last_peered":"2023-01-01T17:39:56.967766+0000","last_clean":"2023-01-01T17:39:56.967766+0000","last_became_active":"2023-01-01T17:39:52.957780+0000","last_became_peered":"2023-01-01T17:39:52.957780+0000","last_unstale":"2023-01-01T17:39:56.967766+0000","last_undegraded":"2023-01-01T17:39:56.967766+0000","last_fullsized":"2023-01-01T17:39:56.967766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:47:32.933861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971406+0000","last_change":"2023-01-01T17:39:52.965920+0000","last_active":"2023-01-01T17:39:56.971406+0000","last_peered":"2023-01-01T17:39:56.971406+0000","last_clean":"2023-01-01T17:39:56.971406+0000","last_became_active":"2023-01-01T17:39:52.965681+0000","last_became_peered":"2023-01-01T17:39:52.965681+0000","last_unstale":"2023-01-01T17:39:56.971406+0000","last_undegraded":"2023-01-01T17:39:56.971406+0000","last_fullsized":"2023-01-01T17:39:56.971406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:28:47.766864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.967121+0000","last_change":"2023-01-01T17:39:52.955931+0000","last_active":"2023-01-01T17:39:56.967121+0000","last_peered":"2023-01-01T17:39:56.967121+0000","last_clean":"2023-01-01T17:39:56.967121+0000","last_became_active":"2023-01-01T17:39:52.955405+0000","last_became_peered":"2023-01-01T17:39:52.955405+0000","last_unstale":"2023-01-01T17:39:56.967121+0000","last_undegraded":"2023-01-01T17:39:56.967121+0000","last_fullsized":"2023-01-01T17:39:56.967121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:39:12.933552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966623+0000","last_change":"2023-01-01T17:39:52.972351+0000","last_active":"2023-01-01T17:39:56.966623+0000","last_peered":"2023-01-01T17:39:56.966623+0000","last_clean":"2023-01-01T17:39:56.966623+0000","last_became_active":"2023-01-01T17:39:52.972060+0000","last_became_peered":"2023-01-01T17:39:52.972060+0000","last_unstale":"2023-01-01T17:39:56.966623+0000","last_undegraded":"2023-01-01T17:39:56.966623+0000","last_fullsized":"2023-01-01T17:39:56.966623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:13:17.225019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971864+0000","last_change":"2023-01-01T17:39:52.959545+0000","last_active":"2023-01-01T17:39:56.971864+0000","last_peered":"2023-01-01T17:39:56.971864+0000","last_clean":"2023-01-01T17:39:56.971864+0000","last_became_active":"2023-01-01T17:39:52.959020+0000","last_became_peered":"2023-01-01T17:39:52.959020+0000","last_unstale":"2023-01-01T17:39:56.971864+0000","last_undegraded":"2023-01-01T17:39:56.971864+0000","last_fullsized":"2023-01-01T17:39:56.971864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:20:51.060158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966447+0000","last_change":"2023-01-01T17:39:52.959152+0000","last_active":"2023-01-01T17:39:56.966447+0000","last_peered":"2023-01-01T17:39:56.966447+0000","last_clean":"2023-01-01T17:39:56.966447+0000","last_became_active":"2023-01-01T17:39:52.958925+0000","last_became_peered":"2023-01-01T17:39:52.958925+0000","last_unstale":"2023-01-01T17:39:56.966447+0000","last_undegraded":"2023-01-01T17:39:56.966447+0000","last_fullsized":"2023-01-01T17:39:56.966447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:27:49.306438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.981469+0000","last_change":"2023-01-01T17:39:52.970401+0000","last_active":"2023-01-01T17:39:56.981469+0000","last_peered":"2023-01-01T17:39:56.981469+0000","last_clean":"2023-01-01T17:39:56.981469+0000","last_became_active":"2023-01-01T17:39:52.970123+0000","last_became_peered":"2023-01-01T17:39:52.970123+0000","last_unstale":"2023-01-01T17:39:56.981469+0000","last_undegraded":"2023-01-01T17:39:56.981469+0000","last_fullsized":"2023-01-01T17:39:56.981469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T22:42:37.419622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.981509+0000","last_change":"2023-01-01T17:39:52.966659+0000","last_active":"2023-01-01T17:39:56.981509+0000","last_peered":"2023-01-01T17:39:56.981509+0000","last_clean":"2023-01-01T17:39:56.981509+0000","last_became_active":"2023-01-01T17:39:52.966510+0000","last_became_peered":"2023-01-01T17:39:52.966510+0000","last_unstale":"2023-01-01T17:39:56.981509+0000","last_undegraded":"2023-01-01T17:39:56.981509+0000","last_fullsized":"2023-01-01T17:39:56.981509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:21:06.881543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971060+0000","last_change":"2023-01-01T17:39:52.965968+0000","last_active":"2023-01-01T17:39:56.971060+0000","last_peered":"2023-01-01T17:39:56.971060+0000","last_clean":"2023-01-01T17:39:56.971060+0000","last_became_active":"2023-01-01T17:39:52.965515+0000","last_became_peered":"2023-01-01T17:39:52.965515+0000","last_unstale":"2023-01-01T17:39:56.971060+0000","last_undegraded":"2023-01-01T17:39:56.971060+0000","last_fullsized":"2023-01-01T17:39:56.971060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:39:12.933552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.832942+0000","last_change":"2023-01-01T17:39:56.985909+0000","last_active":"2023-01-01T17:39:58.832942+0000","last_peered":"2023-01-01T17:39:58.832942+0000","last_clean":"2023-01-01T17:39:58.832942+0000","last_became_active":"2023-01-01T17:39:56.985529+0000","last_became_peered":"2023-01-01T17:39:56.985529+0000","last_unstale":"2023-01-01T17:39:58.832942+0000","last_undegraded":"2023-01-01T17:39:58.832942+0000","last_fullsized":"2023-01-01T17:39:58.832942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:52:49.314145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.973444+0000","last_change":"2023-01-01T17:39:52.544503+0000","last_active":"2023-01-01T17:39:56.973444+0000","last_peered":"2023-01-01T17:39:56.973444+0000","last_clean":"2023-01-01T17:39:56.973444+0000","last_became_active":"2023-01-01T17:39:52.544174+0000","last_became_peered":"2023-01-01T17:39:52.544174+0000","last_unstale":"2023-01-01T17:39:56.973444+0000","last_undegraded":"2023-01-01T17:39:56.973444+0000","last_fullsized":"2023-01-01T17:39:56.973444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:04:09.352850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.975913+0000","last_change":"2023-01-01T17:39:52.961218+0000","last_active":"2023-01-01T17:39:56.975913+0000","last_peered":"2023-01-01T17:39:56.975913+0000","last_clean":"2023-01-01T17:39:56.975913+0000","last_became_active":"2023-01-01T17:39:52.960909+0000","last_became_peered":"2023-01-01T17:39:52.960909+0000","last_unstale":"2023-01-01T17:39:56.975913+0000","last_undegraded":"2023-01-01T17:39:56.975913+0000","last_fullsized":"2023-01-01T17:39:56.975913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:27:49.306438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.397722+0000","last_change":"2023-01-01T17:39:56.983018+0000","last_active":"2023-01-01T17:39:57.397722+0000","last_peered":"2023-01-01T17:39:57.397722+0000","last_clean":"2023-01-01T17:39:57.397722+0000","last_became_active":"2023-01-01T17:39:56.981943+0000","last_became_peered":"2023-01-01T17:39:56.981943+0000","last_unstale":"2023-01-01T17:39:57.397722+0000","last_undegraded":"2023-01-01T17:39:57.397722+0000","last_fullsized":"2023-01-01T17:39:57.397722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:53:49.928875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.980811+0000","last_change":"2023-01-01T17:39:52.548955+0000","last_active":"2023-01-01T17:39:56.980811+0000","last_peered":"2023-01-01T17:39:56.980811+0000","last_clean":"2023-01-01T17:39:56.980811+0000","last_became_active":"2023-01-01T17:39:52.548746+0000","last_became_peered":"2023-01-01T17:39:52.548746+0000","last_unstale":"2023-01-01T17:39:56.980811+0000","last_undegraded":"2023-01-01T17:39:56.980811+0000","last_fullsized":"2023-01-01T17:39:56.980811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:48:45.787227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.968330+0000","last_change":"2023-01-01T17:39:52.967463+0000","last_active":"2023-01-01T17:39:56.968330+0000","last_peered":"2023-01-01T17:39:56.968330+0000","last_clean":"2023-01-01T17:39:56.968330+0000","last_became_active":"2023-01-01T17:39:52.965478+0000","last_became_peered":"2023-01-01T17:39:52.965478+0000","last_unstale":"2023-01-01T17:39:56.968330+0000","last_undegraded":"2023-01-01T17:39:56.968330+0000","last_fullsized":"2023-01-01T17:39:56.968330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T05:06:34.299709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.437445+0000","last_change":"2023-01-01T17:39:56.986080+0000","last_active":"2023-01-01T17:39:57.437445+0000","last_peered":"2023-01-01T17:39:57.437445+0000","last_clean":"2023-01-01T17:39:57.437445+0000","last_became_active":"2023-01-01T17:39:56.985584+0000","last_became_peered":"2023-01-01T17:39:56.985584+0000","last_unstale":"2023-01-01T17:39:57.437445+0000","last_undegraded":"2023-01-01T17:39:57.437445+0000","last_fullsized":"2023-01-01T17:39:57.437445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:14:54.324576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971939+0000","last_change":"2023-01-01T17:39:52.542192+0000","last_active":"2023-01-01T17:39:56.971939+0000","last_peered":"2023-01-01T17:39:56.971939+0000","last_clean":"2023-01-01T17:39:56.971939+0000","last_became_active":"2023-01-01T17:39:52.541722+0000","last_became_peered":"2023-01-01T17:39:52.541722+0000","last_unstale":"2023-01-01T17:39:56.971939+0000","last_undegraded":"2023-01-01T17:39:56.971939+0000","last_fullsized":"2023-01-01T17:39:56.971939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:05:31.448005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.981286+0000","last_change":"2023-01-01T17:39:52.963441+0000","last_active":"2023-01-01T17:39:56.981286+0000","last_peered":"2023-01-01T17:39:56.981286+0000","last_clean":"2023-01-01T17:39:56.981286+0000","last_became_active":"2023-01-01T17:39:52.963185+0000","last_became_peered":"2023-01-01T17:39:52.963185+0000","last_unstale":"2023-01-01T17:39:56.981286+0000","last_undegraded":"2023-01-01T17:39:56.981286+0000","last_fullsized":"2023-01-01T17:39:56.981286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:51:02.120858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.397417+0000","last_change":"2023-01-01T17:39:56.986618+0000","last_active":"2023-01-01T17:39:57.397417+0000","last_peered":"2023-01-01T17:39:57.397417+0000","last_clean":"2023-01-01T17:39:57.397417+0000","last_became_active":"2023-01-01T17:39:56.986194+0000","last_became_peered":"2023-01-01T17:39:56.986194+0000","last_unstale":"2023-01-01T17:39:57.397417+0000","last_undegraded":"2023-01-01T17:39:57.397417+0000","last_fullsized":"2023-01-01T17:39:57.397417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:20:54.495809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966504+0000","last_change":"2023-01-01T17:39:52.549532+0000","last_active":"2023-01-01T17:39:56.966504+0000","last_peered":"2023-01-01T17:39:56.966504+0000","last_clean":"2023-01-01T17:39:56.966504+0000","last_became_active":"2023-01-01T17:39:52.546547+0000","last_became_peered":"2023-01-01T17:39:52.546547+0000","last_unstale":"2023-01-01T17:39:56.966504+0000","last_undegraded":"2023-01-01T17:39:56.966504+0000","last_fullsized":"2023-01-01T17:39:56.966504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:04:09.352850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971830+0000","last_change":"2023-01-01T17:39:52.958851+0000","last_active":"2023-01-01T17:39:56.971830+0000","last_peered":"2023-01-01T17:39:56.971830+0000","last_clean":"2023-01-01T17:39:56.971830+0000","last_became_active":"2023-01-01T17:39:52.958452+0000","last_became_peered":"2023-01-01T17:39:52.958452+0000","last_unstale":"2023-01-01T17:39:56.971830+0000","last_undegraded":"2023-01-01T17:39:56.971830+0000","last_fullsized":"2023-01-01T17:39:56.971830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:53:46.493224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.895404+0000","last_change":"2023-01-01T17:39:56.984155+0000","last_active":"2023-01-01T17:39:58.895404+0000","last_peered":"2023-01-01T17:39:58.895404+0000","last_clean":"2023-01-01T17:39:58.895404+0000","last_became_active":"2023-01-01T17:39:56.983766+0000","last_became_peered":"2023-01-01T17:39:56.983766+0000","last_unstale":"2023-01-01T17:39:58.895404+0000","last_undegraded":"2023-01-01T17:39:58.895404+0000","last_fullsized":"2023-01-01T17:39:58.895404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:27:23.085160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971866+0000","last_change":"2023-01-01T17:39:52.543588+0000","last_active":"2023-01-01T17:39:56.971866+0000","last_peered":"2023-01-01T17:39:56.971866+0000","last_clean":"2023-01-01T17:39:56.971866+0000","last_became_active":"2023-01-01T17:39:52.543119+0000","last_became_peered":"2023-01-01T17:39:52.543119+0000","last_unstale":"2023-01-01T17:39:56.971866+0000","last_undegraded":"2023-01-01T17:39:56.971866+0000","last_fullsized":"2023-01-01T17:39:56.971866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:04:09.352850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971673+0000","last_change":"2023-01-01T17:39:52.949406+0000","last_active":"2023-01-01T17:39:56.971673+0000","last_peered":"2023-01-01T17:39:56.971673+0000","last_clean":"2023-01-01T17:39:56.971673+0000","last_became_active":"2023-01-01T17:39:52.949198+0000","last_became_peered":"2023-01-01T17:39:52.949198+0000","last_unstale":"2023-01-01T17:39:56.971673+0000","last_undegraded":"2023-01-01T17:39:56.971673+0000","last_fullsized":"2023-01-01T17:39:56.971673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:39:12.933552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.396744+0000","last_change":"2023-01-01T17:39:56.988325+0000","last_active":"2023-01-01T17:39:57.396744+0000","last_peered":"2023-01-01T17:39:57.396744+0000","last_clean":"2023-01-01T17:39:57.396744+0000","last_became_active":"2023-01-01T17:39:56.987892+0000","last_became_peered":"2023-01-01T17:39:56.987892+0000","last_unstale":"2023-01-01T17:39:57.396744+0000","last_undegraded":"2023-01-01T17:39:57.396744+0000","last_fullsized":"2023-01-01T17:39:57.396744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:59:18.287257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966680+0000","last_change":"2023-01-01T17:39:52.551693+0000","last_active":"2023-01-01T17:39:56.966680+0000","last_peered":"2023-01-01T17:39:56.966680+0000","last_clean":"2023-01-01T17:39:56.966680+0000","last_became_active":"2023-01-01T17:39:52.551402+0000","last_became_peered":"2023-01-01T17:39:52.551402+0000","last_unstale":"2023-01-01T17:39:56.966680+0000","last_undegraded":"2023-01-01T17:39:56.966680+0000","last_fullsized":"2023-01-01T17:39:56.966680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:56:28.713641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.981128+0000","last_change":"2023-01-01T17:39:52.972567+0000","last_active":"2023-01-01T17:39:56.981128+0000","last_peered":"2023-01-01T17:39:56.981128+0000","last_clean":"2023-01-01T17:39:56.981128+0000","last_became_active":"2023-01-01T17:39:52.971771+0000","last_became_peered":"2023-01-01T17:39:52.971771+0000","last_unstale":"2023-01-01T17:39:56.981128+0000","last_undegraded":"2023-01-01T17:39:56.981128+0000","last_fullsized":"2023-01-01T17:39:56.981128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T22:26:50.173884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.439549+0000","last_change":"2023-01-01T17:39:56.984259+0000","last_active":"2023-01-01T17:39:57.439549+0000","last_peered":"2023-01-01T17:39:57.439549+0000","last_clean":"2023-01-01T17:39:57.439549+0000","last_became_active":"2023-01-01T17:39:56.983826+0000","last_became_peered":"2023-01-01T17:39:56.983826+0000","last_unstale":"2023-01-01T17:39:57.439549+0000","last_undegraded":"2023-01-01T17:39:57.439549+0000","last_fullsized":"2023-01-01T17:39:57.439549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T05:23:20.710125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:40:01.425525+0000","last_change":"2023-01-01T17:39:52.542307+0000","last_active":"2023-01-01T17:40:01.425525+0000","last_peered":"2023-01-01T17:40:01.425525+0000","last_clean":"2023-01-01T17:40:01.425525+0000","last_became_active":"2023-01-01T17:39:52.542004+0000","last_became_peered":"2023-01-01T17:39:52.542004+0000","last_unstale":"2023-01-01T17:40:01.425525+0000","last_undegraded":"2023-01-01T17:40:01.425525+0000","last_fullsized":"2023-01-01T17:40:01.425525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:34:48.096366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3701,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.973005+0000","last_change":"2023-01-01T17:39:52.965551+0000","last_active":"2023-01-01T17:39:56.973005+0000","last_peered":"2023-01-01T17:39:56.973005+0000","last_clean":"2023-01-01T17:39:56.973005+0000","last_became_active":"2023-01-01T17:39:52.965295+0000","last_became_peered":"2023-01-01T17:39:52.965295+0000","last_unstale":"2023-01-01T17:39:56.973005+0000","last_undegraded":"2023-01-01T17:39:56.973005+0000","last_fullsized":"2023-01-01T17:39:56.973005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:45:24.963723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.474391+0000","last_change":"2023-01-01T17:39:56.988193+0000","last_active":"2023-01-01T17:39:58.474391+0000","last_peered":"2023-01-01T17:39:58.474391+0000","last_clean":"2023-01-01T17:39:58.474391+0000","last_became_active":"2023-01-01T17:39:56.987742+0000","last_became_peered":"2023-01-01T17:39:56.987742+0000","last_unstale":"2023-01-01T17:39:58.474391+0000","last_undegraded":"2023-01-01T17:39:58.474391+0000","last_fullsized":"2023-01-01T17:39:58.474391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:02:01.149781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.967223+0000","last_change":"2023-01-01T17:39:52.544115+0000","last_active":"2023-01-01T17:39:56.967223+0000","last_peered":"2023-01-01T17:39:56.967223+0000","last_clean":"2023-01-01T17:39:56.967223+0000","last_became_active":"2023-01-01T17:39:52.543262+0000","last_became_peered":"2023-01-01T17:39:52.543262+0000","last_unstale":"2023-01-01T17:39:56.967223+0000","last_undegraded":"2023-01-01T17:39:56.967223+0000","last_fullsized":"2023-01-01T17:39:56.967223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:04:28.975539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.976885+0000","last_change":"2023-01-01T17:39:52.961302+0000","last_active":"2023-01-01T17:39:56.976885+0000","last_peered":"2023-01-01T17:39:56.976885+0000","last_clean":"2023-01-01T17:39:56.976885+0000","last_became_active":"2023-01-01T17:39:52.960989+0000","last_became_peered":"2023-01-01T17:39:52.960989+0000","last_unstale":"2023-01-01T17:39:56.976885+0000","last_undegraded":"2023-01-01T17:39:56.976885+0000","last_fullsized":"2023-01-01T17:39:56.976885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:12:40.598666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.396961+0000","last_change":"2023-01-01T17:39:56.991710+0000","last_active":"2023-01-01T17:39:57.396961+0000","last_peered":"2023-01-01T17:39:57.396961+0000","last_clean":"2023-01-01T17:39:57.396961+0000","last_became_active":"2023-01-01T17:39:56.990850+0000","last_became_peered":"2023-01-01T17:39:56.990850+0000","last_unstale":"2023-01-01T17:39:57.396961+0000","last_undegraded":"2023-01-01T17:39:57.396961+0000","last_fullsized":"2023-01-01T17:39:57.396961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:02:01.149781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966815+0000","last_change":"2023-01-01T17:39:52.545791+0000","last_active":"2023-01-01T17:39:56.966815+0000","last_peered":"2023-01-01T17:39:56.966815+0000","last_clean":"2023-01-01T17:39:56.966815+0000","last_became_active":"2023-01-01T17:39:52.545488+0000","last_became_peered":"2023-01-01T17:39:52.545488+0000","last_unstale":"2023-01-01T17:39:56.966815+0000","last_undegraded":"2023-01-01T17:39:56.966815+0000","last_fullsized":"2023-01-01T17:39:56.966815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:56:28.713641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971022+0000","last_change":"2023-01-01T17:39:52.965778+0000","last_active":"2023-01-01T17:39:56.971022+0000","last_peered":"2023-01-01T17:39:56.971022+0000","last_clean":"2023-01-01T17:39:56.971022+0000","last_became_active":"2023-01-01T17:39:52.965147+0000","last_became_peered":"2023-01-01T17:39:52.965147+0000","last_unstale":"2023-01-01T17:39:56.971022+0000","last_undegraded":"2023-01-01T17:39:56.971022+0000","last_fullsized":"2023-01-01T17:39:56.971022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:17:10.326486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.396845+0000","last_change":"2023-01-01T17:39:56.986717+0000","last_active":"2023-01-01T17:39:57.396845+0000","last_peered":"2023-01-01T17:39:57.396845+0000","last_clean":"2023-01-01T17:39:57.396845+0000","last_became_active":"2023-01-01T17:39:56.986276+0000","last_became_peered":"2023-01-01T17:39:56.986276+0000","last_unstale":"2023-01-01T17:39:57.396845+0000","last_undegraded":"2023-01-01T17:39:57.396845+0000","last_fullsized":"2023-01-01T17:39:57.396845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:04:46.047782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966234+0000","last_change":"2023-01-01T17:39:52.544050+0000","last_active":"2023-01-01T17:39:56.966234+0000","last_peered":"2023-01-01T17:39:56.966234+0000","last_clean":"2023-01-01T17:39:56.966234+0000","last_became_active":"2023-01-01T17:39:52.543519+0000","last_became_peered":"2023-01-01T17:39:52.543519+0000","last_unstale":"2023-01-01T17:39:56.966234+0000","last_undegraded":"2023-01-01T17:39:56.966234+0000","last_fullsized":"2023-01-01T17:39:56.966234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T22:26:49.169066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.968604+0000","last_change":"2023-01-01T17:39:52.967678+0000","last_active":"2023-01-01T17:39:56.968604+0000","last_peered":"2023-01-01T17:39:56.968604+0000","last_clean":"2023-01-01T17:39:56.968604+0000","last_became_active":"2023-01-01T17:39:52.965616+0000","last_became_peered":"2023-01-01T17:39:52.965616+0000","last_unstale":"2023-01-01T17:39:56.968604+0000","last_undegraded":"2023-01-01T17:39:56.968604+0000","last_fullsized":"2023-01-01T17:39:56.968604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T22:42:37.419622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.474167+0000","last_change":"2023-01-01T17:39:56.987972+0000","last_active":"2023-01-01T17:39:58.474167+0000","last_peered":"2023-01-01T17:39:58.474167+0000","last_clean":"2023-01-01T17:39:58.474167+0000","last_became_active":"2023-01-01T17:39:56.987575+0000","last_became_peered":"2023-01-01T17:39:56.987575+0000","last_unstale":"2023-01-01T17:39:58.474167+0000","last_undegraded":"2023-01-01T17:39:58.474167+0000","last_fullsized":"2023-01-01T17:39:58.474167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T22:56:37.998610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.979048+0000","last_change":"2023-01-01T17:39:52.553331+0000","last_active":"2023-01-01T17:39:56.979048+0000","last_peered":"2023-01-01T17:39:56.979048+0000","last_clean":"2023-01-01T17:39:56.979048+0000","last_became_active":"2023-01-01T17:39:52.553030+0000","last_became_peered":"2023-01-01T17:39:52.553030+0000","last_unstale":"2023-01-01T17:39:56.979048+0000","last_undegraded":"2023-01-01T17:39:56.979048+0000","last_fullsized":"2023-01-01T17:39:56.979048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:21:53.166663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.975027+0000","last_change":"2023-01-01T17:39:52.949026+0000","last_active":"2023-01-01T17:39:56.975027+0000","last_peered":"2023-01-01T17:39:56.975027+0000","last_clean":"2023-01-01T17:39:56.975027+0000","last_became_active":"2023-01-01T17:39:52.948779+0000","last_became_peered":"2023-01-01T17:39:52.948779+0000","last_unstale":"2023-01-01T17:39:56.975027+0000","last_undegraded":"2023-01-01T17:39:56.975027+0000","last_fullsized":"2023-01-01T17:39:56.975027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T05:06:34.299709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.895796+0000","last_change":"2023-01-01T17:39:56.983900+0000","last_active":"2023-01-01T17:39:58.895796+0000","last_peered":"2023-01-01T17:39:58.895796+0000","last_clean":"2023-01-01T17:39:58.895796+0000","last_became_active":"2023-01-01T17:39:56.983523+0000","last_became_peered":"2023-01-01T17:39:56.983523+0000","last_unstale":"2023-01-01T17:39:58.895796+0000","last_undegraded":"2023-01-01T17:39:58.895796+0000","last_fullsized":"2023-01-01T17:39:58.895796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:45:28.399373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.968788+0000","last_change":"2023-01-01T17:39:52.543689+0000","last_active":"2023-01-01T17:39:56.968788+0000","last_peered":"2023-01-01T17:39:56.968788+0000","last_clean":"2023-01-01T17:39:56.968788+0000","last_became_active":"2023-01-01T17:39:52.543296+0000","last_became_peered":"2023-01-01T17:39:52.543296+0000","last_unstale":"2023-01-01T17:39:56.968788+0000","last_undegraded":"2023-01-01T17:39:56.968788+0000","last_fullsized":"2023-01-01T17:39:56.968788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T02:44:27.478991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.970314+0000","last_change":"2023-01-01T17:39:52.965596+0000","last_active":"2023-01-01T17:39:56.970314+0000","last_peered":"2023-01-01T17:39:56.970314+0000","last_clean":"2023-01-01T17:39:56.970314+0000","last_became_active":"2023-01-01T17:39:52.965299+0000","last_became_peered":"2023-01-01T17:39:52.965299+0000","last_unstale":"2023-01-01T17:39:56.970314+0000","last_undegraded":"2023-01-01T17:39:56.970314+0000","last_fullsized":"2023-01-01T17:39:56.970314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:29:27.193367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.393206+0000","last_change":"2023-01-01T17:39:56.985023+0000","last_active":"2023-01-01T17:39:57.393206+0000","last_peered":"2023-01-01T17:39:57.393206+0000","last_clean":"2023-01-01T17:39:57.393206+0000","last_became_active":"2023-01-01T17:39:56.984658+0000","last_became_peered":"2023-01-01T17:39:56.984658+0000","last_unstale":"2023-01-01T17:39:57.393206+0000","last_undegraded":"2023-01-01T17:39:57.393206+0000","last_fullsized":"2023-01-01T17:39:57.393206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:20:54.495809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.968602+0000","last_change":"2023-01-01T17:39:52.544983+0000","last_active":"2023-01-01T17:39:56.968602+0000","last_peered":"2023-01-01T17:39:56.968602+0000","last_clean":"2023-01-01T17:39:56.968602+0000","last_became_active":"2023-01-01T17:39:52.543540+0000","last_became_peered":"2023-01-01T17:39:52.543540+0000","last_unstale":"2023-01-01T17:39:56.968602+0000","last_undegraded":"2023-01-01T17:39:56.968602+0000","last_fullsized":"2023-01-01T17:39:56.968602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:51:01.116040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.975618+0000","last_change":"2023-01-01T17:39:52.961386+0000","last_active":"2023-01-01T17:39:56.975618+0000","last_peered":"2023-01-01T17:39:56.975618+0000","last_clean":"2023-01-01T17:39:56.975618+0000","last_became_active":"2023-01-01T17:39:52.961095+0000","last_became_peered":"2023-01-01T17:39:52.961095+0000","last_unstale":"2023-01-01T17:39:56.975618+0000","last_undegraded":"2023-01-01T17:39:56.975618+0000","last_fullsized":"2023-01-01T17:39:56.975618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:02:40.763669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.393555+0000","last_change":"2023-01-01T17:39:56.986859+0000","last_active":"2023-01-01T17:39:57.393555+0000","last_peered":"2023-01-01T17:39:57.393555+0000","last_clean":"2023-01-01T17:39:57.393555+0000","last_became_active":"2023-01-01T17:39:56.986501+0000","last_became_peered":"2023-01-01T17:39:56.986501+0000","last_unstale":"2023-01-01T17:39:57.393555+0000","last_undegraded":"2023-01-01T17:39:57.393555+0000","last_fullsized":"2023-01-01T17:39:57.393555+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:37:26.269443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966564+0000","last_change":"2023-01-01T17:39:52.547827+0000","last_active":"2023-01-01T17:39:56.966564+0000","last_peered":"2023-01-01T17:39:56.966564+0000","last_clean":"2023-01-01T17:39:56.966564+0000","last_became_active":"2023-01-01T17:39:52.547578+0000","last_became_peered":"2023-01-01T17:39:52.547578+0000","last_unstale":"2023-01-01T17:39:56.966564+0000","last_undegraded":"2023-01-01T17:39:56.966564+0000","last_fullsized":"2023-01-01T17:39:56.966564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:32:00.585258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.979287+0000","last_change":"2023-01-01T17:39:52.972609+0000","last_active":"2023-01-01T17:39:56.979287+0000","last_peered":"2023-01-01T17:39:56.979287+0000","last_clean":"2023-01-01T17:39:56.979287+0000","last_became_active":"2023-01-01T17:39:52.972412+0000","last_became_peered":"2023-01-01T17:39:52.972412+0000","last_unstale":"2023-01-01T17:39:56.979287+0000","last_undegraded":"2023-01-01T17:39:56.979287+0000","last_fullsized":"2023-01-01T17:39:56.979287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T02:44:28.483809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.393419+0000","last_change":"2023-01-01T17:39:56.982521+0000","last_active":"2023-01-01T17:39:57.393419+0000","last_peered":"2023-01-01T17:39:57.393419+0000","last_clean":"2023-01-01T17:39:57.393419+0000","last_became_active":"2023-01-01T17:39:56.982193+0000","last_became_peered":"2023-01-01T17:39:56.982193+0000","last_unstale":"2023-01-01T17:39:57.393419+0000","last_undegraded":"2023-01-01T17:39:57.393419+0000","last_fullsized":"2023-01-01T17:39:57.393419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:53:49.928875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.970959+0000","last_change":"2023-01-01T17:39:52.551778+0000","last_active":"2023-01-01T17:39:56.970959+0000","last_peered":"2023-01-01T17:39:56.970959+0000","last_clean":"2023-01-01T17:39:56.970959+0000","last_became_active":"2023-01-01T17:39:52.551372+0000","last_became_peered":"2023-01-01T17:39:52.551372+0000","last_unstale":"2023-01-01T17:39:56.970959+0000","last_undegraded":"2023-01-01T17:39:56.970959+0000","last_fullsized":"2023-01-01T17:39:56.970959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:06:58.613789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.968874+0000","last_change":"2023-01-01T17:39:52.958663+0000","last_active":"2023-01-01T17:39:56.968874+0000","last_peered":"2023-01-01T17:39:56.968874+0000","last_clean":"2023-01-01T17:39:56.968874+0000","last_became_active":"2023-01-01T17:39:52.958380+0000","last_became_peered":"2023-01-01T17:39:52.958380+0000","last_unstale":"2023-01-01T17:39:56.968874+0000","last_undegraded":"2023-01-01T17:39:56.968874+0000","last_fullsized":"2023-01-01T17:39:56.968874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:12:40.598666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.393440+0000","last_change":"2023-01-01T17:39:56.984062+0000","last_active":"2023-01-01T17:39:57.393440+0000","last_peered":"2023-01-01T17:39:57.393440+0000","last_clean":"2023-01-01T17:39:57.393440+0000","last_became_active":"2023-01-01T17:39:56.983629+0000","last_became_peered":"2023-01-01T17:39:56.983629+0000","last_unstale":"2023-01-01T17:39:57.393440+0000","last_undegraded":"2023-01-01T17:39:57.393440+0000","last_fullsized":"2023-01-01T17:39:57.393440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:13:20.660670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.974416+0000","last_change":"2023-01-01T17:39:52.543859+0000","last_active":"2023-01-01T17:39:56.974416+0000","last_peered":"2023-01-01T17:39:56.974416+0000","last_clean":"2023-01-01T17:39:56.974416+0000","last_became_active":"2023-01-01T17:39:52.543608+0000","last_became_peered":"2023-01-01T17:39:52.543608+0000","last_unstale":"2023-01-01T17:39:56.974416+0000","last_undegraded":"2023-01-01T17:39:56.974416+0000","last_fullsized":"2023-01-01T17:39:56.974416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:32:00.585258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971221+0000","last_change":"2023-01-01T17:39:52.955020+0000","last_active":"2023-01-01T17:39:56.971221+0000","last_peered":"2023-01-01T17:39:56.971221+0000","last_clean":"2023-01-01T17:39:56.971221+0000","last_became_active":"2023-01-01T17:39:52.954761+0000","last_became_peered":"2023-01-01T17:39:52.954761+0000","last_unstale":"2023-01-01T17:39:56.971221+0000","last_undegraded":"2023-01-01T17:39:56.971221+0000","last_fullsized":"2023-01-01T17:39:56.971221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:38:10.525560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.439777+0000","last_change":"2023-01-01T17:39:56.987402+0000","last_active":"2023-01-01T17:39:57.439777+0000","last_peered":"2023-01-01T17:39:57.439777+0000","last_clean":"2023-01-01T17:39:57.439777+0000","last_became_active":"2023-01-01T17:39:56.986985+0000","last_became_peered":"2023-01-01T17:39:56.986985+0000","last_unstale":"2023-01-01T17:39:57.439777+0000","last_undegraded":"2023-01-01T17:39:57.439777+0000","last_fullsized":"2023-01-01T17:39:57.439777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T02:27:56.672313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.980601+0000","last_change":"2023-01-01T17:39:52.545685+0000","last_active":"2023-01-01T17:39:56.980601+0000","last_peered":"2023-01-01T17:39:56.980601+0000","last_clean":"2023-01-01T17:39:56.980601+0000","last_became_active":"2023-01-01T17:39:52.545424+0000","last_became_peered":"2023-01-01T17:39:52.545424+0000","last_unstale":"2023-01-01T17:39:56.980601+0000","last_undegraded":"2023-01-01T17:39:56.980601+0000","last_fullsized":"2023-01-01T17:39:56.980601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:48:45.787227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.972715+0000","last_change":"2023-01-01T17:39:52.961138+0000","last_active":"2023-01-01T17:39:56.972715+0000","last_peered":"2023-01-01T17:39:56.972715+0000","last_clean":"2023-01-01T17:39:56.972715+0000","last_became_active":"2023-01-01T17:39:52.960867+0000","last_became_peered":"2023-01-01T17:39:52.960867+0000","last_unstale":"2023-01-01T17:39:56.972715+0000","last_undegraded":"2023-01-01T17:39:56.972715+0000","last_fullsized":"2023-01-01T17:39:56.972715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:53:46.493224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.474381+0000","last_change":"2023-01-01T17:39:56.984187+0000","last_active":"2023-01-01T17:39:58.474381+0000","last_peered":"2023-01-01T17:39:58.474381+0000","last_clean":"2023-01-01T17:39:58.474381+0000","last_became_active":"2023-01-01T17:39:56.983771+0000","last_became_peered":"2023-01-01T17:39:56.983771+0000","last_unstale":"2023-01-01T17:39:58.474381+0000","last_undegraded":"2023-01-01T17:39:58.474381+0000","last_fullsized":"2023-01-01T17:39:58.474381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:02:45.626404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.975453+0000","last_change":"2023-01-01T17:39:52.541917+0000","last_active":"2023-01-01T17:39:56.975453+0000","last_peered":"2023-01-01T17:39:56.975453+0000","last_clean":"2023-01-01T17:39:56.975453+0000","last_became_active":"2023-01-01T17:39:52.541656+0000","last_became_peered":"2023-01-01T17:39:52.541656+0000","last_unstale":"2023-01-01T17:39:56.975453+0000","last_undegraded":"2023-01-01T17:39:56.975453+0000","last_fullsized":"2023-01-01T17:39:56.975453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:47:31.929043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.972945+0000","last_change":"2023-01-01T17:39:52.960351+0000","last_active":"2023-01-01T17:39:56.972945+0000","last_peered":"2023-01-01T17:39:56.972945+0000","last_clean":"2023-01-01T17:39:56.972945+0000","last_became_active":"2023-01-01T17:39:52.960106+0000","last_became_peered":"2023-01-01T17:39:52.960106+0000","last_unstale":"2023-01-01T17:39:56.972945+0000","last_undegraded":"2023-01-01T17:39:56.972945+0000","last_fullsized":"2023-01-01T17:39:56.972945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:10:33.122278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.832775+0000","last_change":"2023-01-01T17:39:56.986969+0000","last_active":"2023-01-01T17:39:58.832775+0000","last_peered":"2023-01-01T17:39:58.832775+0000","last_clean":"2023-01-01T17:39:58.832775+0000","last_became_active":"2023-01-01T17:39:56.986612+0000","last_became_peered":"2023-01-01T17:39:56.986612+0000","last_unstale":"2023-01-01T17:39:58.832775+0000","last_undegraded":"2023-01-01T17:39:58.832775+0000","last_fullsized":"2023-01-01T17:39:58.832775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:59:32.743399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971705+0000","last_change":"2023-01-01T17:39:52.544178+0000","last_active":"2023-01-01T17:39:56.971705+0000","last_peered":"2023-01-01T17:39:56.971705+0000","last_clean":"2023-01-01T17:39:56.971705+0000","last_became_active":"2023-01-01T17:39:52.543259+0000","last_became_peered":"2023-01-01T17:39:52.543259+0000","last_unstale":"2023-01-01T17:39:56.971705+0000","last_undegraded":"2023-01-01T17:39:56.971705+0000","last_fullsized":"2023-01-01T17:39:56.971705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:04:09.352850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.981647+0000","last_change":"2023-01-01T17:39:52.966905+0000","last_active":"2023-01-01T17:39:56.981647+0000","last_peered":"2023-01-01T17:39:56.981647+0000","last_clean":"2023-01-01T17:39:56.981647+0000","last_became_active":"2023-01-01T17:39:52.966652+0000","last_became_peered":"2023-01-01T17:39:52.966652+0000","last_unstale":"2023-01-01T17:39:56.981647+0000","last_undegraded":"2023-01-01T17:39:56.981647+0000","last_fullsized":"2023-01-01T17:39:56.981647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:33:57.337802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.832482+0000","last_change":"2023-01-01T17:39:56.992320+0000","last_active":"2023-01-01T17:39:58.832482+0000","last_peered":"2023-01-01T17:39:58.832482+0000","last_clean":"2023-01-01T17:39:58.832482+0000","last_became_active":"2023-01-01T17:39:56.991958+0000","last_became_peered":"2023-01-01T17:39:56.991958+0000","last_unstale":"2023-01-01T17:39:58.832482+0000","last_undegraded":"2023-01-01T17:39:58.832482+0000","last_fullsized":"2023-01-01T17:39:58.832482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:44:25.204625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.974879+0000","last_change":"2023-01-01T17:39:52.542402+0000","last_active":"2023-01-01T17:39:56.974879+0000","last_peered":"2023-01-01T17:39:56.974879+0000","last_clean":"2023-01-01T17:39:56.974879+0000","last_became_active":"2023-01-01T17:39:52.541828+0000","last_became_peered":"2023-01-01T17:39:52.541828+0000","last_unstale":"2023-01-01T17:39:56.974879+0000","last_undegraded":"2023-01-01T17:39:56.974879+0000","last_fullsized":"2023-01-01T17:39:56.974879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:47:31.929043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.972864+0000","last_change":"2023-01-01T17:39:47.373285+0000","last_active":"2023-01-01T17:39:56.972864+0000","last_peered":"2023-01-01T17:39:56.972864+0000","last_clean":"2023-01-01T17:39:56.972864+0000","last_became_active":"2023-01-01T17:39:47.372956+0000","last_became_peered":"2023-01-01T17:39:47.372956+0000","last_unstale":"2023-01-01T17:39:56.972864+0000","last_undegraded":"2023-01-01T17:39:56.972864+0000","last_fullsized":"2023-01-01T17:39:56.972864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_clean_scrub_stamp":"2023-01-01T17:39:46.276990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:49:32.017195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971616+0000","last_change":"2023-01-01T17:39:52.949304+0000","last_active":"2023-01-01T17:39:56.971616+0000","last_peered":"2023-01-01T17:39:56.971616+0000","last_clean":"2023-01-01T17:39:56.971616+0000","last_became_active":"2023-01-01T17:39:52.949049+0000","last_became_peered":"2023-01-01T17:39:52.949049+0000","last_unstale":"2023-01-01T17:39:56.971616+0000","last_undegraded":"2023-01-01T17:39:56.971616+0000","last_fullsized":"2023-01-01T17:39:56.971616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:38:17.390301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.396068+0000","last_change":"2023-01-01T17:39:56.986230+0000","last_active":"2023-01-01T17:39:57.396068+0000","last_peered":"2023-01-01T17:39:57.396068+0000","last_clean":"2023-01-01T17:39:57.396068+0000","last_became_active":"2023-01-01T17:39:56.985563+0000","last_became_peered":"2023-01-01T17:39:56.985563+0000","last_unstale":"2023-01-01T17:39:57.396068+0000","last_undegraded":"2023-01-01T17:39:57.396068+0000","last_fullsized":"2023-01-01T17:39:57.396068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T05:39:37.898528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.975799+0000","last_change":"2023-01-01T17:39:47.302896+0000","last_active":"2023-01-01T17:39:56.975799+0000","last_peered":"2023-01-01T17:39:56.975799+0000","last_clean":"2023-01-01T17:39:56.975799+0000","last_became_active":"2023-01-01T17:39:47.302559+0000","last_became_peered":"2023-01-01T17:39:47.302559+0000","last_unstale":"2023-01-01T17:39:56.975799+0000","last_undegraded":"2023-01-01T17:39:56.975799+0000","last_fullsized":"2023-01-01T17:39:56.975799+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_clean_scrub_stamp":"2023-01-01T17:39:46.276990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:49:32.017195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.437307+0000","last_change":"2023-01-01T17:39:52.546050+0000","last_active":"2023-01-01T17:39:57.437307+0000","last_peered":"2023-01-01T17:39:57.437307+0000","last_clean":"2023-01-01T17:39:57.437307+0000","last_became_active":"2023-01-01T17:39:52.545801+0000","last_became_peered":"2023-01-01T17:39:52.545801+0000","last_unstale":"2023-01-01T17:39:57.437307+0000","last_undegraded":"2023-01-01T17:39:57.437307+0000","last_fullsized":"2023-01-01T17:39:57.437307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:34:48.096366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.975540+0000","last_change":"2023-01-01T17:39:52.963646+0000","last_active":"2023-01-01T17:39:56.975540+0000","last_peered":"2023-01-01T17:39:56.975540+0000","last_clean":"2023-01-01T17:39:56.975540+0000","last_became_active":"2023-01-01T17:39:52.963372+0000","last_became_peered":"2023-01-01T17:39:52.963372+0000","last_unstale":"2023-01-01T17:39:56.975540+0000","last_undegraded":"2023-01-01T17:39:56.975540+0000","last_fullsized":"2023-01-01T17:39:56.975540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:20:51.060158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.474248+0000","last_change":"2023-01-01T17:39:56.985447+0000","last_active":"2023-01-01T17:39:58.474248+0000","last_peered":"2023-01-01T17:39:58.474248+0000","last_clean":"2023-01-01T17:39:58.474248+0000","last_became_active":"2023-01-01T17:39:56.985061+0000","last_became_peered":"2023-01-01T17:39:56.985061+0000","last_unstale":"2023-01-01T17:39:58.474248+0000","last_undegraded":"2023-01-01T17:39:58.474248+0000","last_fullsized":"2023-01-01T17:39:58.474248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:40:46.122449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.981389+0000","last_change":"2023-01-01T17:39:47.304031+0000","last_active":"2023-01-01T17:39:56.981389+0000","last_peered":"2023-01-01T17:39:56.981389+0000","last_clean":"2023-01-01T17:39:56.981389+0000","last_became_active":"2023-01-01T17:39:47.303722+0000","last_became_peered":"2023-01-01T17:39:47.303722+0000","last_unstale":"2023-01-01T17:39:56.981389+0000","last_undegraded":"2023-01-01T17:39:56.981389+0000","last_fullsized":"2023-01-01T17:39:56.981389+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_clean_scrub_stamp":"2023-01-01T17:39:46.276990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:35:16.549190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966543+0000","last_change":"2023-01-01T17:39:47.305762+0000","last_active":"2023-01-01T17:39:56.966543+0000","last_peered":"2023-01-01T17:39:56.966543+0000","last_clean":"2023-01-01T17:39:56.966543+0000","last_became_active":"2023-01-01T17:39:47.304987+0000","last_became_peered":"2023-01-01T17:39:47.304987+0000","last_unstale":"2023-01-01T17:39:56.966543+0000","last_undegraded":"2023-01-01T17:39:56.966543+0000","last_fullsized":"2023-01-01T17:39:56.966543+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_clean_scrub_stamp":"2023-01-01T17:39:46.276990+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:21:04.167413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966426+0000","last_change":"2023-01-01T17:39:52.545184+0000","last_active":"2023-01-01T17:39:56.966426+0000","last_peered":"2023-01-01T17:39:56.966426+0000","last_clean":"2023-01-01T17:39:56.966426+0000","last_became_active":"2023-01-01T17:39:52.544797+0000","last_became_peered":"2023-01-01T17:39:52.544797+0000","last_unstale":"2023-01-01T17:39:56.966426+0000","last_undegraded":"2023-01-01T17:39:56.966426+0000","last_fullsized":"2023-01-01T17:39:56.966426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:32:00.585258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.968517+0000","last_change":"2023-01-01T17:39:52.972606+0000","last_active":"2023-01-01T17:39:56.968517+0000","last_peered":"2023-01-01T17:39:56.968517+0000","last_clean":"2023-01-01T17:39:56.968517+0000","last_became_active":"2023-01-01T17:39:52.972366+0000","last_became_peered":"2023-01-01T17:39:52.972366+0000","last_unstale":"2023-01-01T17:39:56.968517+0000","last_undegraded":"2023-01-01T17:39:56.968517+0000","last_fullsized":"2023-01-01T17:39:56.968517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:20:30.823975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.393598+0000","last_change":"2023-01-01T17:39:56.984925+0000","last_active":"2023-01-01T17:39:57.393598+0000","last_peered":"2023-01-01T17:39:57.393598+0000","last_clean":"2023-01-01T17:39:57.393598+0000","last_became_active":"2023-01-01T17:39:56.984572+0000","last_became_peered":"2023-01-01T17:39:56.984572+0000","last_unstale":"2023-01-01T17:39:57.393598+0000","last_undegraded":"2023-01-01T17:39:57.393598+0000","last_fullsized":"2023-01-01T17:39:57.393598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T05:06:37.735359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966941+0000","last_change":"2023-01-01T17:39:47.365630+0000","last_active":"2023-01-01T17:39:56.966941+0000","last_peered":"2023-01-01T17:39:56.966941+0000","last_clean":"2023-01-01T17:39:56.966941+0000","last_became_active":"2023-01-01T17:39:47.365306+0000","last_became_peered":"2023-01-01T17:39:47.365306+0000","last_unstale":"2023-01-01T17:39:56.966941+0000","last_undegraded":"2023-01-01T17:39:56.966941+0000","last_fullsized":"2023-01-01T17:39:56.966941+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_clean_scrub_stamp":"2023-01-01T17:39:46.276990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T02:18:31.270261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.980681+0000","last_change":"2023-01-01T17:39:52.548241+0000","last_active":"2023-01-01T17:39:56.980681+0000","last_peered":"2023-01-01T17:39:56.980681+0000","last_clean":"2023-01-01T17:39:56.980681+0000","last_became_active":"2023-01-01T17:39:52.547960+0000","last_became_peered":"2023-01-01T17:39:52.547960+0000","last_unstale":"2023-01-01T17:39:56.980681+0000","last_undegraded":"2023-01-01T17:39:56.980681+0000","last_fullsized":"2023-01-01T17:39:56.980681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:21:53.166663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.981566+0000","last_change":"2023-01-01T17:39:52.970894+0000","last_active":"2023-01-01T17:39:56.981566+0000","last_peered":"2023-01-01T17:39:56.981566+0000","last_clean":"2023-01-01T17:39:56.981566+0000","last_became_active":"2023-01-01T17:39:52.970617+0000","last_became_peered":"2023-01-01T17:39:52.970617+0000","last_unstale":"2023-01-01T17:39:56.981566+0000","last_undegraded":"2023-01-01T17:39:56.981566+0000","last_fullsized":"2023-01-01T17:39:56.981566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:29:27.193367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.895750+0000","last_change":"2023-01-01T17:39:56.979186+0000","last_active":"2023-01-01T17:39:58.895750+0000","last_peered":"2023-01-01T17:39:58.895750+0000","last_clean":"2023-01-01T17:39:58.895750+0000","last_became_active":"2023-01-01T17:39:56.978779+0000","last_became_peered":"2023-01-01T17:39:56.978779+0000","last_unstale":"2023-01-01T17:39:58.895750+0000","last_undegraded":"2023-01-01T17:39:58.895750+0000","last_fullsized":"2023-01-01T17:39:58.895750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:28:51.202515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966352+0000","last_change":"2023-01-01T17:39:47.365687+0000","last_active":"2023-01-01T17:39:56.966352+0000","last_peered":"2023-01-01T17:39:56.966352+0000","last_clean":"2023-01-01T17:39:56.966352+0000","last_became_active":"2023-01-01T17:39:47.365433+0000","last_became_peered":"2023-01-01T17:39:47.365433+0000","last_unstale":"2023-01-01T17:39:56.966352+0000","last_undegraded":"2023-01-01T17:39:56.966352+0000","last_fullsized":"2023-01-01T17:39:56.966352+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_clean_scrub_stamp":"2023-01-01T17:39:46.276990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:05:23.068625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971494+0000","last_change":"2023-01-01T17:39:52.542938+0000","last_active":"2023-01-01T17:39:56.971494+0000","last_peered":"2023-01-01T17:39:56.971494+0000","last_clean":"2023-01-01T17:39:56.971494+0000","last_became_active":"2023-01-01T17:39:52.542480+0000","last_became_peered":"2023-01-01T17:39:52.542480+0000","last_unstale":"2023-01-01T17:39:56.971494+0000","last_undegraded":"2023-01-01T17:39:56.971494+0000","last_fullsized":"2023-01-01T17:39:56.971494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:34:48.096366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.980422+0000","last_change":"2023-01-01T17:39:52.957732+0000","last_active":"2023-01-01T17:39:56.980422+0000","last_peered":"2023-01-01T17:39:56.980422+0000","last_clean":"2023-01-01T17:39:56.980422+0000","last_became_active":"2023-01-01T17:39:52.957531+0000","last_became_peered":"2023-01-01T17:39:52.957531+0000","last_unstale":"2023-01-01T17:39:56.980422+0000","last_undegraded":"2023-01-01T17:39:56.980422+0000","last_fullsized":"2023-01-01T17:39:56.980422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T03:53:15.558910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.437415+0000","last_change":"2023-01-01T17:39:56.985580+0000","last_active":"2023-01-01T17:39:57.437415+0000","last_peered":"2023-01-01T17:39:57.437415+0000","last_clean":"2023-01-01T17:39:57.437415+0000","last_became_active":"2023-01-01T17:39:56.985166+0000","last_became_peered":"2023-01-01T17:39:56.985166+0000","last_unstale":"2023-01-01T17:39:57.437415+0000","last_undegraded":"2023-01-01T17:39:57.437415+0000","last_fullsized":"2023-01-01T17:39:57.437415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:27:23.085160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.970225+0000","last_change":"2023-01-01T17:39:47.367908+0000","last_active":"2023-01-01T17:39:56.970225+0000","last_peered":"2023-01-01T17:39:56.970225+0000","last_clean":"2023-01-01T17:39:56.970225+0000","last_became_active":"2023-01-01T17:39:47.367631+0000","last_became_peered":"2023-01-01T17:39:47.367631+0000","last_unstale":"2023-01-01T17:39:56.970225+0000","last_undegraded":"2023-01-01T17:39:56.970225+0000","last_fullsized":"2023-01-01T17:39:56.970225+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_clean_scrub_stamp":"2023-01-01T17:39:46.276990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:35:16.549190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.973094+0000","last_change":"2023-01-01T17:39:52.546724+0000","last_active":"2023-01-01T17:39:56.973094+0000","last_peered":"2023-01-01T17:39:56.973094+0000","last_clean":"2023-01-01T17:39:56.973094+0000","last_became_active":"2023-01-01T17:39:52.546514+0000","last_became_peered":"2023-01-01T17:39:52.546514+0000","last_unstale":"2023-01-01T17:39:56.973094+0000","last_undegraded":"2023-01-01T17:39:56.973094+0000","last_fullsized":"2023-01-01T17:39:56.973094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:05:31.448005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.980812+0000","last_change":"2023-01-01T17:39:52.965004+0000","last_active":"2023-01-01T17:39:56.980812+0000","last_peered":"2023-01-01T17:39:56.980812+0000","last_clean":"2023-01-01T17:39:56.980812+0000","last_became_active":"2023-01-01T17:39:52.964483+0000","last_became_peered":"2023-01-01T17:39:52.964483+0000","last_unstale":"2023-01-01T17:39:56.980812+0000","last_undegraded":"2023-01-01T17:39:56.980812+0000","last_fullsized":"2023-01-01T17:39:56.980812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:26:59.346786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.397683+0000","last_change":"2023-01-01T17:39:56.994936+0000","last_active":"2023-01-01T17:39:57.397683+0000","last_peered":"2023-01-01T17:39:57.397683+0000","last_clean":"2023-01-01T17:39:57.397683+0000","last_became_active":"2023-01-01T17:39:56.994480+0000","last_became_peered":"2023-01-01T17:39:56.994480+0000","last_unstale":"2023-01-01T17:39:57.397683+0000","last_undegraded":"2023-01-01T17:39:57.397683+0000","last_fullsized":"2023-01-01T17:39:57.397683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:37:26.269443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.980561+0000","last_change":"2023-01-01T17:39:47.365528+0000","last_active":"2023-01-01T17:39:56.980561+0000","last_peered":"2023-01-01T17:39:56.980561+0000","last_clean":"2023-01-01T17:39:56.980561+0000","last_became_active":"2023-01-01T17:39:47.365239+0000","last_became_peered":"2023-01-01T17:39:47.365239+0000","last_unstale":"2023-01-01T17:39:56.980561+0000","last_undegraded":"2023-01-01T17:39:56.980561+0000","last_fullsized":"2023-01-01T17:39:56.980561+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_clean_scrub_stamp":"2023-01-01T17:39:46.276990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:21:04.167413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.981073+0000","last_change":"2023-01-01T17:39:52.542456+0000","last_active":"2023-01-01T17:39:56.981073+0000","last_peered":"2023-01-01T17:39:56.981073+0000","last_clean":"2023-01-01T17:39:56.981073+0000","last_became_active":"2023-01-01T17:39:52.542154+0000","last_became_peered":"2023-01-01T17:39:52.542154+0000","last_unstale":"2023-01-01T17:39:56.981073+0000","last_undegraded":"2023-01-01T17:39:56.981073+0000","last_fullsized":"2023-01-01T17:39:56.981073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:06:58.613789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.969042+0000","last_change":"2023-01-01T17:39:52.968138+0000","last_active":"2023-01-01T17:39:56.969042+0000","last_peered":"2023-01-01T17:39:56.969042+0000","last_clean":"2023-01-01T17:39:56.969042+0000","last_became_active":"2023-01-01T17:39:52.967887+0000","last_became_peered":"2023-01-01T17:39:52.967887+0000","last_unstale":"2023-01-01T17:39:56.969042+0000","last_undegraded":"2023-01-01T17:39:56.969042+0000","last_fullsized":"2023-01-01T17:39:56.969042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:38:17.390301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.436948+0000","last_change":"2023-01-01T17:39:56.992991+0000","last_active":"2023-01-01T17:39:57.436948+0000","last_peered":"2023-01-01T17:39:57.436948+0000","last_clean":"2023-01-01T17:39:57.436948+0000","last_became_active":"2023-01-01T17:39:56.986739+0000","last_became_peered":"2023-01-01T17:39:56.986739+0000","last_unstale":"2023-01-01T17:39:57.436948+0000","last_undegraded":"2023-01-01T17:39:57.436948+0000","last_fullsized":"2023-01-01T17:39:57.436948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:45:28.399373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.981191+0000","last_change":"2023-01-01T17:39:47.305897+0000","last_active":"2023-01-01T17:39:56.981191+0000","last_peered":"2023-01-01T17:39:56.981191+0000","last_clean":"2023-01-01T17:39:56.981191+0000","last_became_active":"2023-01-01T17:39:47.305590+0000","last_became_peered":"2023-01-01T17:39:47.305590+0000","last_unstale":"2023-01-01T17:39:56.981191+0000","last_undegraded":"2023-01-01T17:39:56.981191+0000","last_fullsized":"2023-01-01T17:39:56.981191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_clean_scrub_stamp":"2023-01-01T17:39:46.276990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:35:16.549190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.970834+0000","last_change":"2023-01-01T17:39:52.551958+0000","last_active":"2023-01-01T17:39:56.970834+0000","last_peered":"2023-01-01T17:39:56.970834+0000","last_clean":"2023-01-01T17:39:56.970834+0000","last_became_active":"2023-01-01T17:39:52.551432+0000","last_became_peered":"2023-01-01T17:39:52.551432+0000","last_unstale":"2023-01-01T17:39:56.970834+0000","last_undegraded":"2023-01-01T17:39:56.970834+0000","last_fullsized":"2023-01-01T17:39:56.970834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:34:48.096366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.980860+0000","last_change":"2023-01-01T17:39:52.970343+0000","last_active":"2023-01-01T17:39:56.980860+0000","last_peered":"2023-01-01T17:39:56.980860+0000","last_clean":"2023-01-01T17:39:56.980860+0000","last_became_active":"2023-01-01T17:39:52.970055+0000","last_became_peered":"2023-01-01T17:39:52.970055+0000","last_unstale":"2023-01-01T17:39:56.980860+0000","last_undegraded":"2023-01-01T17:39:56.980860+0000","last_fullsized":"2023-01-01T17:39:56.980860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:17:10.326486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.439827+0000","last_change":"2023-01-01T17:39:56.994930+0000","last_active":"2023-01-01T17:39:57.439827+0000","last_peered":"2023-01-01T17:39:57.439827+0000","last_clean":"2023-01-01T17:39:57.439827+0000","last_became_active":"2023-01-01T17:39:56.994469+0000","last_became_peered":"2023-01-01T17:39:56.994469+0000","last_unstale":"2023-01-01T17:39:57.439827+0000","last_undegraded":"2023-01-01T17:39:57.439827+0000","last_fullsized":"2023-01-01T17:39:57.439827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:27:23.085160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.969397+0000","last_change":"2023-01-01T17:39:52.553058+0000","last_active":"2023-01-01T17:39:56.969397+0000","last_peered":"2023-01-01T17:39:56.969397+0000","last_clean":"2023-01-01T17:39:56.969397+0000","last_became_active":"2023-01-01T17:39:52.552766+0000","last_became_peered":"2023-01-01T17:39:52.552766+0000","last_unstale":"2023-01-01T17:39:56.969397+0000","last_undegraded":"2023-01-01T17:39:56.969397+0000","last_fullsized":"2023-01-01T17:39:56.969397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:47:31.929043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.967297+0000","last_change":"2023-01-01T17:39:52.961138+0000","last_active":"2023-01-01T17:39:56.967297+0000","last_peered":"2023-01-01T17:39:56.967297+0000","last_clean":"2023-01-01T17:39:56.967297+0000","last_became_active":"2023-01-01T17:39:52.960885+0000","last_became_peered":"2023-01-01T17:39:52.960885+0000","last_unstale":"2023-01-01T17:39:56.967297+0000","last_undegraded":"2023-01-01T17:39:56.967297+0000","last_fullsized":"2023-01-01T17:39:56.967297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:34:49.101183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.895602+0000","last_change":"2023-01-01T17:39:56.985985+0000","last_active":"2023-01-01T17:39:58.895602+0000","last_peered":"2023-01-01T17:39:58.895602+0000","last_clean":"2023-01-01T17:39:58.895602+0000","last_became_active":"2023-01-01T17:39:56.985568+0000","last_became_peered":"2023-01-01T17:39:56.985568+0000","last_unstale":"2023-01-01T17:39:58.895602+0000","last_undegraded":"2023-01-01T17:39:58.895602+0000","last_fullsized":"2023-01-01T17:39:58.895602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:02:45.626404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.970839+0000","last_change":"2023-01-01T17:39:52.543976+0000","last_active":"2023-01-01T17:39:56.970839+0000","last_peered":"2023-01-01T17:39:56.970839+0000","last_clean":"2023-01-01T17:39:56.970839+0000","last_became_active":"2023-01-01T17:39:52.543744+0000","last_became_peered":"2023-01-01T17:39:52.543744+0000","last_unstale":"2023-01-01T17:39:56.970839+0000","last_undegraded":"2023-01-01T17:39:56.970839+0000","last_fullsized":"2023-01-01T17:39:56.970839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:32:00.585258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.972793+0000","last_change":"2023-01-01T17:39:52.957073+0000","last_active":"2023-01-01T17:39:56.972793+0000","last_peered":"2023-01-01T17:39:56.972793+0000","last_clean":"2023-01-01T17:39:56.972793+0000","last_became_active":"2023-01-01T17:39:52.956802+0000","last_became_peered":"2023-01-01T17:39:52.956802+0000","last_unstale":"2023-01-01T17:39:56.972793+0000","last_undegraded":"2023-01-01T17:39:56.972793+0000","last_fullsized":"2023-01-01T17:39:56.972793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:38:17.390301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.474123+0000","last_change":"2023-01-01T17:39:56.985478+0000","last_active":"2023-01-01T17:39:58.474123+0000","last_peered":"2023-01-01T17:39:58.474123+0000","last_clean":"2023-01-01T17:39:58.474123+0000","last_became_active":"2023-01-01T17:39:56.985070+0000","last_became_peered":"2023-01-01T17:39:56.985070+0000","last_unstale":"2023-01-01T17:39:58.474123+0000","last_undegraded":"2023-01-01T17:39:58.474123+0000","last_fullsized":"2023-01-01T17:39:58.474123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:50:42.814791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.970934+0000","last_change":"2023-01-01T17:39:52.546754+0000","last_active":"2023-01-01T17:39:56.970934+0000","last_peered":"2023-01-01T17:39:56.970934+0000","last_clean":"2023-01-01T17:39:56.970934+0000","last_became_active":"2023-01-01T17:39:52.546448+0000","last_became_peered":"2023-01-01T17:39:52.546448+0000","last_unstale":"2023-01-01T17:39:56.970934+0000","last_undegraded":"2023-01-01T17:39:56.970934+0000","last_fullsized":"2023-01-01T17:39:56.970934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:05:31.448005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.973286+0000","last_change":"2023-01-01T17:39:52.961694+0000","last_active":"2023-01-01T17:39:56.973286+0000","last_peered":"2023-01-01T17:39:56.973286+0000","last_clean":"2023-01-01T17:39:56.973286+0000","last_became_active":"2023-01-01T17:39:52.961316+0000","last_became_peered":"2023-01-01T17:39:52.961316+0000","last_unstale":"2023-01-01T17:39:56.973286+0000","last_undegraded":"2023-01-01T17:39:56.973286+0000","last_fullsized":"2023-01-01T17:39:56.973286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T05:06:34.299709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.832171+0000","last_change":"2023-01-01T17:39:56.998170+0000","last_active":"2023-01-01T17:39:58.832171+0000","last_peered":"2023-01-01T17:39:58.832171+0000","last_clean":"2023-01-01T17:39:58.832171+0000","last_became_active":"2023-01-01T17:39:56.997838+0000","last_became_peered":"2023-01-01T17:39:56.997838+0000","last_unstale":"2023-01-01T17:39:58.832171+0000","last_undegraded":"2023-01-01T17:39:58.832171+0000","last_fullsized":"2023-01-01T17:39:58.832171+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:19:24.610726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.975082+0000","last_change":"2023-01-01T17:39:52.545957+0000","last_active":"2023-01-01T17:39:56.975082+0000","last_peered":"2023-01-01T17:39:56.975082+0000","last_clean":"2023-01-01T17:39:56.975082+0000","last_became_active":"2023-01-01T17:39:52.545673+0000","last_became_peered":"2023-01-01T17:39:52.545673+0000","last_unstale":"2023-01-01T17:39:56.975082+0000","last_undegraded":"2023-01-01T17:39:56.975082+0000","last_fullsized":"2023-01-01T17:39:56.975082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:56:28.713641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971764+0000","last_change":"2023-01-01T17:39:52.959871+0000","last_active":"2023-01-01T17:39:56.971764+0000","last_peered":"2023-01-01T17:39:56.971764+0000","last_clean":"2023-01-01T17:39:56.971764+0000","last_became_active":"2023-01-01T17:39:52.959385+0000","last_became_peered":"2023-01-01T17:39:52.959385+0000","last_unstale":"2023-01-01T17:39:56.971764+0000","last_undegraded":"2023-01-01T17:39:56.971764+0000","last_fullsized":"2023-01-01T17:39:56.971764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:13:17.225019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.439450+0000","last_change":"2023-01-01T17:39:56.986617+0000","last_active":"2023-01-01T17:39:57.439450+0000","last_peered":"2023-01-01T17:39:57.439450+0000","last_clean":"2023-01-01T17:39:57.439450+0000","last_became_active":"2023-01-01T17:39:56.986236+0000","last_became_peered":"2023-01-01T17:39:56.986236+0000","last_unstale":"2023-01-01T17:39:57.439450+0000","last_undegraded":"2023-01-01T17:39:57.439450+0000","last_fullsized":"2023-01-01T17:39:57.439450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:45:28.399373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966603+0000","last_change":"2023-01-01T17:39:52.552957+0000","last_active":"2023-01-01T17:39:56.966603+0000","last_peered":"2023-01-01T17:39:56.966603+0000","last_clean":"2023-01-01T17:39:56.966603+0000","last_became_active":"2023-01-01T17:39:52.552694+0000","last_became_peered":"2023-01-01T17:39:52.552694+0000","last_unstale":"2023-01-01T17:39:56.966603+0000","last_undegraded":"2023-01-01T17:39:56.966603+0000","last_fullsized":"2023-01-01T17:39:56.966603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:05:31.448005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.978572+0000","last_change":"2023-01-01T17:39:52.959416+0000","last_active":"2023-01-01T17:39:56.978572+0000","last_peered":"2023-01-01T17:39:56.978572+0000","last_clean":"2023-01-01T17:39:56.978572+0000","last_became_active":"2023-01-01T17:39:52.959092+0000","last_became_peered":"2023-01-01T17:39:52.959092+0000","last_unstale":"2023-01-01T17:39:56.978572+0000","last_undegraded":"2023-01-01T17:39:56.978572+0000","last_fullsized":"2023-01-01T17:39:56.978572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T05:23:17.274474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.979030+0000","last_change":"2023-01-01T17:39:52.960401+0000","last_active":"2023-01-01T17:39:56.979030+0000","last_peered":"2023-01-01T17:39:56.979030+0000","last_clean":"2023-01-01T17:39:56.979030+0000","last_became_active":"2023-01-01T17:39:52.960104+0000","last_became_peered":"2023-01-01T17:39:52.960104+0000","last_unstale":"2023-01-01T17:39:56.979030+0000","last_undegraded":"2023-01-01T17:39:56.979030+0000","last_fullsized":"2023-01-01T17:39:56.979030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T22:26:50.173884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971956+0000","last_change":"2023-01-01T17:39:52.961844+0000","last_active":"2023-01-01T17:39:56.971956+0000","last_peered":"2023-01-01T17:39:56.971956+0000","last_clean":"2023-01-01T17:39:56.971956+0000","last_became_active":"2023-01-01T17:39:52.961588+0000","last_became_peered":"2023-01-01T17:39:52.961588+0000","last_unstale":"2023-01-01T17:39:56.971956+0000","last_undegraded":"2023-01-01T17:39:56.971956+0000","last_fullsized":"2023-01-01T17:39:56.971956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:38:10.525560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.974677+0000","last_change":"2023-01-01T17:39:52.965441+0000","last_active":"2023-01-01T17:39:56.974677+0000","last_peered":"2023-01-01T17:39:56.974677+0000","last_clean":"2023-01-01T17:39:56.974677+0000","last_became_active":"2023-01-01T17:39:52.965156+0000","last_became_peered":"2023-01-01T17:39:52.965156+0000","last_unstale":"2023-01-01T17:39:56.974677+0000","last_undegraded":"2023-01-01T17:39:56.974677+0000","last_fullsized":"2023-01-01T17:39:56.974677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:57:37.343251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.974315+0000","last_change":"2023-01-01T17:39:52.949007+0000","last_active":"2023-01-01T17:39:56.974315+0000","last_peered":"2023-01-01T17:39:56.974315+0000","last_clean":"2023-01-01T17:39:56.974315+0000","last_became_active":"2023-01-01T17:39:52.948731+0000","last_became_peered":"2023-01-01T17:39:52.948731+0000","last_unstale":"2023-01-01T17:39:56.974315+0000","last_undegraded":"2023-01-01T17:39:56.974315+0000","last_fullsized":"2023-01-01T17:39:56.974315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:20:30.823975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.980912+0000","last_change":"2023-01-01T17:39:52.966309+0000","last_active":"2023-01-01T17:39:56.980912+0000","last_peered":"2023-01-01T17:39:56.980912+0000","last_clean":"2023-01-01T17:39:56.980912+0000","last_became_active":"2023-01-01T17:39:52.966028+0000","last_became_peered":"2023-01-01T17:39:52.966028+0000","last_unstale":"2023-01-01T17:39:56.980912+0000","last_undegraded":"2023-01-01T17:39:56.980912+0000","last_fullsized":"2023-01-01T17:39:56.980912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:04:29.980357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4499,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64598,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9052,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362788,"statfs":{"total":96636764160,"available":96627494912,"internally_reserved":0,"allocated":348160,"data_stored":699011,"data_compressed":32299,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8384,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363456,"statfs":{"total":96636764160,"available":96628178944,"internally_reserved":0,"allocated":253952,"data_stored":104726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8960,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362880,"statfs":{"total":96636764160,"available":96627589120,"internally_reserved":0,"allocated":319488,"data_stored":695094,"data_compressed":32299,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.246}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8452,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363388,"statfs":{"total":96636764160,"available":96628109312,"internally_reserved":0,"allocated":258048,"data_stored":105308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8384,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363456,"statfs":{"total":96636764160,"available":96628178944,"internally_reserved":0,"allocated":253952,"data_stored":104726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8452,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363388,"statfs":{"total":96636764160,"available":96628109312,"internally_reserved":0,"allocated":258048,"data_stored":104816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8532,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363308,"statfs":{"total":96636764160,"available":96628027392,"internally_reserved":0,"allocated":274432,"data_stored":108483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8456,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363384,"statfs":{"total":96636764160,"available":96628105216,"internally_reserved":0,"allocated":262144,"data_stored":105378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32299,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32299,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-01T17:40:11.040 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-01-01T17:40:11.040 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-01-01T17:40:11.040 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-01-01T17:40:11.040 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-01-01T17:40:11.041 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-01-01T17:40:11.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.195+0000 7f1a1d543700 1 Processor -- start 2023-01-01T17:40:11.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.195+0000 7f1a1d543700 1 -- start start 2023-01-01T17:40:11.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.196+0000 7f1a1d543700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1a180c1ad0 0x7f1a18152de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:11.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.196+0000 7f1a1d543700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a18157030 0x7f1a18153320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:11.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.196+0000 7f1a1d543700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a1806dc10 con 0x7f1a1806a640 2023-01-01T17:40:11.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.196+0000 7f1a1d543700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a18071770 con 0x7f1a180c1ad0 2023-01-01T17:40:11.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.196+0000 7f1a1d543700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a18156ba0 con 0x7f1a18157030 2023-01-01T17:40:11.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.196+0000 7f1a167fc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1a180c1ad0 0x7f1a18152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:11.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.196+0000 7f1a167fc700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1a180c1ad0 0x7f1a18152de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46502/0 (socket says 172.21.15.61:46502) 2023-01-01T17:40:11.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.196+0000 7f1a167fc700 1 -- 172.21.15.61:0/1134683127 learned_addr learned my addr 172.21.15.61:0/1134683127 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:11.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.196+0000 7f1a177fe700 1 --2- 172.21.15.61:0/1134683127 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a18157030 0x7f1a18153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:11.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.197+0000 7f1a167fc700 1 -- 172.21.15.61:0/1134683127 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a18157030 msgr2=0x7f1a18153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:11.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.197+0000 7f1a167fc700 1 --2- 172.21.15.61:0/1134683127 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a18157030 0x7f1a18153320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:11.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.197+0000 7f1a167fc700 1 -- 172.21.15.61:0/1134683127 >> v1:172.21.15.149:6789/0 conn(0x7f1a1806a640 legacy=0x7f1a1814ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:11.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.197+0000 7f1a167fc700 1 -- 172.21.15.61:0/1134683127 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a1806f7a0 con 0x7f1a180c1ad0 2023-01-01T17:40:11.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.197+0000 7f1a167fc700 1 --2- 172.21.15.61:0/1134683127 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1a180c1ad0 0x7f1a18152de0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1a080098f0 tx=0x7f1a08009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f27bab376060af68 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:11.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.197+0000 7f1a15ffb700 1 -- 172.21.15.61:0/1134683127 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0800b8a0 con 0x7f1a180c1ad0 2023-01-01T17:40:11.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.197+0000 7f1a15ffb700 1 -- 172.21.15.61:0/1134683127 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0800ba00 con 0x7f1a180c1ad0 2023-01-01T17:40:11.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.197+0000 7f1a15ffb700 1 -- 172.21.15.61:0/1134683127 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0800bd90 con 0x7f1a180c1ad0 2023-01-01T17:40:11.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.197+0000 7f1a1d543700 1 -- 172.21.15.61:0/1134683127 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1a180c1ad0 msgr2=0x7f1a18152de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:11.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.197+0000 7f1a1d543700 1 --2- 172.21.15.61:0/1134683127 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1a180c1ad0 0x7f1a18152de0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1a080098f0 tx=0x7f1a08009c00 comp rx=0 tx=0).stop 2023-01-01T17:40:11.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.197+0000 7f1a1d543700 1 -- 172.21.15.61:0/1134683127 shutdown_connections 2023-01-01T17:40:11.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.198+0000 7f1a1d543700 1 --2- 172.21.15.61:0/1134683127 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a18157030 0x7f1a18153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:11.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.198+0000 7f1a1d543700 1 --2- 172.21.15.61:0/1134683127 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1a180c1ad0 0x7f1a18152de0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:11.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.198+0000 7f1a1d543700 1 -- 172.21.15.61:0/1134683127 >> 172.21.15.61:0/1134683127 conn(0x7f1a180c1f30 msgr2=0x7f1a180c2330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:11.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.198+0000 7f1a1d543700 1 -- 172.21.15.61:0/1134683127 shutdown_connections 2023-01-01T17:40:11.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.198+0000 7f1a1d543700 1 -- 172.21.15.61:0/1134683127 wait complete. 2023-01-01T17:40:11.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.199+0000 7f1a1d543700 1 Processor -- start 2023-01-01T17:40:11.204 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.199+0000 7f1a1d543700 1 -- start start 2023-01-01T17:40:11.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.199+0000 7f1a1d543700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a1806a640 0x7f1a181ebbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:11.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.199+0000 7f1a1d543700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a180c1ad0 0x7f1a180bd550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:11.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.199+0000 7f1a1d543700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1a18157030 0x7f1a180bda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:11.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.199+0000 7f1a1d543700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a181ec6f0 con 0x7f1a18157030 2023-01-01T17:40:11.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.199+0000 7f1a1d543700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a180bd0c0 con 0x7f1a1806a640 2023-01-01T17:40:11.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.200+0000 7f1a1d543700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a180bdfd0 con 0x7f1a180c1ad0 2023-01-01T17:40:11.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.200+0000 7f1a177fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1a18157030 0x7f1a180bda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:11.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.200+0000 7f1a177fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1a18157030 0x7f1a180bda90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46510/0 (socket says 172.21.15.61:46510) 2023-01-01T17:40:11.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.200+0000 7f1a177fe700 1 -- 172.21.15.61:0/2025578779 learned_addr learned my addr 172.21.15.61:0/2025578779 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:11.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.200+0000 7f1a16ffd700 1 --2- 172.21.15.61:0/2025578779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a1806a640 0x7f1a181ebbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:11.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.200+0000 7f1a167fc700 1 --2- 172.21.15.61:0/2025578779 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a180c1ad0 0x7f1a180bd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:11.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.200+0000 7f1a177fe700 1 -- 172.21.15.61:0/2025578779 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a180c1ad0 msgr2=0x7f1a180bd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:11.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.200+0000 7f1a177fe700 1 --2- 172.21.15.61:0/2025578779 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a180c1ad0 0x7f1a180bd550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:11.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.200+0000 7f1a177fe700 1 -- 172.21.15.61:0/2025578779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a1806a640 msgr2=0x7f1a181ebbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:11.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.200+0000 7f1a177fe700 1 --2- 172.21.15.61:0/2025578779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a1806a640 0x7f1a181ebbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:11.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.200+0000 7f1a177fe700 1 -- 172.21.15.61:0/2025578779 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a08009550 con 0x7f1a18157030 2023-01-01T17:40:11.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.200+0000 7f1a177fe700 1 --2- 172.21.15.61:0/2025578779 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1a18157030 0x7f1a180bda90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1a10007e90 tx=0x7f1a1000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:11.207 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.200+0000 7f19ff7fe700 1 -- 172.21.15.61:0/2025578779 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1000ed30 con 0x7f1a18157030 2023-01-01T17:40:11.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.200+0000 7f19ff7fe700 1 -- 172.21.15.61:0/2025578779 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1000ee90 con 0x7f1a18157030 2023-01-01T17:40:11.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.200+0000 7f1a1d543700 1 -- 172.21.15.61:0/2025578779 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a1806f4c0 con 0x7f1a18157030 2023-01-01T17:40:11.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.200+0000 7f19ff7fe700 1 -- 172.21.15.61:0/2025578779 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a10014660 con 0x7f1a18157030 2023-01-01T17:40:11.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.200+0000 7f1a1d543700 1 -- 172.21.15.61:0/2025578779 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a1806f1e0 con 0x7f1a18157030 2023-01-01T17:40:11.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.201+0000 7f1a1d543700 1 -- 172.21.15.61:0/2025578779 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a18156550 con 0x7f1a18157030 2023-01-01T17:40:11.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.202+0000 7f19ff7fe700 1 -- 172.21.15.61:0/2025578779 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f1a10012050 con 0x7f1a18157030 2023-01-01T17:40:11.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.202+0000 7f19ff7fe700 1 --2- 172.21.15.61:0/2025578779 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f1a04063290 0x7f1a04065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:11.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.202+0000 7f19ff7fe700 1 -- 172.21.15.61:0/2025578779 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1a10080350 con 0x7f1a18157030 2023-01-01T17:40:11.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.202+0000 7f1a16ffd700 1 --2- 172.21.15.61:0/2025578779 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f1a04063290 0x7f1a04065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:11.208 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.203+0000 7f1a16ffd700 1 --2- 172.21.15.61:0/2025578779 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f1a04063290 0x7f1a04065740 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c007fd0 tx=0x7f1a0c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:11.209 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.207+0000 7f19ff7fe700 1 -- 172.21.15.61:0/2025578779 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f1a1004efc0 con 0x7f1a18157030 2023-01-01T17:40:11.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.452+0000 7f1a1d543700 1 -- 172.21.15.61:0/2025578779 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f1a180668a0 con 0x7f1a18157030 2023-01-01T17:40:11.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.455+0000 7f19ff7fe700 1 -- 172.21.15.61:0/2025578779 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+157790 (secure 0 0 0) 0x7f1a100525e0 con 0x7f1a18157030 2023-01-01T17:40:11.459 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:40:11.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.458+0000 7f1a1d543700 1 -- 172.21.15.61:0/2025578779 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f1a04063290 msgr2=0x7f1a04065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:11.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.458+0000 7f1a1d543700 1 --2- 172.21.15.61:0/2025578779 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f1a04063290 0x7f1a04065740 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c007fd0 tx=0x7f1a0c009040 comp rx=0 tx=0).stop 2023-01-01T17:40:11.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.458+0000 7f1a1d543700 1 -- 172.21.15.61:0/2025578779 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1a18157030 msgr2=0x7f1a180bda90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:11.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.458+0000 7f1a1d543700 1 --2- 172.21.15.61:0/2025578779 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1a18157030 0x7f1a180bda90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1a10007e90 tx=0x7f1a1000e3c0 comp rx=0 tx=0).stop 2023-01-01T17:40:11.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.458+0000 7f1a1d543700 1 -- 172.21.15.61:0/2025578779 shutdown_connections 2023-01-01T17:40:11.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.458+0000 7f1a1d543700 1 --2- 172.21.15.61:0/2025578779 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f1a04063290 0x7f1a04065740 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:11.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.458+0000 7f1a1d543700 1 --2- 172.21.15.61:0/2025578779 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1a18157030 0x7f1a180bda90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:11.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.458+0000 7f1a1d543700 1 --2- 172.21.15.61:0/2025578779 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a1806a640 0x7f1a181ebbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:11.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.458+0000 7f1a1d543700 1 --2- 172.21.15.61:0/2025578779 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1a180c1ad0 0x7f1a180bd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:11.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.458+0000 7f1a1d543700 1 -- 172.21.15.61:0/2025578779 >> 172.21.15.61:0/2025578779 conn(0x7f1a180c1f30 msgr2=0x7f1a18150010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:11.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.458+0000 7f1a1d543700 1 -- 172.21.15.61:0/2025578779 shutdown_connections 2023-01-01T17:40:11.463 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.458+0000 7f1a1d543700 1 -- 172.21.15.61:0/2025578779 wait complete. 2023-01-01T17:40:11.471 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":5,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":94075},{"type":"v1","addr":"172.21.15.61:6833","nonce":94075}]},"active_addr":"172.21.15.61:6833/94075","active_change":"2023-01-01T17:39:40.216139+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4111,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":false,"error_string":"No module named 'packaging'","module_options":{}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":false,"error_string":"No module named 'packaging'","module_options":{}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.61:0","nonce":4013382616}]},{"addrvec":[{"type":"v2","addr":"172.21.15.61:0","nonce":1290757079}]},{"addrvec":[{"type":"v2","addr":"172.21.15.61:0","nonce":1024365508}]},{"addrvec":[{"type":"v2","addr":"172.21.15.61:0","nonce":4113036228}]}]}} 2023-01-01T17:40:11.478 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-01-01T17:40:11.479 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-01-01T17:40:11.479 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-01T17:40:11.604 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.604+0000 7ff1ae224700 1 Processor -- start 2023-01-01T17:40:11.605 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.604+0000 7ff1ae224700 1 -- start start 2023-01-01T17:40:11.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.605+0000 7ff1ae224700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff1a80c58c0 0x7ff1a814e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:11.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.605+0000 7ff1ae224700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff1a80c5c90 0x7ff1a814e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:11.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.605+0000 7ff1ae224700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1a80c7430 con 0x7ff1a80a6060 2023-01-01T17:40:11.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.605+0000 7ff1ae224700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1a80c6310 con 0x7ff1a80c5c90 2023-01-01T17:40:11.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.605+0000 7ff1ae224700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1a80c7c40 con 0x7ff1a80c58c0 2023-01-01T17:40:11.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.605+0000 7ff1a6ffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff1a80c5c90 0x7ff1a814e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:11.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.605+0000 7ff1a6ffd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff1a80c5c90 0x7ff1a814e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46516/0 (socket says 172.21.15.61:46516) 2023-01-01T17:40:11.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.605+0000 7ff1a6ffd700 1 -- 172.21.15.61:0/4276335312 learned_addr learned my addr 172.21.15.61:0/4276335312 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:11.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.605+0000 7ff1a77fe700 1 --2- 172.21.15.61:0/4276335312 >> v2:172.21.15.149:3300/0 conn(0x7ff1a80c58c0 0x7ff1a814e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:11.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.605+0000 7ff1a6ffd700 1 -- 172.21.15.61:0/4276335312 >> v2:172.21.15.149:3300/0 conn(0x7ff1a80c58c0 msgr2=0x7ff1a814e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:11.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.605+0000 7ff1a6ffd700 1 --2- 172.21.15.61:0/4276335312 >> v2:172.21.15.149:3300/0 conn(0x7ff1a80c58c0 0x7ff1a814e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:11.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.605+0000 7ff1a6ffd700 1 -- 172.21.15.61:0/4276335312 >> v1:172.21.15.149:6789/0 conn(0x7ff1a80a6060 legacy=0x7ff1a8150cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:11.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.605+0000 7ff1a6ffd700 1 -- 172.21.15.61:0/4276335312 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a80a8dd0 con 0x7ff1a80c5c90 2023-01-01T17:40:11.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.606+0000 7ff1a6ffd700 1 --2- 172.21.15.61:0/4276335312 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff1a80c5c90 0x7ff1a814e5e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8066070 tx=0x7ff190009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890291ebeb6c4a4d server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:11.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.606+0000 7ff1a67fc700 1 -- 172.21.15.61:0/4276335312 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19000b860 con 0x7ff1a80c5c90 2023-01-01T17:40:11.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.606+0000 7ff1a67fc700 1 -- 172.21.15.61:0/4276335312 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff19000b9c0 con 0x7ff1a80c5c90 2023-01-01T17:40:11.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.606+0000 7ff1a67fc700 1 -- 172.21.15.61:0/4276335312 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19000bd50 con 0x7ff1a80c5c90 2023-01-01T17:40:11.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.606+0000 7ff1ae224700 1 -- 172.21.15.61:0/4276335312 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff1a80c5c90 msgr2=0x7ff1a814e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:11.610 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.606+0000 7ff1ae224700 1 --2- 172.21.15.61:0/4276335312 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff1a80c5c90 0x7ff1a814e5e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8066070 tx=0x7ff190009c00 comp rx=0 tx=0).stop 2023-01-01T17:40:11.610 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.606+0000 7ff1ae224700 1 -- 172.21.15.61:0/4276335312 shutdown_connections 2023-01-01T17:40:11.610 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.606+0000 7ff1ae224700 1 --2- 172.21.15.61:0/4276335312 >> v2:172.21.15.149:3300/0 conn(0x7ff1a80c58c0 0x7ff1a814e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:11.610 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.606+0000 7ff1ae224700 1 --2- 172.21.15.61:0/4276335312 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff1a80c5c90 0x7ff1a814e5e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:11.610 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.606+0000 7ff1ae224700 1 -- 172.21.15.61:0/4276335312 >> 172.21.15.61:0/4276335312 conn(0x7ff1a8069fa0 msgr2=0x7ff1a80c6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:11.610 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.606+0000 7ff1ae224700 1 -- 172.21.15.61:0/4276335312 shutdown_connections 2023-01-01T17:40:11.610 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.606+0000 7ff1ae224700 1 -- 172.21.15.61:0/4276335312 wait complete. 2023-01-01T17:40:11.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.607+0000 7ff1ae224700 1 Processor -- start 2023-01-01T17:40:11.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.608+0000 7ff1ae224700 1 -- start start 2023-01-01T17:40:11.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.608+0000 7ff1ae224700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff1a80a6060 0x7ff1a8147990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:11.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.608+0000 7ff1ae224700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1a80c58c0 0x7ff1a8149350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:11.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.608+0000 7ff1ae224700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1a80c5c90 0x7ff1a81e9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:11.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.608+0000 7ff1ae224700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a81521a0 con 0x7ff1a80a6060 2023-01-01T17:40:11.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.608+0000 7ff1ae224700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a8154d80 con 0x7ff1a80c5c90 2023-01-01T17:40:11.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.608+0000 7ff1ae224700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a8152400 con 0x7ff1a80c58c0 2023-01-01T17:40:11.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.608+0000 7ff1a77fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff1a80a6060 0x7ff1a8147990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:11.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.608+0000 7ff1a77fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff1a80a6060 0x7ff1a8147990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46522/0 (socket says 172.21.15.61:46522) 2023-01-01T17:40:11.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.608+0000 7ff1a77fe700 1 -- 172.21.15.61:0/1769623224 learned_addr learned my addr 172.21.15.61:0/1769623224 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:11.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.608+0000 7ff1a6ffd700 1 --2- 172.21.15.61:0/1769623224 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1a80c58c0 0x7ff1a8149350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:11.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.608+0000 7ff1a7fff700 1 --2- 172.21.15.61:0/1769623224 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1a80c5c90 0x7ff1a81e9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:11.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.609+0000 7ff1a77fe700 1 -- 172.21.15.61:0/1769623224 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1a80c58c0 msgr2=0x7ff1a8149350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:11.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.609+0000 7ff1a77fe700 1 --2- 172.21.15.61:0/1769623224 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1a80c58c0 0x7ff1a8149350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:11.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.609+0000 7ff1a77fe700 1 -- 172.21.15.61:0/1769623224 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1a80c5c90 msgr2=0x7ff1a81e9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:11.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.609+0000 7ff1a77fe700 1 --2- 172.21.15.61:0/1769623224 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1a80c5c90 0x7ff1a81e9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:11.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.609+0000 7ff1a77fe700 1 -- 172.21.15.61:0/1769623224 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff190009550 con 0x7ff1a80a6060 2023-01-01T17:40:11.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.609+0000 7ff1a77fe700 1 --2- 172.21.15.61:0/1769623224 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff1a80a6060 0x7ff1a8147990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff19800e810 tx=0x7ff19800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:11.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.609+0000 7ff19ffff700 1 -- 172.21.15.61:0/1769623224 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19800c070 con 0x7ff1a80a6060 2023-01-01T17:40:11.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.609+0000 7ff19ffff700 1 -- 172.21.15.61:0/1769623224 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff198013610 con 0x7ff1a80a6060 2023-01-01T17:40:11.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.609+0000 7ff1ae224700 1 -- 172.21.15.61:0/1769623224 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1a80a8aa0 con 0x7ff1a80a6060 2023-01-01T17:40:11.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.609+0000 7ff19ffff700 1 -- 172.21.15.61:0/1769623224 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1980139c0 con 0x7ff1a80a6060 2023-01-01T17:40:11.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.609+0000 7ff1ae224700 1 -- 172.21.15.61:0/1769623224 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1a80a9260 con 0x7ff1a80a6060 2023-01-01T17:40:11.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.610+0000 7ff1ae224700 1 -- 172.21.15.61:0/1769623224 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1a80c7680 con 0x7ff1a80a6060 2023-01-01T17:40:11.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.610+0000 7ff19ffff700 1 -- 172.21.15.61:0/1769623224 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7ff198013b20 con 0x7ff1a80a6060 2023-01-01T17:40:11.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.611+0000 7ff19ffff700 1 --2- 172.21.15.61:0/1769623224 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7ff188063290 0x7ff188065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:11.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.611+0000 7ff19ffff700 1 -- 172.21.15.61:0/1769623224 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff19807fa80 con 0x7ff1a80a6060 2023-01-01T17:40:11.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.611+0000 7ff1a6ffd700 1 --2- 172.21.15.61:0/1769623224 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7ff188063290 0x7ff188065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:11.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.611+0000 7ff1a6ffd700 1 --2- 172.21.15.61:0/1769623224 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7ff188063290 0x7ff188065740 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff190000c00 tx=0x7ff190008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:11.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.615+0000 7ff19ffff700 1 -- 172.21.15.61:0/1769623224 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7ff19804e7e0 con 0x7ff1a80a6060 2023-01-01T17:40:11.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.805+0000 7ff1ae224700 1 -- 172.21.15.61:0/1769623224 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1a8155020 con 0x7ff1a80a6060 2023-01-01T17:40:11.806 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.806+0000 7ff19ffff700 1 -- 172.21.15.61:0/1769623224 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18729 (secure 0 0 0) 0x7ff198017090 con 0x7ff1a80a6060 2023-01-01T17:40:11.806 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:40:11.807 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":24,"fsid":"fe0d3d8e-46ee-4ed9-92f8-749741721d01","created":"2023-01-01T17:39:34.752404+0000","modified":"2023-01-01T17:39:57.386830+0000","last_up_change":"2023-01-01T17:39:45.159720+0000","last_in_change":"2023-01-01T17:39:37.293057+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-01-01T17:39:46.110776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-01-01T17:39:46.276625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-01-01T17:39:50.568073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-01-01T17:39:51.915351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-01-01T17:39:54.992107+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5ba13bcd-4407-4cfd-8487-80917501e525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":94349},{"type":"v1","addr":"172.21.15.61:6825","nonce":94349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":94349},{"type":"v1","addr":"172.21.15.61:6827","nonce":94349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":94349},{"type":"v1","addr":"172.21.15.61:6831","nonce":94349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":94349},{"type":"v1","addr":"172.21.15.61:6829","nonce":94349}]},"public_addr":"172.21.15.61:6825/94349","cluster_addr":"172.21.15.61:6827/94349","heartbeat_back_addr":"172.21.15.61:6831/94349","heartbeat_front_addr":"172.21.15.61:6829/94349","state":["exists","up"]},{"osd":1,"uuid":"7dca9f34-ea22-4894-b238-5606b16b9c74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6811","nonce":94348},{"type":"v1","addr":"172.21.15.61:6813","nonce":94348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":94348},{"type":"v1","addr":"172.21.15.61:6816","nonce":94348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6821","nonce":94348},{"type":"v1","addr":"172.21.15.61:6823","nonce":94348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":94348},{"type":"v1","addr":"172.21.15.61:6819","nonce":94348}]},"public_addr":"172.21.15.61:6813/94348","cluster_addr":"172.21.15.61:6816/94348","heartbeat_back_addr":"172.21.15.61:6823/94348","heartbeat_front_addr":"172.21.15.61:6819/94348","state":["exists","up"]},{"osd":2,"uuid":"7b43ea06-a7b6-49f4-a390-18ad14dfe4fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":94350},{"type":"v1","addr":"172.21.15.61:6809","nonce":94350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":94350},{"type":"v1","addr":"172.21.15.61:6812","nonce":94350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":94350},{"type":"v1","addr":"172.21.15.61:6822","nonce":94350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6815","nonce":94350},{"type":"v1","addr":"172.21.15.61:6817","nonce":94350}]},"public_addr":"172.21.15.61:6809/94350","cluster_addr":"172.21.15.61:6812/94350","heartbeat_back_addr":"172.21.15.61:6822/94350","heartbeat_front_addr":"172.21.15.61:6817/94350","state":["exists","up"]},{"osd":3,"uuid":"117c41d8-d40c-4cc0-b0e1-70bca058fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":94347},{"type":"v1","addr":"172.21.15.61:6801","nonce":94347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":94347},{"type":"v1","addr":"172.21.15.61:6803","nonce":94347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":94347},{"type":"v1","addr":"172.21.15.61:6807","nonce":94347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":94347},{"type":"v1","addr":"172.21.15.61:6805","nonce":94347}]},"public_addr":"172.21.15.61:6801/94347","cluster_addr":"172.21.15.61:6803/94347","heartbeat_back_addr":"172.21.15.61:6807/94347","heartbeat_front_addr":"172.21.15.61:6805/94347","state":["exists","up"]},{"osd":4,"uuid":"4073e0e8-c5dd-463f-aa1c-c9515ef09976","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":94711},{"type":"v1","addr":"172.21.15.149:6818","nonce":94711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":94711},{"type":"v1","addr":"172.21.15.149:6822","nonce":94711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":94711},{"type":"v1","addr":"172.21.15.149:6830","nonce":94711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":94711},{"type":"v1","addr":"172.21.15.149:6826","nonce":94711}]},"public_addr":"172.21.15.149:6818/94711","cluster_addr":"172.21.15.149:6822/94711","heartbeat_back_addr":"172.21.15.149:6830/94711","heartbeat_front_addr":"172.21.15.149:6826/94711","state":["exists","up"]},{"osd":5,"uuid":"88aa0c0f-e3c1-4dd3-af8c-61f4bc28504e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":94709},{"type":"v1","addr":"172.21.15.149:6809","nonce":94709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":94709},{"type":"v1","addr":"172.21.15.149:6811","nonce":94709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":94709},{"type":"v1","addr":"172.21.15.149:6815","nonce":94709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":94709},{"type":"v1","addr":"172.21.15.149:6813","nonce":94709}]},"public_addr":"172.21.15.149:6809/94709","cluster_addr":"172.21.15.149:6811/94709","heartbeat_back_addr":"172.21.15.149:6815/94709","heartbeat_front_addr":"172.21.15.149:6813/94709","state":["exists","up"]},{"osd":6,"uuid":"8b13fc0c-5f00-41c7-8923-c4570da77afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":94710},{"type":"v1","addr":"172.21.15.149:6801","nonce":94710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":94710},{"type":"v1","addr":"172.21.15.149:6803","nonce":94710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":94710},{"type":"v1","addr":"172.21.15.149:6807","nonce":94710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":94710},{"type":"v1","addr":"172.21.15.149:6805","nonce":94710}]},"public_addr":"172.21.15.149:6801/94710","cluster_addr":"172.21.15.149:6803/94710","heartbeat_back_addr":"172.21.15.149:6807/94710","heartbeat_front_addr":"172.21.15.149:6805/94710","state":["exists","up"]},{"osd":7,"uuid":"5390c6e5-39e7-4aa6-b73c-642458b2acf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":94734},{"type":"v1","addr":"172.21.15.149:6819","nonce":94734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":94734},{"type":"v1","addr":"172.21.15.149:6823","nonce":94734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":94734},{"type":"v1","addr":"172.21.15.149:6831","nonce":94734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":94734},{"type":"v1","addr":"172.21.15.149:6827","nonce":94734}]},"public_addr":"172.21.15.149:6819/94734","cluster_addr":"172.21.15.149:6823/94734","heartbeat_back_addr":"172.21.15.149:6831/94734","heartbeat_front_addr":"172.21.15.149:6827/94734","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.555826+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.508739+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.515601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.472067+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.535257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.493397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.554910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.552343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-01T17:40:11.809 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.808+0000 7ff1ae224700 1 -- 172.21.15.61:0/1769623224 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7ff188063290 msgr2=0x7ff188065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:11.809 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.808+0000 7ff1ae224700 1 --2- 172.21.15.61:0/1769623224 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7ff188063290 0x7ff188065740 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff190000c00 tx=0x7ff190008030 comp rx=0 tx=0).stop 2023-01-01T17:40:11.809 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.808+0000 7ff1ae224700 1 -- 172.21.15.61:0/1769623224 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff1a80a6060 msgr2=0x7ff1a8147990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:11.809 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.808+0000 7ff1ae224700 1 --2- 172.21.15.61:0/1769623224 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff1a80a6060 0x7ff1a8147990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff19800e810 tx=0x7ff19800eb20 comp rx=0 tx=0).stop 2023-01-01T17:40:11.809 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.808+0000 7ff1ae224700 1 -- 172.21.15.61:0/1769623224 shutdown_connections 2023-01-01T17:40:11.809 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.808+0000 7ff1ae224700 1 --2- 172.21.15.61:0/1769623224 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1a80c5c90 0x7ff1a81e9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:11.809 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.808+0000 7ff1ae224700 1 --2- 172.21.15.61:0/1769623224 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7ff188063290 0x7ff188065740 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:11.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.808+0000 7ff1ae224700 1 --2- 172.21.15.61:0/1769623224 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff1a80a6060 0x7ff1a8147990 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:11.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.808+0000 7ff1ae224700 1 --2- 172.21.15.61:0/1769623224 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff1a80c58c0 0x7ff1a8149350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:11.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.808+0000 7ff1ae224700 1 -- 172.21.15.61:0/1769623224 >> 172.21.15.61:0/1769623224 conn(0x7ff1a8069fa0 msgr2=0x7ff1a814b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:11.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.808+0000 7ff1ae224700 1 -- 172.21.15.61:0/1769623224 shutdown_connections 2023-01-01T17:40:11.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.808+0000 7ff1ae224700 1 -- 172.21.15.61:0/1769623224 wait complete. 2023-01-01T17:40:11.821 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-01-01T17:40:11.821 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-01T17:40:11.944 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.944+0000 7f71a9994700 1 Processor -- start 2023-01-01T17:40:11.945 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.944+0000 7f71a9994700 1 -- start start 2023-01-01T17:40:11.947 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.945+0000 7f71a9994700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f71a406b030 0x7f71a40c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:11.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.945+0000 7f71a9994700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71a4153bb0 0x7f71a406b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:11.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.945+0000 7f71a9994700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f71a4156490 0x7f71a4156930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:11.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.945+0000 7f71a9994700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71a40c9810 con 0x7f71a4156490 2023-01-01T17:40:11.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.945+0000 7f71a9994700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71a4152ec0 con 0x7f71a406b030 2023-01-01T17:40:11.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.945+0000 7f71a9994700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71a406b940 con 0x7f71a4153bb0 2023-01-01T17:40:11.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.945+0000 7f71a37fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f71a4156490 0x7f71a4156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:11.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.945+0000 7f71a37fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f71a4156490 0x7f71a4156930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46532/0 (socket says 172.21.15.61:46532) 2023-01-01T17:40:11.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.945+0000 7f71a37fe700 1 -- 172.21.15.61:0/3947804687 learned_addr learned my addr 172.21.15.61:0/3947804687 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:11.948 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.945+0000 7f71a27fc700 1 --2- 172.21.15.61:0/3947804687 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71a4153bb0 0x7f71a406b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:11.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.945+0000 7f71a2ffd700 1 --2- 172.21.15.61:0/3947804687 >> v2:172.21.15.149:3300/0 conn(0x7f71a406b030 0x7f71a40c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:11.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.945+0000 7f71a37fe700 1 -- 172.21.15.61:0/3947804687 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71a4153bb0 msgr2=0x7f71a406b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:11.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.945+0000 7f71a37fe700 1 --2- 172.21.15.61:0/3947804687 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71a4153bb0 0x7f71a406b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:11.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.945+0000 7f71a37fe700 1 -- 172.21.15.61:0/3947804687 >> v2:172.21.15.149:3300/0 conn(0x7f71a406b030 msgr2=0x7f71a40c4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:11.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.945+0000 7f71a37fe700 1 --2- 172.21.15.61:0/3947804687 >> v2:172.21.15.149:3300/0 conn(0x7f71a406b030 0x7f71a40c4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:11.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.945+0000 7f71a37fe700 1 -- 172.21.15.61:0/3947804687 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a40c9530 con 0x7f71a4156490 2023-01-01T17:40:11.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.946+0000 7f71a37fe700 1 --2- 172.21.15.61:0/3947804687 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71a4156490 0x7f71a4156930 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f71a40715c0 tx=0x7f719c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd1d08c70608d2e server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:11.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.946+0000 7f71a1ffb700 1 -- 172.21.15.61:0/3947804687 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719c00e070 con 0x7f71a4156490 2023-01-01T17:40:11.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.946+0000 7f71a1ffb700 1 -- 172.21.15.61:0/3947804687 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719c00b9c0 con 0x7f71a4156490 2023-01-01T17:40:11.949 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.946+0000 7f71a1ffb700 1 -- 172.21.15.61:0/3947804687 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719c00bd70 con 0x7f71a4156490 2023-01-01T17:40:11.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.946+0000 7f71a9994700 1 -- 172.21.15.61:0/3947804687 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71a4156490 msgr2=0x7f71a4156930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:11.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.946+0000 7f71a9994700 1 --2- 172.21.15.61:0/3947804687 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71a4156490 0x7f71a4156930 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f71a40715c0 tx=0x7f719c00b330 comp rx=0 tx=0).stop 2023-01-01T17:40:11.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.946+0000 7f71a9994700 1 -- 172.21.15.61:0/3947804687 shutdown_connections 2023-01-01T17:40:11.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.946+0000 7f71a9994700 1 --2- 172.21.15.61:0/3947804687 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71a4156490 0x7f71a4156930 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:11.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.946+0000 7f71a9994700 1 --2- 172.21.15.61:0/3947804687 >> v2:172.21.15.149:3300/0 conn(0x7f71a406b030 0x7f71a40c4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:11.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.946+0000 7f71a9994700 1 --2- 172.21.15.61:0/3947804687 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71a4153bb0 0x7f71a406b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:11.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.946+0000 7f71a9994700 1 -- 172.21.15.61:0/3947804687 >> 172.21.15.61:0/3947804687 conn(0x7f71a4070a90 msgr2=0x7f71a4070e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:11.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.946+0000 7f71a9994700 1 -- 172.21.15.61:0/3947804687 shutdown_connections 2023-01-01T17:40:11.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.946+0000 7f71a9994700 1 -- 172.21.15.61:0/3947804687 wait complete. 2023-01-01T17:40:11.950 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.947+0000 7f71a9994700 1 Processor -- start 2023-01-01T17:40:11.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.948+0000 7f71a9994700 1 -- start start 2023-01-01T17:40:11.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.948+0000 7f71a9994700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71a406b030 0x7f71a41ebc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:11.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.948+0000 7f71a9994700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71a4153bb0 0x7f71a41ec1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:11.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.948+0000 7f71a9994700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71a4156490 0x7f71a40aa5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:11.954 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.948+0000 7f71a9994700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a40c09f0 con 0x7f71a406b030 2023-01-01T17:40:11.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.948+0000 7f71a9994700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a41ec700 con 0x7f71a4153bb0 2023-01-01T17:40:11.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.948+0000 7f71a9994700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71a41ecbf0 con 0x7f71a4156490 2023-01-01T17:40:11.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.948+0000 7f71a2ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71a406b030 0x7f71a41ebc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:11.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.948+0000 7f71a2ffd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71a406b030 0x7f71a41ebc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46534/0 (socket says 172.21.15.61:46534) 2023-01-01T17:40:11.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.948+0000 7f71a2ffd700 1 -- 172.21.15.61:0/2027857727 learned_addr learned my addr 172.21.15.61:0/2027857727 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:11.955 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.949+0000 7f71a27fc700 1 --2- 172.21.15.61:0/2027857727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71a4153bb0 0x7f71a41ec1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:11.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.949+0000 7f71a37fe700 1 --2- 172.21.15.61:0/2027857727 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71a4156490 0x7f71a40aa5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:11.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.949+0000 7f71a2ffd700 1 -- 172.21.15.61:0/2027857727 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71a4156490 msgr2=0x7f71a40aa5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:11.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.949+0000 7f71a2ffd700 1 --2- 172.21.15.61:0/2027857727 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71a4156490 0x7f71a40aa5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:11.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.949+0000 7f71a2ffd700 1 -- 172.21.15.61:0/2027857727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71a4153bb0 msgr2=0x7f71a41ec1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:11.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.949+0000 7f71a2ffd700 1 --2- 172.21.15.61:0/2027857727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71a4153bb0 0x7f71a41ec1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:11.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.949+0000 7f71a2ffd700 1 -- 172.21.15.61:0/2027857727 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719c009b30 con 0x7f71a406b030 2023-01-01T17:40:11.957 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.949+0000 7f71a2ffd700 1 --2- 172.21.15.61:0/2027857727 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71a406b030 0x7f71a41ebc80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f719400e810 tx=0x7f719400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:11.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.949+0000 7f719bfff700 1 -- 172.21.15.61:0/2027857727 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719400c070 con 0x7f71a406b030 2023-01-01T17:40:11.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.949+0000 7f719bfff700 1 -- 172.21.15.61:0/2027857727 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7194013610 con 0x7f71a406b030 2023-01-01T17:40:11.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.949+0000 7f71a9994700 1 -- 172.21.15.61:0/2027857727 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71a41533b0 con 0x7f71a406b030 2023-01-01T17:40:11.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.949+0000 7f719bfff700 1 -- 172.21.15.61:0/2027857727 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71940139a0 con 0x7f71a406b030 2023-01-01T17:40:11.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.949+0000 7f71a9994700 1 -- 172.21.15.61:0/2027857727 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71a41530d0 con 0x7f71a406b030 2023-01-01T17:40:11.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.950+0000 7f71a9994700 1 -- 172.21.15.61:0/2027857727 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71a4153690 con 0x7f71a406b030 2023-01-01T17:40:11.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.951+0000 7f719bfff700 1 -- 172.21.15.61:0/2027857727 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f7194023070 con 0x7f71a406b030 2023-01-01T17:40:11.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.951+0000 7f719bfff700 1 --2- 172.21.15.61:0/2027857727 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f7184063290 0x7f7184065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:11.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.951+0000 7f719bfff700 1 -- 172.21.15.61:0/2027857727 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f719407fa40 con 0x7f71a406b030 2023-01-01T17:40:11.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.951+0000 7f71a27fc700 1 --2- 172.21.15.61:0/2027857727 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f7184063290 0x7f7184065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:11.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.951+0000 7f71a27fc700 1 --2- 172.21.15.61:0/2027857727 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f7184063290 0x7f7184065740 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f71a40c0430 tx=0x7f718c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:11.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:11.955+0000 7f719bfff700 1 -- 172.21.15.61:0/2027857727 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f719404e800 con 0x7f71a406b030 2023-01-01T17:40:12.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.144+0000 7f71a9994700 1 -- 172.21.15.61:0/2027857727 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71a40c3a50 con 0x7f71a406b030 2023-01-01T17:40:12.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.145+0000 7f719bfff700 1 -- 172.21.15.61:0/2027857727 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18729 (secure 0 0 0) 0x7f719407d940 con 0x7f71a406b030 2023-01-01T17:40:12.146 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:40:12.146 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":24,"fsid":"fe0d3d8e-46ee-4ed9-92f8-749741721d01","created":"2023-01-01T17:39:34.752404+0000","modified":"2023-01-01T17:39:57.386830+0000","last_up_change":"2023-01-01T17:39:45.159720+0000","last_in_change":"2023-01-01T17:39:37.293057+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-01-01T17:39:46.110776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-01-01T17:39:46.276625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-01-01T17:39:50.568073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-01-01T17:39:51.915351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-01-01T17:39:54.992107+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5ba13bcd-4407-4cfd-8487-80917501e525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":94349},{"type":"v1","addr":"172.21.15.61:6825","nonce":94349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":94349},{"type":"v1","addr":"172.21.15.61:6827","nonce":94349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":94349},{"type":"v1","addr":"172.21.15.61:6831","nonce":94349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":94349},{"type":"v1","addr":"172.21.15.61:6829","nonce":94349}]},"public_addr":"172.21.15.61:6825/94349","cluster_addr":"172.21.15.61:6827/94349","heartbeat_back_addr":"172.21.15.61:6831/94349","heartbeat_front_addr":"172.21.15.61:6829/94349","state":["exists","up"]},{"osd":1,"uuid":"7dca9f34-ea22-4894-b238-5606b16b9c74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6811","nonce":94348},{"type":"v1","addr":"172.21.15.61:6813","nonce":94348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":94348},{"type":"v1","addr":"172.21.15.61:6816","nonce":94348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6821","nonce":94348},{"type":"v1","addr":"172.21.15.61:6823","nonce":94348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":94348},{"type":"v1","addr":"172.21.15.61:6819","nonce":94348}]},"public_addr":"172.21.15.61:6813/94348","cluster_addr":"172.21.15.61:6816/94348","heartbeat_back_addr":"172.21.15.61:6823/94348","heartbeat_front_addr":"172.21.15.61:6819/94348","state":["exists","up"]},{"osd":2,"uuid":"7b43ea06-a7b6-49f4-a390-18ad14dfe4fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":94350},{"type":"v1","addr":"172.21.15.61:6809","nonce":94350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":94350},{"type":"v1","addr":"172.21.15.61:6812","nonce":94350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":94350},{"type":"v1","addr":"172.21.15.61:6822","nonce":94350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6815","nonce":94350},{"type":"v1","addr":"172.21.15.61:6817","nonce":94350}]},"public_addr":"172.21.15.61:6809/94350","cluster_addr":"172.21.15.61:6812/94350","heartbeat_back_addr":"172.21.15.61:6822/94350","heartbeat_front_addr":"172.21.15.61:6817/94350","state":["exists","up"]},{"osd":3,"uuid":"117c41d8-d40c-4cc0-b0e1-70bca058fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":94347},{"type":"v1","addr":"172.21.15.61:6801","nonce":94347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":94347},{"type":"v1","addr":"172.21.15.61:6803","nonce":94347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":94347},{"type":"v1","addr":"172.21.15.61:6807","nonce":94347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":94347},{"type":"v1","addr":"172.21.15.61:6805","nonce":94347}]},"public_addr":"172.21.15.61:6801/94347","cluster_addr":"172.21.15.61:6803/94347","heartbeat_back_addr":"172.21.15.61:6807/94347","heartbeat_front_addr":"172.21.15.61:6805/94347","state":["exists","up"]},{"osd":4,"uuid":"4073e0e8-c5dd-463f-aa1c-c9515ef09976","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":94711},{"type":"v1","addr":"172.21.15.149:6818","nonce":94711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":94711},{"type":"v1","addr":"172.21.15.149:6822","nonce":94711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":94711},{"type":"v1","addr":"172.21.15.149:6830","nonce":94711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":94711},{"type":"v1","addr":"172.21.15.149:6826","nonce":94711}]},"public_addr":"172.21.15.149:6818/94711","cluster_addr":"172.21.15.149:6822/94711","heartbeat_back_addr":"172.21.15.149:6830/94711","heartbeat_front_addr":"172.21.15.149:6826/94711","state":["exists","up"]},{"osd":5,"uuid":"88aa0c0f-e3c1-4dd3-af8c-61f4bc28504e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":94709},{"type":"v1","addr":"172.21.15.149:6809","nonce":94709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":94709},{"type":"v1","addr":"172.21.15.149:6811","nonce":94709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":94709},{"type":"v1","addr":"172.21.15.149:6815","nonce":94709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":94709},{"type":"v1","addr":"172.21.15.149:6813","nonce":94709}]},"public_addr":"172.21.15.149:6809/94709","cluster_addr":"172.21.15.149:6811/94709","heartbeat_back_addr":"172.21.15.149:6815/94709","heartbeat_front_addr":"172.21.15.149:6813/94709","state":["exists","up"]},{"osd":6,"uuid":"8b13fc0c-5f00-41c7-8923-c4570da77afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":94710},{"type":"v1","addr":"172.21.15.149:6801","nonce":94710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":94710},{"type":"v1","addr":"172.21.15.149:6803","nonce":94710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":94710},{"type":"v1","addr":"172.21.15.149:6807","nonce":94710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":94710},{"type":"v1","addr":"172.21.15.149:6805","nonce":94710}]},"public_addr":"172.21.15.149:6801/94710","cluster_addr":"172.21.15.149:6803/94710","heartbeat_back_addr":"172.21.15.149:6807/94710","heartbeat_front_addr":"172.21.15.149:6805/94710","state":["exists","up"]},{"osd":7,"uuid":"5390c6e5-39e7-4aa6-b73c-642458b2acf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":94734},{"type":"v1","addr":"172.21.15.149:6819","nonce":94734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":94734},{"type":"v1","addr":"172.21.15.149:6823","nonce":94734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":94734},{"type":"v1","addr":"172.21.15.149:6831","nonce":94734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":94734},{"type":"v1","addr":"172.21.15.149:6827","nonce":94734}]},"public_addr":"172.21.15.149:6819/94734","cluster_addr":"172.21.15.149:6823/94734","heartbeat_back_addr":"172.21.15.149:6831/94734","heartbeat_front_addr":"172.21.15.149:6827/94734","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.555826+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.508739+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.515601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.472067+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.535257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.493397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.554910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.552343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-01T17:40:12.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.147+0000 7f71a9994700 1 -- 172.21.15.61:0/2027857727 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f7184063290 msgr2=0x7f7184065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.147+0000 7f71a9994700 1 --2- 172.21.15.61:0/2027857727 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f7184063290 0x7f7184065740 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f71a40c0430 tx=0x7f718c008040 comp rx=0 tx=0).stop 2023-01-01T17:40:12.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.147+0000 7f71a9994700 1 -- 172.21.15.61:0/2027857727 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71a406b030 msgr2=0x7f71a41ebc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.147+0000 7f71a9994700 1 --2- 172.21.15.61:0/2027857727 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71a406b030 0x7f71a41ebc80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f719400e810 tx=0x7f719400eb20 comp rx=0 tx=0).stop 2023-01-01T17:40:12.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.147+0000 7f71a9994700 1 -- 172.21.15.61:0/2027857727 shutdown_connections 2023-01-01T17:40:12.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.147+0000 7f71a9994700 1 --2- 172.21.15.61:0/2027857727 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f71a4156490 0x7f71a40aa5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.148 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.147+0000 7f71a9994700 1 --2- 172.21.15.61:0/2027857727 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f7184063290 0x7f7184065740 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.147+0000 7f71a9994700 1 --2- 172.21.15.61:0/2027857727 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f71a406b030 0x7f71a41ebc80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.147+0000 7f71a9994700 1 --2- 172.21.15.61:0/2027857727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71a4153bb0 0x7f71a41ec1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.147+0000 7f71a9994700 1 -- 172.21.15.61:0/2027857727 >> 172.21.15.61:0/2027857727 conn(0x7f71a4070a90 msgr2=0x7f71a40c6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:12.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.147+0000 7f71a9994700 1 -- 172.21.15.61:0/2027857727 shutdown_connections 2023-01-01T17:40:12.149 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.147+0000 7f71a9994700 1 -- 172.21.15.61:0/2027857727 wait complete. 2023-01-01T17:40:12.160 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-01-01T17:40:12.161 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-01-01T17:40:12.161 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-01-01T17:40:12.162 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-01-01T17:40:12.162 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-01-01T17:40:12.162 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-01-01T17:40:12.163 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-01-01T17:40:12.163 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-01-01T17:40:12.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.375+0000 7fb5c2047700 1 Processor -- start 2023-01-01T17:40:12.376 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.375+0000 7fb5c2047700 1 -- start start 2023-01-01T17:40:12.377 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.376+0000 7fb5c2047700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb5bc0c4610 0x7fb5bc152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.377 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.376+0000 7fb5c2047700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb5bc0c4b60 0x7fb5bc153530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.377 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.376+0000 7fb5c2047700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5bc0c0270 con 0x7fb5bc150140 2023-01-01T17:40:12.377 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.376+0000 7fb5c2047700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5bc152be0 con 0x7fb5bc0c4b60 2023-01-01T17:40:12.377 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.376+0000 7fb5c2047700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc0c4020 con 0x7fb5bc0c4610 2023-01-01T17:40:12.377 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.377+0000 7fb5c0844700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb5bc0c4610 0x7fb5bc152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.377 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.377+0000 7fb5c0844700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb5bc0c4610 0x7fb5bc152ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.61:44784/0 (socket says 172.21.15.61:44784) 2023-01-01T17:40:12.378 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.377+0000 7fb5c0844700 1 -- 172.21.15.61:0/2811122355 learned_addr learned my addr 172.21.15.61:0/2811122355 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:12.379 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.377+0000 7fb5c0844700 1 -- 172.21.15.61:0/2811122355 >> v2:172.21.15.149:3300/0 conn(0x7fb5bc0c4b60 msgr2=0x7fb5bc153530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:40:12.379 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.377+0000 7fb5c0844700 1 --2- 172.21.15.61:0/2811122355 >> v2:172.21.15.149:3300/0 conn(0x7fb5bc0c4b60 0x7fb5bc153530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.379 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.377+0000 7fb5c0844700 1 -- 172.21.15.61:0/2811122355 >> v1:172.21.15.61:6789/0 conn(0x7fb5bc150140 legacy=0x7fb5bc0c6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:12.379 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.377+0000 7fb5c0844700 1 -- 172.21.15.61:0/2811122355 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5bc0c4300 con 0x7fb5bc0c4610 2023-01-01T17:40:12.379 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.377+0000 7fb5c0844700 1 --2- 172.21.15.61:0/2811122355 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb5bc0c4610 0x7fb5bc152ff0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac0098f0 tx=0x7fb5ac009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b55a1d1b890a0fd server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.379 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.377+0000 7fb5b3fff700 1 -- 172.21.15.61:0/2811122355 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac004230 con 0x7fb5bc0c4610 2023-01-01T17:40:12.379 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.377+0000 7fb5b3fff700 1 -- 172.21.15.61:0/2811122355 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5ac004390 con 0x7fb5bc0c4610 2023-01-01T17:40:12.379 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.377+0000 7fb5b3fff700 1 -- 172.21.15.61:0/2811122355 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac0036a0 con 0x7fb5bc0c4610 2023-01-01T17:40:12.380 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.378+0000 7fb5c2047700 1 -- 172.21.15.61:0/2811122355 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb5bc0c4610 msgr2=0x7fb5bc152ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.380 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.378+0000 7fb5c2047700 1 --2- 172.21.15.61:0/2811122355 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb5bc0c4610 0x7fb5bc152ff0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac0098f0 tx=0x7fb5ac009c00 comp rx=0 tx=0).stop 2023-01-01T17:40:12.380 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.380+0000 7fb5c2047700 1 -- 172.21.15.61:0/2811122355 shutdown_connections 2023-01-01T17:40:12.380 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.380+0000 7fb5c2047700 1 --2- 172.21.15.61:0/2811122355 >> v2:172.21.15.149:3300/0 conn(0x7fb5bc0c4b60 0x7fb5bc153530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.380 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.380+0000 7fb5c2047700 1 --2- 172.21.15.61:0/2811122355 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb5bc0c4610 0x7fb5bc152ff0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.381 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.380+0000 7fb5c2047700 1 -- 172.21.15.61:0/2811122355 >> 172.21.15.61:0/2811122355 conn(0x7fb5bc0a8170 msgr2=0x7fb5bc0c58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:12.381 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.380+0000 7fb5c2047700 1 -- 172.21.15.61:0/2811122355 shutdown_connections 2023-01-01T17:40:12.381 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.380+0000 7fb5c2047700 1 -- 172.21.15.61:0/2811122355 wait complete. 2023-01-01T17:40:12.382 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.381+0000 7fb5c2047700 1 Processor -- start 2023-01-01T17:40:12.382 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.382+0000 7fb5c2047700 1 -- start start 2023-01-01T17:40:12.383 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.383+0000 7fb5c2047700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb5bc0c4610 0x7fb5bc151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.384 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.383+0000 7fb5c2047700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5bc0c4b60 0x7fb5bc14a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.384 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.383+0000 7fb5c2047700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb5bc150140 0x7fb5bc1e7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.384 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.383+0000 7fb5c2047700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc155c20 con 0x7fb5bc0c4610 2023-01-01T17:40:12.384 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.383+0000 7fb5c2047700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc14f410 con 0x7fb5bc0c4b60 2023-01-01T17:40:12.384 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.383+0000 7fb5c2047700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc0bb120 con 0x7fb5bc150140 2023-01-01T17:40:12.384 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.383+0000 7fb5c1045700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb5bc0c4610 0x7fb5bc151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.384 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.383+0000 7fb5c1045700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb5bc0c4610 0x7fb5bc151d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46546/0 (socket says 172.21.15.61:46546) 2023-01-01T17:40:12.384 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.383+0000 7fb5c1045700 1 -- 172.21.15.61:0/2675342962 learned_addr learned my addr 172.21.15.61:0/2675342962 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:12.384 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.383+0000 7fb5c1846700 1 --2- 172.21.15.61:0/2675342962 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb5bc150140 0x7fb5bc1e7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.384 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.383+0000 7fb5c1045700 1 -- 172.21.15.61:0/2675342962 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb5bc150140 msgr2=0x7fb5bc1e7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.383+0000 7fb5c1045700 1 --2- 172.21.15.61:0/2675342962 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb5bc150140 0x7fb5bc1e7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.383+0000 7fb5c1045700 1 -- 172.21.15.61:0/2675342962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5bc0c4b60 msgr2=0x7fb5bc14a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.383+0000 7fb5c1045700 1 --2- 172.21.15.61:0/2675342962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb5bc0c4b60 0x7fb5bc14a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.383+0000 7fb5c1045700 1 -- 172.21.15.61:0/2675342962 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ac009550 con 0x7fb5bc0c4610 2023-01-01T17:40:12.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.384+0000 7fb5c1045700 1 --2- 172.21.15.61:0/2675342962 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb5bc0c4610 0x7fb5bc151d10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb5b400c8c0 tx=0x7fb5b400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.384+0000 7fb5b1ffb700 1 -- 172.21.15.61:0/2675342962 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b4003e10 con 0x7fb5bc0c4610 2023-01-01T17:40:12.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.384+0000 7fb5b1ffb700 1 -- 172.21.15.61:0/2675342962 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b400ce60 con 0x7fb5bc0c4610 2023-01-01T17:40:12.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.384+0000 7fb5b1ffb700 1 -- 172.21.15.61:0/2675342962 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b40052b0 con 0x7fb5bc0c4610 2023-01-01T17:40:12.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.385+0000 7fb5c2047700 1 -- 172.21.15.61:0/2675342962 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5bc156e40 con 0x7fb5bc0c4610 2023-01-01T17:40:12.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.385+0000 7fb5c2047700 1 -- 172.21.15.61:0/2675342962 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5bc156b60 con 0x7fb5bc0c4610 2023-01-01T17:40:12.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.386+0000 7fb5b1ffb700 1 -- 172.21.15.61:0/2675342962 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7fb5b4010070 con 0x7fb5bc0c4610 2023-01-01T17:40:12.387 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.387+0000 7fcc370bd700 1 Processor -- start 2023-01-01T17:40:12.387 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.387+0000 7fb12caaf700 1 Processor -- start 2023-01-01T17:40:12.388 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.387+0000 7fb5b1ffb700 1 --2- 172.21.15.61:0/2675342962 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fb5a0063290 0x7fb5a0065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.388 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.387+0000 7fb5b1ffb700 1 -- 172.21.15.61:0/2675342962 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb5b407f160 con 0x7fb5bc0c4610 2023-01-01T17:40:12.388 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.387+0000 7fc755eb3700 1 Processor -- start 2023-01-01T17:40:12.388 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.387+0000 7fcc370bd700 1 -- start start 2023-01-01T17:40:12.388 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.388+0000 7fcc370bd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fcc3014c810 0x7fcc3006a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.389 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.388+0000 7fcc370bd700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc300714b0 0x7fcc301528a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.389 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.388+0000 7fcc370bd700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc3006db90 con 0x7fcc3006fc40 2023-01-01T17:40:12.389 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.388+0000 7fcc370bd700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc3006d7a0 con 0x7fcc3014c810 2023-01-01T17:40:12.389 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.388+0000 7fcc370bd700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc300bc3e0 con 0x7fcc300714b0 2023-01-01T17:40:12.389 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.388+0000 7fb12caaf700 1 -- start start 2023-01-01T17:40:12.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.388+0000 7fcc34e59700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fcc3014c810 0x7fcc3006a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.388+0000 7fcc34e59700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fcc3014c810 0x7fcc3006a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46554/0 (socket says 172.21.15.61:46554) 2023-01-01T17:40:12.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.388+0000 7fcc34e59700 1 -- 172.21.15.61:0/3343142129 learned_addr learned my addr 172.21.15.61:0/3343142129 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:12.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.389+0000 7fb12caaf700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb12814fa20 0x7fb12806b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.390 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.389+0000 7fb12caaf700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb1280c2b10 0x7fb12806b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.389+0000 7fb12caaf700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb12814ff30 con 0x7fb12814c640 2023-01-01T17:40:12.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.389+0000 7fb12caaf700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb12806ada0 con 0x7fb1280c2b10 2023-01-01T17:40:12.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.389+0000 7fb12caaf700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb12814ca10 con 0x7fb12814fa20 2023-01-01T17:40:12.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.387+0000 7fb5c0844700 1 --2- 172.21.15.61:0/2675342962 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fb5a0063290 0x7fb5a0065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.388+0000 7fb5c0844700 1 --2- 172.21.15.61:0/2675342962 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fb5a0063290 0x7fb5a0065740 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc14d670 tx=0x7fb5ac010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.391 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.389+0000 7fb5c2047700 1 --2- 172.21.15.61:0/2675342962 >> [v2:172.21.15.149:6800/94710,v1:172.21.15.149:6801/94710] conn(0x7fb5bc155770 0x7fb5bc0c5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.389+0000 7fb5c2047700 1 -- 172.21.15.61:0/2675342962 --> [v2:172.21.15.149:6800/94710,v1:172.21.15.149:6801/94710] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb5bc1e7c40 con 0x7fb5bc155770 2023-01-01T17:40:12.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.389+0000 7fb12659c700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fb12814c640 0x7fb1280c1620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.61:48884/0 (socket says 172.21.15.61:48884) 2023-01-01T17:40:12.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.389+0000 7fb12659c700 1 -- 172.21.15.61:0/373653102 learned_addr learned my addr 172.21.15.61:0/373653102 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:40:12.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.389+0000 7fcc2ffff700 1 --2- 172.21.15.61:0/3343142129 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc300714b0 0x7fcc301528a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.389+0000 7fcc2f7fe700 1 -- 172.21.15.61:0/3343142129 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3258699939 0 0) 0x7fcc3006db90 con 0x7fcc3006fc40 2023-01-01T17:40:12.392 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.389+0000 7fcc2f7fe700 1 -- 172.21.15.61:0/3343142129 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc180079c0 con 0x7fcc3006fc40 2023-01-01T17:40:12.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.389+0000 7fcc2f7fe700 1 -- 172.21.15.61:0/3343142129 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1301419258 0 0) 0x7fcc180079c0 con 0x7fcc3006fc40 2023-01-01T17:40:12.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.389+0000 7fcc2f7fe700 1 -- 172.21.15.61:0/3343142129 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc300714b0 msgr2=0x7fcc301528a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:12.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.389+0000 7fcc2f7fe700 1 --2- 172.21.15.61:0/3343142129 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc300714b0 0x7fcc301528a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.389+0000 7fcc2f7fe700 1 -- 172.21.15.61:0/3343142129 >> v2:172.21.15.61:3300/0 conn(0x7fcc3014c810 msgr2=0x7fcc3006a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:12.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.389+0000 7fcc2f7fe700 1 --2- 172.21.15.61:0/3343142129 >> v2:172.21.15.61:3300/0 conn(0x7fcc3014c810 0x7fcc3006a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.389+0000 7fcc2f7fe700 1 -- 172.21.15.61:0/3343142129 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc300bc100 con 0x7fcc3006fc40 2023-01-01T17:40:12.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.389+0000 7fcc2f7fe700 1 -- 172.21.15.61:0/3343142129 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586489653 0 0) 0x7fcc280019f0 con 0x7fcc3006fc40 2023-01-01T17:40:12.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.390+0000 7fcc2f7fe700 1 -- 172.21.15.61:0/3343142129 >> v1:172.21.15.61:6789/0 conn(0x7fcc3006fc40 legacy=0x7fcc300bfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.390+0000 7fcc2f7fe700 1 --2- 172.21.15.61:0/3343142129 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc18007e40 0x7fcc18008250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.393 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.390+0000 7fcc2f7fe700 1 --2- 172.21.15.61:0/3343142129 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc18008c60 0x7fcc180090d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.390+0000 7fcc2f7fe700 1 --2- 172.21.15.61:0/3343142129 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc180074f0 0x7fcc18009610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.390+0000 7fcc2f7fe700 1 -- 172.21.15.61:0/3343142129 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3006d7a0 con 0x7fcc18008c60 2023-01-01T17:40:12.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.390+0000 7fcc2f7fe700 1 -- 172.21.15.61:0/3343142129 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc300bc3e0 con 0x7fcc18007e40 2023-01-01T17:40:12.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.390+0000 7fcc2f7fe700 1 -- 172.21.15.61:0/3343142129 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1800c060 con 0x7fcc180074f0 2023-01-01T17:40:12.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.390+0000 7fb125d9b700 1 --2- 172.21.15.61:0/373653102 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb12814fa20 0x7fb12806b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.394 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.390+0000 7fb5c1846700 1 --2- 172.21.15.61:0/2675342962 >> [v2:172.21.15.149:6800/94710,v1:172.21.15.149:6801/94710] conn(0x7fb5bc155770 0x7fb5bc0c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.389+0000 7fc755eb3700 1 -- start start 2023-01-01T17:40:12.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.390+0000 7fc755eb3700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc750070810 0x7fc75006fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.390+0000 7fc755eb3700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fc7500a5270 0x7fc7500c2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.390+0000 7fc755eb3700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc750150ad0 con 0x7fc7500715c0 2023-01-01T17:40:12.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.390+0000 7fc755eb3700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7500c3c30 con 0x7fc7500a5270 2023-01-01T17:40:12.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.390+0000 7fc755eb3700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7500c4120 con 0x7fc750070810 2023-01-01T17:40:12.395 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.390+0000 7fcc3565a700 1 --2- 172.21.15.61:0/3343142129 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc180074f0 0x7fcc18009610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.396 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.390+0000 7fc74ffff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fc7500a5270 0x7fc7500c2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.396 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.390+0000 7fc74ffff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fc7500a5270 0x7fc7500c2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46570/0 (socket says 172.21.15.61:46570) 2023-01-01T17:40:12.396 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.390+0000 7fc74ffff700 1 -- 172.21.15.61:0/1558034844 learned_addr learned my addr 172.21.15.61:0/1558034844 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:12.396 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.390+0000 7fb126d9d700 1 --2- 172.21.15.61:0/373653102 >> v2:172.21.15.61:3300/0 conn(0x7fb1280c2b10 0x7fb12806b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.397 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.391+0000 7fc74ffff700 1 -- 172.21.15.61:0/1558034844 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc750070810 msgr2=0x7fc75006fad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:40:12.397 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.391+0000 7fc74ffff700 1 --2- 172.21.15.61:0/1558034844 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc750070810 0x7fc75006fad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.397 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.391+0000 7fc74ffff700 1 -- 172.21.15.61:0/1558034844 >> v1:172.21.15.61:6789/0 conn(0x7fc7500715c0 legacy=0x7fc7500c06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:12.397 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.391+0000 7fc74ffff700 1 -- 172.21.15.61:0/1558034844 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7500c2f80 con 0x7fc7500a5270 2023-01-01T17:40:12.397 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.390+0000 7fb12559a700 1 -- 172.21.15.61:0/373653102 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 690814966 0 0) 0x7fb12814ff30 con 0x7fb12814c640 2023-01-01T17:40:12.397 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.390+0000 7fb12559a700 1 -- 172.21.15.61:0/373653102 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1100035b0 con 0x7fb12814c640 2023-01-01T17:40:12.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.391+0000 7fb126d9d700 1 -- 172.21.15.61:0/373653102 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb12814fa20 msgr2=0x7fb12806b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:12.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.391+0000 7fb126d9d700 1 --2- 172.21.15.61:0/373653102 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb12814fa20 0x7fb12806b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.391+0000 7fb126d9d700 1 -- 172.21.15.61:0/373653102 >> v1:172.21.15.149:6789/0 conn(0x7fb12814c640 legacy=0x7fb1280c1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.391+0000 7fb126d9d700 1 -- 172.21.15.61:0/373653102 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1280bf6c0 con 0x7fb1280c2b10 2023-01-01T17:40:12.398 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.391+0000 7fc74ffff700 1 --2- 172.21.15.61:0/1558034844 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc7500a5270 0x7fc7500c2240 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc7440098f0 tx=0x7fc744009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40cc16e3aab65153 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.391+0000 7fcc3565a700 1 -- 172.21.15.61:0/3343142129 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc18007e40 msgr2=0x7fcc18008250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-01-01T17:40:12.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.391+0000 7fcc3565a700 1 --2- 172.21.15.61:0/3343142129 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc18007e40 0x7fcc18008250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.391+0000 7fcc3565a700 1 -- 172.21.15.61:0/3343142129 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc18008c60 msgr2=0x7fcc180090d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:40:12.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.391+0000 7fcc3565a700 1 --2- 172.21.15.61:0/3343142129 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc18008c60 0x7fcc180090d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.391+0000 7fcc3565a700 1 -- 172.21.15.61:0/3343142129 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc300bc100 con 0x7fcc180074f0 2023-01-01T17:40:12.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.391+0000 7fb126d9d700 1 --2- 172.21.15.61:0/373653102 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb1280c2b10 0x7fb12806b770 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb120009d90 tx=0x7fb12000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b0ec31f201f4c14 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.391+0000 7fcc3565a700 1 --2- 172.21.15.61:0/3343142129 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc180074f0 0x7fcc18009610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800a8d0 tx=0x7fcc18009c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bebfa6e935d28cd9 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.391+0000 7fc74e7fc700 1 -- 172.21.15.61:0/1558034844 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc744004230 con 0x7fc7500a5270 2023-01-01T17:40:12.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.391+0000 7fc74e7fc700 1 -- 172.21.15.61:0/1558034844 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc744004390 con 0x7fc7500a5270 2023-01-01T17:40:12.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.391+0000 7fc74e7fc700 1 -- 172.21.15.61:0/1558034844 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7440036a0 con 0x7fc7500a5270 2023-01-01T17:40:12.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.391+0000 7fcc2f7fe700 1 -- 172.21.15.61:0/3343142129 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc28012620 con 0x7fcc180074f0 2023-01-01T17:40:12.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.391+0000 7fcc2f7fe700 1 -- 172.21.15.61:0/3343142129 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc28012780 con 0x7fcc180074f0 2023-01-01T17:40:12.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.391+0000 7fcc2f7fe700 1 -- 172.21.15.61:0/3343142129 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc28012b10 con 0x7fcc180074f0 2023-01-01T17:40:12.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.392+0000 7fb5c1846700 1 --2- 172.21.15.61:0/2675342962 >> [v2:172.21.15.149:6800/94710,v1:172.21.15.149:6801/94710] conn(0x7fb5bc155770 0x7fb5bc0c5800 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.392+0000 7fb12559a700 1 -- 172.21.15.61:0/373653102 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12000e070 con 0x7fb1280c2b10 2023-01-01T17:40:12.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.392+0000 7fb12559a700 1 -- 172.21.15.61:0/373653102 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12000bb20 con 0x7fb1280c2b10 2023-01-01T17:40:12.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.392+0000 7fb12559a700 1 -- 172.21.15.61:0/373653102 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb120012430 con 0x7fb1280c2b10 2023-01-01T17:40:12.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.393+0000 7fb5b1ffb700 1 -- 172.21.15.61:0/2675342962 <== osd.6 v2:172.21.15.149:6800/94710 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24745 (crc 0 0 0) 0x7fb5b800b440 con 0x7fb5bc155770 2023-01-01T17:40:12.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.393+0000 7fc755eb3700 1 -- 172.21.15.61:0/1558034844 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc7500a5270 msgr2=0x7fc7500c2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.393+0000 7fc755eb3700 1 --2- 172.21.15.61:0/1558034844 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc7500a5270 0x7fc7500c2240 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc7440098f0 tx=0x7fc744009c00 comp rx=0 tx=0).stop 2023-01-01T17:40:12.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.393+0000 7fc755eb3700 1 -- 172.21.15.61:0/1558034844 shutdown_connections 2023-01-01T17:40:12.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.393+0000 7fc755eb3700 1 --2- 172.21.15.61:0/1558034844 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc750070810 0x7fc75006fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.393+0000 7fc755eb3700 1 --2- 172.21.15.61:0/1558034844 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc7500a5270 0x7fc7500c2240 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.393+0000 7fc755eb3700 1 -- 172.21.15.61:0/1558034844 >> 172.21.15.61:0/1558034844 conn(0x7fc75006b100 msgr2=0x7fc7500c5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:12.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.393+0000 7fcc370bd700 1 -- 172.21.15.61:0/3343142129 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc180074f0 msgr2=0x7fcc18009610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.393+0000 7fcc370bd700 1 --2- 172.21.15.61:0/3343142129 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc180074f0 0x7fcc18009610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800a8d0 tx=0x7fcc18009c90 comp rx=0 tx=0).stop 2023-01-01T17:40:12.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.393+0000 7fcc3565a700 1 -- 172.21.15.61:0/3343142129 reap_dead start 2023-01-01T17:40:12.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.393+0000 7fc755eb3700 1 -- 172.21.15.61:0/1558034844 shutdown_connections 2023-01-01T17:40:12.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.393+0000 7fc755eb3700 1 -- 172.21.15.61:0/1558034844 wait complete. 2023-01-01T17:40:12.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.393+0000 7fcddc8cd700 1 Processor -- start 2023-01-01T17:40:12.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.393+0000 7fcc370bd700 1 -- 172.21.15.61:0/3343142129 shutdown_connections 2023-01-01T17:40:12.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.393+0000 7fcc370bd700 1 -- 172.21.15.61:0/3343142129 >> 172.21.15.61:0/3343142129 conn(0x7fcc300c1f30 msgr2=0x7fcc300c2330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:12.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.393+0000 7fb12caaf700 1 -- 172.21.15.61:0/373653102 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb1280c2b10 msgr2=0x7fb12806b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.393+0000 7fb12caaf700 1 --2- 172.21.15.61:0/373653102 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb1280c2b10 0x7fb12806b770 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb120009d90 tx=0x7fb12000b330 comp rx=0 tx=0).stop 2023-01-01T17:40:12.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.394+0000 7fcc370bd700 1 -- 172.21.15.61:0/3343142129 shutdown_connections 2023-01-01T17:40:12.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.394+0000 7fb12caaf700 1 -- 172.21.15.61:0/373653102 shutdown_connections 2023-01-01T17:40:12.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.394+0000 7fb12caaf700 1 --2- 172.21.15.61:0/373653102 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb1280c2b10 0x7fb12806b770 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.394+0000 7fb12caaf700 1 --2- 172.21.15.61:0/373653102 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb12814fa20 0x7fb12806b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.394+0000 7fb12caaf700 1 -- 172.21.15.61:0/373653102 >> 172.21.15.61:0/373653102 conn(0x7fb128069fb0 msgr2=0x7fb1280a6740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:12.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.394+0000 7fb12caaf700 1 -- 172.21.15.61:0/373653102 shutdown_connections 2023-01-01T17:40:12.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.394+0000 7fcddc8cd700 1 -- start start 2023-01-01T17:40:12.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.395+0000 7fcddc8cd700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcdd80715c0 0x7fcdd806fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.395+0000 7fcddc8cd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fcdd80a5270 0x7fcdd80c2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.395+0000 7fcddc8cd700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd8150ad0 con 0x7fcdd8070810 2023-01-01T17:40:12.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.395+0000 7fcddc8cd700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdd80c3c30 con 0x7fcdd80a5270 2023-01-01T17:40:12.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.395+0000 7fcddc8cd700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd80c4120 con 0x7fcdd80715c0 2023-01-01T17:40:12.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.395+0000 7fc755eb3700 1 Processor -- start 2023-01-01T17:40:12.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.394+0000 7fb12caaf700 1 -- 172.21.15.61:0/373653102 wait complete. 2023-01-01T17:40:12.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.394+0000 7fcc370bd700 1 -- 172.21.15.61:0/3343142129 wait complete. 2023-01-01T17:40:12.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.395+0000 7fcc370bd700 1 Processor -- start 2023-01-01T17:40:12.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.395+0000 7fcdd659c700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fcdd8070810 0x7fcdd80c06b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40426/0 (socket says 172.21.15.61:40426) 2023-01-01T17:40:12.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.395+0000 7fcdd659c700 1 -- 172.21.15.61:0/4254511783 learned_addr learned my addr 172.21.15.61:0/4254511783 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:40:12.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.395+0000 7fcdd6d9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fcdd80a5270 0x7fcdd80c2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.396+0000 7fb12caaf700 1 Processor -- start 2023-01-01T17:40:12.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.396+0000 7fcdd559a700 1 -- 172.21.15.61:0/4254511783 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3639593274 0 0) 0x7fcdd8150ad0 con 0x7fcdd8070810 2023-01-01T17:40:12.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.396+0000 7fcdd559a700 1 -- 172.21.15.61:0/4254511783 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdc00035b0 con 0x7fcdd8070810 2023-01-01T17:40:12.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.396+0000 7fcdd559a700 1 -- 172.21.15.61:0/4254511783 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3308479183 0 0) 0x7fcdc00035b0 con 0x7fcdd8070810 2023-01-01T17:40:12.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.396+0000 7fcdd559a700 1 -- 172.21.15.61:0/4254511783 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcdd80715c0 msgr2=0x7fcdd806fad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:40:12.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.396+0000 7fcdd559a700 1 --2- 172.21.15.61:0/4254511783 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcdd80715c0 0x7fcdd806fad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.396+0000 7fcdd559a700 1 -- 172.21.15.61:0/4254511783 >> v2:172.21.15.149:3300/0 conn(0x7fcdd80a5270 msgr2=0x7fcdd80c2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:12.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.396+0000 7fcdd559a700 1 --2- 172.21.15.61:0/4254511783 >> v2:172.21.15.149:3300/0 conn(0x7fcdd80a5270 0x7fcdd80c2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.396+0000 7fcdd559a700 1 -- 172.21.15.61:0/4254511783 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd80c2f80 con 0x7fcdd8070810 2023-01-01T17:40:12.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.396+0000 7fcdd559a700 1 -- 172.21.15.61:0/4254511783 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586489653 0 0) 0x7fcdcc001670 con 0x7fcdd8070810 2023-01-01T17:40:12.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.396+0000 7fcdd559a700 1 -- 172.21.15.61:0/4254511783 >> v1:172.21.15.61:6789/0 conn(0x7fcdd8070810 legacy=0x7fcdd80c06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.397+0000 7fcdd559a700 1 --2- 172.21.15.61:0/4254511783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcdc0003a00 0x7fcdc0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.397+0000 7fcdd559a700 1 --2- 172.21.15.61:0/4254511783 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcdc0004350 0x7fcdc0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.397+0000 7fcdd559a700 1 --2- 172.21.15.61:0/4254511783 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcdc0004fe0 0x7fcdc0010020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.397+0000 7fcdd559a700 1 -- 172.21.15.61:0/4254511783 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd80c3c30 con 0x7fcdc0004fe0 2023-01-01T17:40:12.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.397+0000 7fcdd559a700 1 -- 172.21.15.61:0/4254511783 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd80c4120 con 0x7fcdc0003a00 2023-01-01T17:40:12.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.397+0000 7fcdd559a700 1 -- 172.21.15.61:0/4254511783 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc0007bf0 con 0x7fcdc0004350 2023-01-01T17:40:12.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.396+0000 7fc755eb3700 1 -- start start 2023-01-01T17:40:12.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.397+0000 7fc755eb3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc750070810 0x7fc7500be8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.397+0000 7fc755eb3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7500715c0 0x7fc75014a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.397+0000 7fc755eb3700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc7500a5270 0x7fc75014ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.397+0000 7fc755eb3700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7500bc850 con 0x7fc750070810 2023-01-01T17:40:12.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.397+0000 7fc755eb3700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7500a6850 con 0x7fc7500715c0 2023-01-01T17:40:12.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.397+0000 7fc755eb3700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7500bdac0 con 0x7fc7500a5270 2023-01-01T17:40:12.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.396+0000 7fb12caaf700 1 -- start start 2023-01-01T17:40:12.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.397+0000 7fb12caaf700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1280c2b10 0x7fb12806fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.397+0000 7fb12caaf700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb12814c640 0x7fb1281f89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.397+0000 7fb12caaf700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb12814fa20 0x7fb1280a9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.397+0000 7fb12caaf700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1280bb4a0 con 0x7fb12814fa20 2023-01-01T17:40:12.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.397+0000 7fb12caaf700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1281f7f60 con 0x7fb1280c2b10 2023-01-01T17:40:12.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.397+0000 7fb12caaf700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1280aa440 con 0x7fb12814c640 2023-01-01T17:40:12.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.397+0000 7fcdd6d9d700 1 --2- 172.21.15.61:0/4254511783 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcdc0004fe0 0x7fcdc0010020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.397+0000 7fc74ffff700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc7500a5270 0x7fc75014ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.397+0000 7fc74ffff700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc7500a5270 0x7fc75014ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.61:44826/0 (socket says 172.21.15.61:44826) 2023-01-01T17:40:12.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.397+0000 7fc74ffff700 1 -- 172.21.15.61:0/1531657974 learned_addr learned my addr 172.21.15.61:0/1531657974 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:12.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.397+0000 7fb125d9b700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb12814c640 0x7fb1281f89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.397+0000 7fb126d9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb12814fa20 0x7fb1280a9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.397+0000 7fb125d9b700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb12814c640 0x7fb1281f89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.61:44830/0 (socket says 172.21.15.61:44830) 2023-01-01T17:40:12.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.397+0000 7fb125d9b700 1 -- 172.21.15.61:0/2082694915 learned_addr learned my addr 172.21.15.61:0/2082694915 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:12.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.397+0000 7fb12659c700 1 --2- 172.21.15.61:0/2082694915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1280c2b10 0x7fb12806fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.397+0000 7fc74f7fe700 1 --2- 172.21.15.61:0/1531657974 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc750070810 0x7fc7500be8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.397+0000 7fcdd6d9d700 1 -- 172.21.15.61:0/4254511783 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcdc0004350 msgr2=0x7fcdc0004850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:40:12.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.397+0000 7fcdd6d9d700 1 --2- 172.21.15.61:0/4254511783 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcdc0004350 0x7fcdc0004850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.397+0000 7fcdd6d9d700 1 -- 172.21.15.61:0/4254511783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcdc0003a00 msgr2=0x7fcdc0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:12.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.397+0000 7fcdd6d9d700 1 --2- 172.21.15.61:0/4254511783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcdc0003a00 0x7fcdc0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.397+0000 7fcdd6d9d700 1 -- 172.21.15.61:0/4254511783 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd80c2f80 con 0x7fcdc0004fe0 2023-01-01T17:40:12.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.398+0000 7fcdd6d9d700 1 --2- 172.21.15.61:0/4254511783 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcdc0004fe0 0x7fcdc0010020 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8009880 tx=0x7fcdc0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51cc6de6415612a2 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.398+0000 7fc74ffff700 1 -- 172.21.15.61:0/1531657974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7500715c0 msgr2=0x7fc75014a6f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-01-01T17:40:12.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.398+0000 7fc74ffff700 1 --2- 172.21.15.61:0/1531657974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7500715c0 0x7fc75014a6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.398+0000 7fc74ffff700 1 -- 172.21.15.61:0/1531657974 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc750070810 msgr2=0x7fc7500be8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.398+0000 7fc74ffff700 1 --2- 172.21.15.61:0/1531657974 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc750070810 0x7fc7500be8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.398+0000 7fc74ffff700 1 -- 172.21.15.61:0/1531657974 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc744009550 con 0x7fc7500a5270 2023-01-01T17:40:12.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.398+0000 7fb126d9d700 1 -- 172.21.15.61:0/2082694915 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb12814c640 msgr2=0x7fb1281f89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.398+0000 7fb126d9d700 1 --2- 172.21.15.61:0/2082694915 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb12814c640 0x7fb1281f89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.398+0000 7fb126d9d700 1 -- 172.21.15.61:0/2082694915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1280c2b10 msgr2=0x7fb12806fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.398+0000 7fb126d9d700 1 --2- 172.21.15.61:0/2082694915 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1280c2b10 0x7fb12806fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.398+0000 7fb126d9d700 1 -- 172.21.15.61:0/2082694915 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb120009a70 con 0x7fb12814fa20 2023-01-01T17:40:12.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.398+0000 7fb126d9d700 1 --2- 172.21.15.61:0/2082694915 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb12814fa20 0x7fb1280a9f00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb12806c2f0 tx=0x7fb120004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.398+0000 7fc74ffff700 1 --2- 172.21.15.61:0/1531657974 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc7500a5270 0x7fc75014ac30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc7500c6af0 tx=0x7fc744004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.398+0000 7fc737fff700 1 -- 172.21.15.61:0/1531657974 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74400fab0 con 0x7fc7500a5270 2023-01-01T17:40:12.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.398+0000 7fc737fff700 1 -- 172.21.15.61:0/1531657974 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7440045e0 con 0x7fc7500a5270 2023-01-01T17:40:12.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.398+0000 7fc737fff700 1 -- 172.21.15.61:0/1531657974 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74400fe30 con 0x7fc7500a5270 2023-01-01T17:40:12.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.398+0000 7fcc370bd700 1 -- start start 2023-01-01T17:40:12.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.399+0000 7fcc370bd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc180074f0 0x7fcc30149250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.399+0000 7fcc370bd700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc30139d20 0x7fcc3013a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.399+0000 7fcc370bd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc30141c60 0x7fcc301420d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.399+0000 7fcc370bd700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3014d780 con 0x7fcc180074f0 2023-01-01T17:40:12.419 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.399+0000 7fcc370bd700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3013a6d0 con 0x7fcc30141c60 2023-01-01T17:40:12.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.399+0000 7fcc370bd700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc301e4720 con 0x7fcc30139d20 2023-01-01T17:40:12.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.399+0000 7fcc34e59700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc180074f0 0x7fcc30149250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.399+0000 7fcc34e59700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc180074f0 0x7fcc30149250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46596/0 (socket says 172.21.15.61:46596) 2023-01-01T17:40:12.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.399+0000 7fcc34e59700 1 -- 172.21.15.61:0/33551629 learned_addr learned my addr 172.21.15.61:0/33551629 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:12.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.399+0000 7fcc3565a700 1 --2- 172.21.15.61:0/33551629 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc30141c60 0x7fcc301420d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.399+0000 7fc755eb3700 1 -- 172.21.15.61:0/1531657974 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7500c3e40 con 0x7fc7500a5270 2023-01-01T17:40:12.420 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.399+0000 7fc755eb3700 1 -- 172.21.15.61:0/1531657974 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7500a4ec0 con 0x7fc7500a5270 2023-01-01T17:40:12.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.399+0000 7fcc34e59700 1 -- 172.21.15.61:0/33551629 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc30139d20 msgr2=0x7fcc3013a190 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-01-01T17:40:12.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.399+0000 7fcc34e59700 1 --2- 172.21.15.61:0/33551629 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcc30139d20 0x7fcc3013a190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.399+0000 7fcc34e59700 1 -- 172.21.15.61:0/33551629 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc30141c60 msgr2=0x7fcc301420d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.399+0000 7fcc34e59700 1 --2- 172.21.15.61:0/33551629 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc30141c60 0x7fcc301420d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.399+0000 7fcc34e59700 1 -- 172.21.15.61:0/33551629 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc300bbb40 con 0x7fcc180074f0 2023-01-01T17:40:12.421 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.400+0000 7fcc3565a700 1 --2- 172.21.15.61:0/33551629 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc30141c60 0x7fcc301420d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-01T17:40:12.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.400+0000 7fcdd559a700 1 -- 172.21.15.61:0/4254511783 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc800c070 con 0x7fcdc0004fe0 2023-01-01T17:40:12.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.400+0000 7fcdd559a700 1 -- 172.21.15.61:0/4254511783 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc8013610 con 0x7fcdc0004fe0 2023-01-01T17:40:12.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.400+0000 7fcdd559a700 1 -- 172.21.15.61:0/4254511783 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc80139c0 con 0x7fcdc0004fe0 2023-01-01T17:40:12.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.400+0000 7fb116ffd700 1 -- 172.21.15.61:0/2082694915 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb120012430 con 0x7fb12814fa20 2023-01-01T17:40:12.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.400+0000 7fb116ffd700 1 -- 172.21.15.61:0/2082694915 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb120004450 con 0x7fb12814fa20 2023-01-01T17:40:12.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.400+0000 7fb116ffd700 1 -- 172.21.15.61:0/2082694915 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb120004800 con 0x7fb12814fa20 2023-01-01T17:40:12.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.400+0000 7fb12caaf700 1 -- 172.21.15.61:0/2082694915 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1280c3200 con 0x7fb12814fa20 2023-01-01T17:40:12.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.400+0000 7fb12caaf700 1 -- 172.21.15.61:0/2082694915 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1280bf9a0 con 0x7fb12814fa20 2023-01-01T17:40:12.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.401+0000 7fcc34e59700 1 --2- 172.21.15.61:0/33551629 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc180074f0 0x7fcc30149250 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcc2400e7e0 tx=0x7fcc2400eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.401+0000 7fcddc8cd700 1 -- 172.21.15.61:0/4254511783 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcdc0004fe0 msgr2=0x7fcdc0010020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.401+0000 7fcddc8cd700 1 --2- 172.21.15.61:0/4254511783 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcdc0004fe0 0x7fcdc0010020 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8009880 tx=0x7fcdc0005880 comp rx=0 tx=0).stop 2023-01-01T17:40:12.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.401+0000 7fcdd6d9d700 1 -- 172.21.15.61:0/4254511783 reap_dead start 2023-01-01T17:40:12.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.401+0000 7fb12caaf700 1 -- 172.21.15.61:0/2082694915 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb1280c1d30 con 0x7fb12814fa20 2023-01-01T17:40:12.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.401+0000 7fae66c48700 1 Processor -- start 2023-01-01T17:40:12.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.401+0000 7fcc2d7fa700 1 -- 172.21.15.61:0/33551629 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc24004230 con 0x7fcc180074f0 2023-01-01T17:40:12.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.401+0000 7fcc2d7fa700 1 -- 172.21.15.61:0/33551629 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc24004390 con 0x7fcc180074f0 2023-01-01T17:40:12.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.402+0000 7fcc2d7fa700 1 -- 172.21.15.61:0/33551629 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc240036a0 con 0x7fcc180074f0 2023-01-01T17:40:12.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.401+0000 7fae66c48700 1 -- start start 2023-01-01T17:40:12.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.402+0000 7fcc370bd700 1 -- 172.21.15.61:0/33551629 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc300bb860 con 0x7fcc180074f0 2023-01-01T17:40:12.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.402+0000 7fcc370bd700 1 -- 172.21.15.61:0/33551629 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc3006d430 con 0x7fcc180074f0 2023-01-01T17:40:12.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.402+0000 7fc755eb3700 1 -- 172.21.15.61:0/1531657974 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc750070be0 con 0x7fc7500a5270 2023-01-01T17:40:12.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.402+0000 7fc737fff700 1 -- 172.21.15.61:0/1531657974 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7fc744028030 con 0x7fc7500a5270 2023-01-01T17:40:12.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.403+0000 7fc737fff700 1 --2- 172.21.15.61:0/1531657974 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fc73c063290 0x7fc73c065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.402+0000 7fb116ffd700 1 -- 172.21.15.61:0/2082694915 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7fb120026410 con 0x7fb12814fa20 2023-01-01T17:40:12.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.402+0000 7fb116ffd700 1 --2- 172.21.15.61:0/2082694915 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fb1080632b0 0x7fb108065760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.403+0000 7fb116ffd700 1 -- 172.21.15.61:0/2082694915 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb120082370 con 0x7fb12814fa20 2023-01-01T17:40:12.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.403+0000 7fc737fff700 1 -- 172.21.15.61:0/1531657974 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc7440852e0 con 0x7fc7500a5270 2023-01-01T17:40:12.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.403+0000 7fae66c48700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae600a5270 0x7fae6006fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.403+0000 7fae66c48700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fae600c06b0 0x7fae600c2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.403+0000 7fae66c48700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae60150ad0 con 0x7fae600715c0 2023-01-01T17:40:12.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.403+0000 7fae66c48700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae600c3c30 con 0x7fae600c06b0 2023-01-01T17:40:12.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.403+0000 7fae66c48700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae600c4120 con 0x7fae600a5270 2023-01-01T17:40:12.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.402+0000 7fcddc8cd700 1 -- 172.21.15.61:0/4254511783 shutdown_connections 2023-01-01T17:40:12.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.402+0000 7fcddc8cd700 1 -- 172.21.15.61:0/4254511783 >> 172.21.15.61:0/4254511783 conn(0x7fcdd806b100 msgr2=0x7fcdd80c5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:12.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.403+0000 7fc737fff700 1 --2- 172.21.15.61:0/1531657974 >> [v2:172.21.15.61:6824/94349,v1:172.21.15.61:6825/94349] conn(0x7fc73c06d000 0x7fc73c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.403+0000 7fc737fff700 1 -- 172.21.15.61:0/1531657974 --> [v2:172.21.15.61:6824/94349,v1:172.21.15.61:6825/94349] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc73c06fb00 con 0x7fc73c06d000 2023-01-01T17:40:12.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.403+0000 7fc737fff700 1 -- 172.21.15.61:0/1531657974 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc744053fb0 con 0x7fc7500a5270 2023-01-01T17:40:12.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.403+0000 7fae5ffff700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae600a5270 0x7fae6006fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.403+0000 7fb116ffd700 1 --2- 172.21.15.61:0/2082694915 >> [v2:172.21.15.149:6808/94709,v1:172.21.15.149:6809/94709] conn(0x7fb10806d020 0x7fb10806f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.403+0000 7fb116ffd700 1 -- 172.21.15.61:0/2082694915 --> [v2:172.21.15.149:6808/94709,v1:172.21.15.149:6809/94709] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb10806fb20 con 0x7fb10806d020 2023-01-01T17:40:12.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.403+0000 7fae5ffff700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae600a5270 0x7fae6006fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.61:44846/0 (socket says 172.21.15.61:44846) 2023-01-01T17:40:12.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.403+0000 7fae5ffff700 1 -- 172.21.15.61:0/4251102714 learned_addr learned my addr 172.21.15.61:0/4251102714 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:12.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.403+0000 7fb125d9b700 1 --2- 172.21.15.61:0/2082694915 >> [v2:172.21.15.149:6808/94709,v1:172.21.15.149:6809/94709] conn(0x7fb10806d020 0x7fb10806f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.403+0000 7fae651e5700 1 --2- 172.21.15.61:0/4251102714 >> v2:172.21.15.149:3300/0 conn(0x7fae600c06b0 0x7fae600c2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.403+0000 7fcddc8cd700 1 -- 172.21.15.61:0/4254511783 shutdown_connections 2023-01-01T17:40:12.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.403+0000 7fcddc8cd700 1 -- 172.21.15.61:0/4254511783 wait complete. 2023-01-01T17:40:12.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.403+0000 7fae5ffff700 1 -- 172.21.15.61:0/4251102714 >> v2:172.21.15.149:3300/0 conn(0x7fae600c06b0 msgr2=0x7fae600c2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:12.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.403+0000 7fae5ffff700 1 --2- 172.21.15.61:0/4251102714 >> v2:172.21.15.149:3300/0 conn(0x7fae600c06b0 0x7fae600c2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.403+0000 7fae5ffff700 1 -- 172.21.15.61:0/4251102714 >> v1:172.21.15.61:6789/0 conn(0x7fae600715c0 legacy=0x7fae60070810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:12.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.403+0000 7fae5ffff700 1 -- 172.21.15.61:0/4251102714 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae600c2f80 con 0x7fae600a5270 2023-01-01T17:40:12.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.402+0000 7fb0b6a62700 1 Processor -- start 2023-01-01T17:40:12.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.402+0000 7fb0b6a62700 1 -- start start 2023-01-01T17:40:12.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.404+0000 7fb0b6a62700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb0b00a3f90 0x7fb0b00b7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.404+0000 7fb12659c700 1 --2- 172.21.15.61:0/2082694915 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fb1080632b0 0x7fb108065760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.404+0000 7fb0b6a62700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fb0b00bf590 0x7fb0b00c1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.404+0000 7fb0b6a62700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0b00c1b60 0x7fb0b006ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.404+0000 7fb0b6a62700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b006c5b0 con 0x7fb0b00bf590 2023-01-01T17:40:12.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.404+0000 7fb0b6a62700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b00c4a90 con 0x7fb0b00a3f90 2023-01-01T17:40:12.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.404+0000 7fb0b6a62700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b00c0e50 con 0x7fb0b00c1b60 2023-01-01T17:40:12.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.404+0000 7fc74f7fe700 1 --2- 172.21.15.61:0/1531657974 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fc73c063290 0x7fc73c065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.404+0000 7fae5ffff700 1 --2- 172.21.15.61:0/4251102714 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae600a5270 0x7fae6006fad0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fae500098f0 tx=0x7fae50009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ed3cc3d6abe3c34 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.404+0000 7fb125d9b700 1 --2- 172.21.15.61:0/2082694915 >> [v2:172.21.15.149:6808/94709,v1:172.21.15.149:6809/94709] conn(0x7fb10806d020 0x7fb10806f450 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.404+0000 7fb0b4fff700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0b00c1b60 0x7fb0b006ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.404+0000 7fb0b4fff700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0b00c1b60 0x7fb0b006ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.61:44858/0 (socket says 172.21.15.61:44858) 2023-01-01T17:40:12.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.404+0000 7fb0b4fff700 1 -- 172.21.15.61:0/1032698678 learned_addr learned my addr 172.21.15.61:0/1032698678 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:12.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.404+0000 7fc74effd700 1 --2- 172.21.15.61:0/1531657974 >> [v2:172.21.15.61:6824/94349,v1:172.21.15.61:6825/94349] conn(0x7fc73c06d000 0x7fc73c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.404+0000 7fb0affff700 1 --2- 172.21.15.61:0/1032698678 >> v2:172.21.15.149:3300/0 conn(0x7fb0b00a3f90 0x7fb0b00b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.404+0000 7fb12659c700 1 --2- 172.21.15.61:0/2082694915 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fb1080632b0 0x7fb108065760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb11c0011e0 tx=0x7fb11c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.405+0000 7fc74f7fe700 1 --2- 172.21.15.61:0/1531657974 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fc73c063290 0x7fc73c065740 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc74800a510 tx=0x7fc74800d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.405+0000 7fc74effd700 1 --2- 172.21.15.61:0/1531657974 >> [v2:172.21.15.61:6824/94349,v1:172.21.15.61:6825/94349] conn(0x7fc73c06d000 0x7fc73c06f430 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.406+0000 7fc737fff700 1 -- 172.21.15.61:0/1531657974 <== osd.0 v2:172.21.15.61:6824/94349 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24745 (crc 0 0 0) 0x7fc73c06fb00 con 0x7fc73c06d000 2023-01-01T17:40:12.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.405+0000 7fcddc8cd700 1 Processor -- start 2023-01-01T17:40:12.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.405+0000 7fcc2d7fa700 1 -- 172.21.15.61:0/33551629 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7fcc24003820 con 0x7fcc180074f0 2023-01-01T17:40:12.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.405+0000 7fcc2d7fa700 1 --2- 172.21.15.61:0/33551629 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fcc1c0632e0 0x7fcc1c065790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.406+0000 7fcc2d7fa700 1 -- 172.21.15.61:0/33551629 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcc2407fa60 con 0x7fcc180074f0 2023-01-01T17:40:12.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.406+0000 7fcc2ffff700 1 --2- 172.21.15.61:0/33551629 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fcc1c0632e0 0x7fcc1c065790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.405+0000 7fb116ffd700 1 -- 172.21.15.61:0/2082694915 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb120004960 con 0x7fb12814fa20 2023-01-01T17:40:12.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.406+0000 7fcc370bd700 1 --2- 172.21.15.61:0/33551629 >> [v2:172.21.15.61:6808/94350,v1:172.21.15.61:6809/94350] conn(0x7fcc30142610 0x7fcc3014f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.406+0000 7fcc370bd700 1 -- 172.21.15.61:0/33551629 --> [v2:172.21.15.61:6808/94350,v1:172.21.15.61:6809/94350] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcc300ba550 con 0x7fcc30142610 2023-01-01T17:40:12.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.406+0000 7fcc3565a700 1 --2- 172.21.15.61:0/33551629 >> [v2:172.21.15.61:6808/94350,v1:172.21.15.61:6809/94350] conn(0x7fcc30142610 0x7fcc3014f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.406+0000 7fcc2ffff700 1 --2- 172.21.15.61:0/33551629 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fcc1c0632e0 0x7fcc1c065790 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcc30142f70 tx=0x7fcc2000f040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.406+0000 7fcc3565a700 1 --2- 172.21.15.61:0/33551629 >> [v2:172.21.15.61:6808/94350,v1:172.21.15.61:6809/94350] conn(0x7fcc30142610 0x7fcc3014f360 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.405+0000 7fb0affff700 1 -- 172.21.15.61:0/1032698678 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0b00c1b60 msgr2=0x7fb0b006ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:12.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.405+0000 7fb0affff700 1 --2- 172.21.15.61:0/1032698678 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0b00c1b60 0x7fb0b006ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.405+0000 7fb0affff700 1 -- 172.21.15.61:0/1032698678 >> v2:172.21.15.61:3300/0 conn(0x7fb0b00bf590 msgr2=0x7fb0b00c1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:12.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.405+0000 7fb0affff700 1 --2- 172.21.15.61:0/1032698678 >> v2:172.21.15.61:3300/0 conn(0x7fb0b00bf590 0x7fb0b00c1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.405+0000 7fb0affff700 1 -- 172.21.15.61:0/1032698678 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b00b8160 con 0x7fb0b00a3f90 2023-01-01T17:40:12.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.405+0000 7fb0affff700 1 --2- 172.21.15.61:0/1032698678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0b00a3f90 0x7fb0b00b7910 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb0b00c2130 tx=0x7fb0a0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69eb3e0ffec3d584 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.407+0000 7fae5f7fe700 1 -- 172.21.15.61:0/4251102714 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae50004230 con 0x7fae600a5270 2023-01-01T17:40:12.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.407+0000 7fae5f7fe700 1 -- 172.21.15.61:0/4251102714 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae50004390 con 0x7fae600a5270 2023-01-01T17:40:12.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.407+0000 7fae5f7fe700 1 -- 172.21.15.61:0/4251102714 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae500036a0 con 0x7fae600a5270 2023-01-01T17:40:12.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.408+0000 7fcc2d7fa700 1 -- 172.21.15.61:0/33551629 <== osd.2 v2:172.21.15.61:6808/94350 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24745 (crc 0 0 0) 0x7fcc300ba550 con 0x7fcc30142610 2023-01-01T17:40:12.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.406+0000 7fcddc8cd700 1 -- start start 2023-01-01T17:40:12.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.407+0000 7fcddc8cd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcdc0004fe0 0x7fcdd80ba550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.407+0000 7fcddc8cd700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcdd814a2d0 0x7fcdd80b88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.407+0000 7fcddc8cd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcdd80b8df0 0x7fcdd81e4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.407+0000 7fcddc8cd700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd80a7930 con 0x7fcdd80b8df0 2023-01-01T17:40:12.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.407+0000 7fcddc8cd700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd80b9a70 con 0x7fcdc0004fe0 2023-01-01T17:40:12.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.407+0000 7fcddc8cd700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd80b9d50 con 0x7fcdd814a2d0 2023-01-01T17:40:12.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.407+0000 7fcdd6d9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcdd80b8df0 0x7fcdd81e4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.407+0000 7fcdd6d9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcdd80b8df0 0x7fcdd81e4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46626/0 (socket says 172.21.15.61:46626) 2023-01-01T17:40:12.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.407+0000 7fcdd6d9d700 1 -- 172.21.15.61:0/664569586 learned_addr learned my addr 172.21.15.61:0/664569586 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:12.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.407+0000 7fcdd6d9d700 1 -- 172.21.15.61:0/664569586 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcdd814a2d0 msgr2=0x7fcdd80b88b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-01-01T17:40:12.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.407+0000 7fcdd6d9d700 1 --2- 172.21.15.61:0/664569586 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcdd814a2d0 0x7fcdd80b88b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.407+0000 7fcdd6d9d700 1 -- 172.21.15.61:0/664569586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcdc0004fe0 msgr2=0x7fcdd80ba550 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-01-01T17:40:12.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.407+0000 7fcdd6d9d700 1 --2- 172.21.15.61:0/664569586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcdc0004fe0 0x7fcdd80ba550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.407+0000 7fcdd6d9d700 1 -- 172.21.15.61:0/664569586 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd80c3e40 con 0x7fcdd80b8df0 2023-01-01T17:40:12.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.407+0000 7fcdd6d9d700 1 --2- 172.21.15.61:0/664569586 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcdd80b8df0 0x7fcdd81e4700 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8016040 tx=0x7fcdc80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.408+0000 7fcdc6ffd700 1 -- 172.21.15.61:0/664569586 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc8013410 con 0x7fcdd80b8df0 2023-01-01T17:40:12.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.408+0000 7fcdc6ffd700 1 -- 172.21.15.61:0/664569586 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc801c630 con 0x7fcdd80b8df0 2023-01-01T17:40:12.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.408+0000 7fcddc8cd700 1 -- 172.21.15.61:0/664569586 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdd80a4ec0 con 0x7fcdd80b8df0 2023-01-01T17:40:12.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.408+0000 7fcdc6ffd700 1 -- 172.21.15.61:0/664569586 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc801c9e0 con 0x7fcdd80b8df0 2023-01-01T17:40:12.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.408+0000 7fcddc8cd700 1 -- 172.21.15.61:0/664569586 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd8070be0 con 0x7fcdd80b8df0 2023-01-01T17:40:12.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.408+0000 7fae66c48700 1 -- 172.21.15.61:0/4251102714 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae600a5270 msgr2=0x7fae6006fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.408+0000 7fae66c48700 1 --2- 172.21.15.61:0/4251102714 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae600a5270 0x7fae6006fad0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fae500098f0 tx=0x7fae50009c00 comp rx=0 tx=0).stop 2023-01-01T17:40:12.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.408+0000 7fb116ffd700 1 -- 172.21.15.61:0/2082694915 <== osd.5 v2:172.21.15.149:6808/94709 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24745 (crc 0 0 0) 0x7fb10806fb20 con 0x7fb10806d020 2023-01-01T17:40:12.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.409+0000 7fcddc8cd700 1 -- 172.21.15.61:0/664569586 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcdd80668a0 con 0x7fcdd80b8df0 2023-01-01T17:40:12.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.410+0000 7fcdc6ffd700 1 -- 172.21.15.61:0/664569586 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7fcdc801cb40 con 0x7fcdd80b8df0 2023-01-01T17:40:12.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.410+0000 7fcdc6ffd700 1 --2- 172.21.15.61:0/664569586 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fcdb80852a0 0x7fcdb8087750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.410+0000 7fcdc6ffd700 1 -- 172.21.15.61:0/664569586 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcdc8000e40 con 0x7fcdd80b8df0 2023-01-01T17:40:12.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.410+0000 7fcdc6ffd700 1 --2- 172.21.15.61:0/664569586 >> [v2:172.21.15.61:6811/94348,v1:172.21.15.61:6813/94348] conn(0x7fcdb808f010 0x7fcdb8091440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.410+0000 7fcdc6ffd700 1 -- 172.21.15.61:0/664569586 --> [v2:172.21.15.61:6811/94348,v1:172.21.15.61:6813/94348] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcdb8091b10 con 0x7fcdb808f010 2023-01-01T17:40:12.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.410+0000 7fcdc6ffd700 1 -- 172.21.15.61:0/664569586 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcdc8082a20 con 0x7fcdd80b8df0 2023-01-01T17:40:12.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.411+0000 7fcdd5d9b700 1 --2- 172.21.15.61:0/664569586 >> [v2:172.21.15.61:6811/94348,v1:172.21.15.61:6813/94348] conn(0x7fcdb808f010 0x7fcdb8091440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.411+0000 7fcdd5d9b700 1 --2- 172.21.15.61:0/664569586 >> [v2:172.21.15.61:6811/94348,v1:172.21.15.61:6813/94348] conn(0x7fcdb808f010 0x7fcdb8091440 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.412+0000 7fcdc6ffd700 1 -- 172.21.15.61:0/664569586 <== osd.1 v2:172.21.15.61:6811/94348 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24745 (crc 0 0 0) 0x7fcdb8091b10 con 0x7fcdb808f010 2023-01-01T17:40:12.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.419+0000 7fcdd659c700 1 --2- 172.21.15.61:0/664569586 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fcdb80852a0 0x7fcdb8087750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.419+0000 7fcdd659c700 1 --2- 172.21.15.61:0/664569586 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fcdb80852a0 0x7fcdb8087750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc0017a0 tx=0x7fcdcc001430 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.417+0000 7fb0aeffd700 1 -- 172.21.15.61:0/1032698678 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0011830 con 0x7fb0b00a3f90 2023-01-01T17:40:12.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.417+0000 7fb0aeffd700 1 -- 172.21.15.61:0/1032698678 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a0011990 con 0x7fb0b00a3f90 2023-01-01T17:40:12.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.417+0000 7fb0aeffd700 1 -- 172.21.15.61:0/1032698678 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0011d00 con 0x7fb0b00a3f90 2023-01-01T17:40:12.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.418+0000 7fb0b6a62700 1 -- 172.21.15.61:0/1032698678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0b00a3f90 msgr2=0x7fb0b00b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.418+0000 7fb0b6a62700 1 --2- 172.21.15.61:0/1032698678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0b00a3f90 0x7fb0b00b7910 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb0b00c2130 tx=0x7fb0a0009b50 comp rx=0 tx=0).stop 2023-01-01T17:40:12.446 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.419+0000 7fb0b6a62700 1 -- 172.21.15.61:0/1032698678 shutdown_connections 2023-01-01T17:40:12.446 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.419+0000 7fb0b6a62700 1 --2- 172.21.15.61:0/1032698678 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0b00c1b60 0x7fb0b006ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.446 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.419+0000 7fb0b6a62700 1 --2- 172.21.15.61:0/1032698678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0b00a3f90 0x7fb0b00b7910 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.446 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.419+0000 7fb0b6a62700 1 --2- 172.21.15.61:0/1032698678 >> v2:172.21.15.61:3300/0 conn(0x7fb0b00bf590 0x7fb0b00c1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.446 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.419+0000 7fb0b6a62700 1 -- 172.21.15.61:0/1032698678 >> 172.21.15.61:0/1032698678 conn(0x7fb0b0069fb0 msgr2=0x7fb0b00a6740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:12.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.421+0000 7fc2c8d14700 1 Processor -- start 2023-01-01T17:40:12.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.421+0000 7fc2c8d14700 1 -- start start 2023-01-01T17:40:12.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.423+0000 7fc2c8d14700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fc2c414c810 0x7fc2c406a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.423+0000 7fc2c8d14700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc2c406fc40 0x7fc2c4159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.423+0000 7fc2c8d14700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2c406db90 con 0x7fc2c40714b0 2023-01-01T17:40:12.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.423+0000 7fc2c8d14700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2c406d7a0 con 0x7fc2c414c810 2023-01-01T17:40:12.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.423+0000 7fc2c8d14700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2c40bc3e0 con 0x7fc2c406fc40 2023-01-01T17:40:12.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.423+0000 7fae66c48700 1 -- 172.21.15.61:0/4251102714 shutdown_connections 2023-01-01T17:40:12.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.423+0000 7fae66c48700 1 --2- 172.21.15.61:0/4251102714 >> v2:172.21.15.149:3300/0 conn(0x7fae600c06b0 0x7fae600c2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.423+0000 7fae66c48700 1 --2- 172.21.15.61:0/4251102714 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae600a5270 0x7fae6006fad0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.423+0000 7fae66c48700 1 -- 172.21.15.61:0/4251102714 >> 172.21.15.61:0/4251102714 conn(0x7fae6006b100 msgr2=0x7fae600c5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:12.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.423+0000 7fc2c259c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fc2c414c810 0x7fc2c406a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.423+0000 7fc2c259c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fc2c414c810 0x7fc2c406a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46632/0 (socket says 172.21.15.61:46632) 2023-01-01T17:40:12.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.423+0000 7fc2c259c700 1 -- 172.21.15.61:0/365511649 learned_addr learned my addr 172.21.15.61:0/365511649 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:12.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.423+0000 7fb0b6a62700 1 -- 172.21.15.61:0/1032698678 shutdown_connections 2023-01-01T17:40:12.449 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.423+0000 7fb0b6a62700 1 -- 172.21.15.61:0/1032698678 wait complete. 2023-01-01T17:40:12.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.423+0000 7fc2c2d9d700 1 --2- 172.21.15.61:0/365511649 >> v2:172.21.15.149:3300/0 conn(0x7fc2c406fc40 0x7fc2c4159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.423+0000 7fc2c259c700 1 -- 172.21.15.61:0/365511649 >> v2:172.21.15.149:3300/0 conn(0x7fc2c406fc40 msgr2=0x7fc2c4159bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:12.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.423+0000 7fc2c259c700 1 --2- 172.21.15.61:0/365511649 >> v2:172.21.15.149:3300/0 conn(0x7fc2c406fc40 0x7fc2c4159bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.423+0000 7fc2c259c700 1 -- 172.21.15.61:0/365511649 >> v1:172.21.15.149:6789/0 conn(0x7fc2c40714b0 legacy=0x7fc2c41528a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:12.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.423+0000 7fc2c259c700 1 -- 172.21.15.61:0/365511649 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c40bc100 con 0x7fc2c414c810 2023-01-01T17:40:12.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.424+0000 7fc2c259c700 1 --2- 172.21.15.61:0/365511649 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc2c414c810 0x7fc2c406a370 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac00bbc0 tx=0x7fc2ac00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79b212be4d12aba4 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.424+0000 7fc2c159a700 1 -- 172.21.15.61:0/365511649 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac00de10 con 0x7fc2c414c810 2023-01-01T17:40:12.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.424+0000 7fc2c159a700 1 -- 172.21.15.61:0/365511649 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ac004030 con 0x7fc2c414c810 2023-01-01T17:40:12.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.424+0000 7fc2c159a700 1 -- 172.21.15.61:0/365511649 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac0043e0 con 0x7fc2c414c810 2023-01-01T17:40:12.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.425+0000 7fb0b6a62700 1 Processor -- start 2023-01-01T17:40:12.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.425+0000 7fc2c8d14700 1 -- 172.21.15.61:0/365511649 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc2c414c810 msgr2=0x7fc2c406a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.425+0000 7fc2c8d14700 1 --2- 172.21.15.61:0/365511649 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc2c414c810 0x7fc2c406a370 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac00bbc0 tx=0x7fc2ac00bed0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.425+0000 7fb0b6a62700 1 -- start start 2023-01-01T17:40:12.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.425+0000 7fc2c8d14700 1 -- 172.21.15.61:0/365511649 shutdown_connections 2023-01-01T17:40:12.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.425+0000 7fc2c8d14700 1 --2- 172.21.15.61:0/365511649 >> v2:172.21.15.149:3300/0 conn(0x7fc2c406fc40 0x7fc2c4159bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.425+0000 7fc2c8d14700 1 --2- 172.21.15.61:0/365511649 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc2c414c810 0x7fc2c406a370 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.425+0000 7fc2c8d14700 1 -- 172.21.15.61:0/365511649 >> 172.21.15.61:0/365511649 conn(0x7fc2c40c1f30 msgr2=0x7fc2c40c2330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:12.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.426+0000 7fb0b6a62700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb0b00a3f90 0x7fb0b006f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.426+0000 7fb0b6a62700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0b00bf590 0x7fb0b006fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.426+0000 7fb0b6a62700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0b00c1b60 0x7fb0b014e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.426+0000 7fb0b6a62700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b00717b0 con 0x7fb0b00a3f90 2023-01-01T17:40:12.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.426+0000 7fb0b6a62700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b0070b70 con 0x7fb0b00bf590 2023-01-01T17:40:12.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.426+0000 7fb0b6a62700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b0070e50 con 0x7fb0b00c1b60 2023-01-01T17:40:12.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.426+0000 7fb0affff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb0b00a3f90 0x7fb0b006f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.426+0000 7fb0affff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb0b00a3f90 0x7fb0b006f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46638/0 (socket says 172.21.15.61:46638) 2023-01-01T17:40:12.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.426+0000 7fb0affff700 1 -- 172.21.15.61:0/2348108258 learned_addr learned my addr 172.21.15.61:0/2348108258 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:12.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.426+0000 7fb0af7fe700 1 --2- 172.21.15.61:0/2348108258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0b00bf590 0x7fb0b006fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.426+0000 7fb0affff700 1 -- 172.21.15.61:0/2348108258 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0b00c1b60 msgr2=0x7fb0b014e3f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-01-01T17:40:12.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.426+0000 7fb0affff700 1 --2- 172.21.15.61:0/2348108258 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fb0b00c1b60 0x7fb0b014e3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.426+0000 7fb0affff700 1 -- 172.21.15.61:0/2348108258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0b00bf590 msgr2=0x7fb0b006fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.426+0000 7fb0affff700 1 --2- 172.21.15.61:0/2348108258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0b00bf590 0x7fb0b006fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.426+0000 7fb0affff700 1 -- 172.21.15.61:0/2348108258 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a00094a0 con 0x7fb0b00a3f90 2023-01-01T17:40:12.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.427+0000 7fc2c8d14700 1 -- 172.21.15.61:0/365511649 shutdown_connections 2023-01-01T17:40:12.455 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.427+0000 7fc2c8d14700 1 -- 172.21.15.61:0/365511649 wait complete. 2023-01-01T17:40:12.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.427+0000 7fb0affff700 1 --2- 172.21.15.61:0/2348108258 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb0b00a3f90 0x7fb0b006f870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0014040 tx=0x7fb0a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.427+0000 7fb0acff9700 1 -- 172.21.15.61:0/2348108258 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0004590 con 0x7fb0b00a3f90 2023-01-01T17:40:12.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.427+0000 7fb0acff9700 1 -- 172.21.15.61:0/2348108258 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a001e070 con 0x7fb0b00a3f90 2023-01-01T17:40:12.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.427+0000 7fb0acff9700 1 -- 172.21.15.61:0/2348108258 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a00038e0 con 0x7fb0b00a3f90 2023-01-01T17:40:12.456 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.428+0000 7fb0b6a62700 1 -- 172.21.15.61:0/2348108258 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b0158010 con 0x7fb0b00a3f90 2023-01-01T17:40:12.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.428+0000 7fb0b6a62700 1 -- 172.21.15.61:0/2348108258 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b00c1080 con 0x7fb0b00a3f90 2023-01-01T17:40:12.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.429+0000 7fc2c8d14700 1 Processor -- start 2023-01-01T17:40:12.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.430+0000 7fb0acff9700 1 -- 172.21.15.61:0/2348108258 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7fb0a000f050 con 0x7fb0b00a3f90 2023-01-01T17:40:12.457 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.430+0000 7fb0acff9700 1 --2- 172.21.15.61:0/2348108258 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fb09c063290 0x7fb09c065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.430+0000 7fb0acff9700 1 -- 172.21.15.61:0/2348108258 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb0a0020070 con 0x7fb0b00a3f90 2023-01-01T17:40:12.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.429+0000 7fc2c8d14700 1 -- start start 2023-01-01T17:40:12.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.430+0000 7fc2c8d14700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc2c406fc40 0x7fc2c414b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.430+0000 7fc2c8d14700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2c40714b0 0x7fc2c40c4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.459 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.430+0000 7fc2c8d14700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc2c414c810 0x7fc2c40c4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.459 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.430+0000 7fc2c8d14700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c41495f0 con 0x7fc2c414c810 2023-01-01T17:40:12.459 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.430+0000 7fc2c8d14700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c4149df0 con 0x7fc2c40714b0 2023-01-01T17:40:12.459 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.430+0000 7fc2c8d14700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c41483e0 con 0x7fc2c406fc40 2023-01-01T17:40:12.459 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.430+0000 7fc2c259c700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc2c406fc40 0x7fc2c414b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.459 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.430+0000 7fc2c1d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2c40714b0 0x7fc2c40c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.459 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.430+0000 7fc2c259c700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc2c406fc40 0x7fc2c414b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.61:44884/0 (socket says 172.21.15.61:44884) 2023-01-01T17:40:12.459 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.430+0000 7fc2c259c700 1 -- 172.21.15.61:0/1616259924 learned_addr learned my addr 172.21.15.61:0/1616259924 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:12.459 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.430+0000 7fc2c2d9d700 1 --2- 172.21.15.61:0/1616259924 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc2c414c810 0x7fc2c40c4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.431+0000 7fb0af7fe700 1 --2- 172.21.15.61:0/2348108258 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fb09c063290 0x7fb09c065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.431+0000 7fc2c259c700 1 -- 172.21.15.61:0/1616259924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2c40714b0 msgr2=0x7fc2c40c4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.431+0000 7fc2c259c700 1 --2- 172.21.15.61:0/1616259924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2c40714b0 0x7fc2c40c4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.431+0000 7fc2c259c700 1 -- 172.21.15.61:0/1616259924 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc2c414c810 msgr2=0x7fc2c40c4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.431+0000 7fc2c259c700 1 --2- 172.21.15.61:0/1616259924 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc2c414c810 0x7fc2c40c4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.431+0000 7fc2c259c700 1 -- 172.21.15.61:0/1616259924 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ac00b7f0 con 0x7fc2c406fc40 2023-01-01T17:40:12.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.431+0000 7fc2c2d9d700 1 --2- 172.21.15.61:0/1616259924 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fc2c414c810 0x7fc2c40c4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-01-01T17:40:12.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.431+0000 7fc2c259c700 1 --2- 172.21.15.61:0/1616259924 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc2c406fc40 0x7fc2c414b200 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac00bf10 tx=0x7fc2ac004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.431+0000 7fb0af7fe700 1 --2- 172.21.15.61:0/2348108258 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fb09c063290 0x7fb09c065740 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb0b006bbe0 tx=0x7fb0a800d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.461 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.433+0000 7fae66c48700 1 -- 172.21.15.61:0/4251102714 shutdown_connections 2023-01-01T17:40:12.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.433+0000 7fc2baffd700 1 -- 172.21.15.61:0/1616259924 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac009040 con 0x7fc2c406fc40 2023-01-01T17:40:12.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.433+0000 7fb0b6a62700 1 --2- 172.21.15.61:0/2348108258 >> [v2:172.21.15.61:6800/94347,v1:172.21.15.61:6801/94347] conn(0x7fb0b00bb820 0x7fb0b014e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.433+0000 7fb0b6a62700 1 -- 172.21.15.61:0/2348108258 --> [v2:172.21.15.61:6800/94347,v1:172.21.15.61:6801/94347] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb0b014ee70 con 0x7fb0b00bb820 2023-01-01T17:40:12.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.433+0000 7fb0b4fff700 1 --2- 172.21.15.61:0/2348108258 >> [v2:172.21.15.61:6800/94347,v1:172.21.15.61:6801/94347] conn(0x7fb0b00bb820 0x7fb0b014e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.462 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.433+0000 7fb0b4fff700 1 --2- 172.21.15.61:0/2348108258 >> [v2:172.21.15.61:6800/94347,v1:172.21.15.61:6801/94347] conn(0x7fb0b00bb820 0x7fb0b014e930 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.463 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.433+0000 7fc2c8d14700 1 -- 172.21.15.61:0/1616259924 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2c40bbb40 con 0x7fc2c406fc40 2023-01-01T17:40:12.463 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.433+0000 7fc2c8d14700 1 -- 172.21.15.61:0/1616259924 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2c40bb860 con 0x7fc2c406fc40 2023-01-01T17:40:12.463 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.433+0000 7fc2baffd700 1 -- 172.21.15.61:0/1616259924 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ac004570 con 0x7fc2c406fc40 2023-01-01T17:40:12.463 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.434+0000 7fc2baffd700 1 -- 172.21.15.61:0/1616259924 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac01f6a0 con 0x7fc2c406fc40 2023-01-01T17:40:12.463 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.434+0000 7fb0acff9700 1 -- 172.21.15.61:0/2348108258 <== osd.3 v2:172.21.15.61:6800/94347 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24745 (crc 0 0 0) 0x7fb0b014ee70 con 0x7fb0b00bb820 2023-01-01T17:40:12.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.435+0000 7fc2c8d14700 1 -- 172.21.15.61:0/1616259924 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc2a8000fc0 con 0x7fc2c406fc40 2023-01-01T17:40:12.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.435+0000 7fc2baffd700 1 -- 172.21.15.61:0/1616259924 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7fc2ac026030 con 0x7fc2c406fc40 2023-01-01T17:40:12.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.435+0000 7fc2baffd700 1 --2- 172.21.15.61:0/1616259924 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fc2a4063310 0x7fc2a40657c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.435+0000 7fc2baffd700 1 -- 172.21.15.61:0/1616259924 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc2ac080c20 con 0x7fc2c406fc40 2023-01-01T17:40:12.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.435+0000 7fc2c1d9b700 1 --2- 172.21.15.61:0/1616259924 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fc2a4063310 0x7fc2a40657c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.435+0000 7fc2baffd700 1 --2- 172.21.15.61:0/1616259924 >> [v2:172.21.15.149:6817/94734,v1:172.21.15.149:6819/94734] conn(0x7fc2a406d100 0x7fc2a406f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.435+0000 7fc2baffd700 1 -- 172.21.15.61:0/1616259924 --> [v2:172.21.15.149:6817/94734,v1:172.21.15.149:6819/94734] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc2a406fc00 con 0x7fc2a406d100 2023-01-01T17:40:12.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.435+0000 7fc2baffd700 1 -- 172.21.15.61:0/1616259924 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2ac083290 con 0x7fc2c406fc40 2023-01-01T17:40:12.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.436+0000 7fc2c2d9d700 1 --2- 172.21.15.61:0/1616259924 >> [v2:172.21.15.149:6817/94734,v1:172.21.15.149:6819/94734] conn(0x7fc2a406d100 0x7fc2a406f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.436+0000 7fc2c1d9b700 1 --2- 172.21.15.61:0/1616259924 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fc2a4063310 0x7fc2a40657c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4153900 tx=0x7fc2b4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.436+0000 7fc2c2d9d700 1 --2- 172.21.15.61:0/1616259924 >> [v2:172.21.15.149:6817/94734,v1:172.21.15.149:6819/94734] conn(0x7fc2a406d100 0x7fc2a406f530 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.437+0000 7fc2baffd700 1 -- 172.21.15.61:0/1616259924 <== osd.7 v2:172.21.15.149:6817/94734 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24745 (crc 0 0 0) 0x7fc2a406fc00 con 0x7fc2a406d100 2023-01-01T17:40:12.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.440+0000 7fc755eb3700 1 -- 172.21.15.61:0/1531657974 --> [v2:172.21.15.61:6824/94349,v1:172.21.15.61:6825/94349] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc75006f2d0 con 0x7fc73c06d000 2023-01-01T17:40:12.466 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.440+0000 7fcc370bd700 1 -- 172.21.15.61:0/33551629 --> [v2:172.21.15.61:6808/94350,v1:172.21.15.61:6809/94350] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcc30149790 con 0x7fcc30142610 2023-01-01T17:40:12.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.441+0000 7fcc2d7fa700 1 -- 172.21.15.61:0/33551629 <== osd.2 v2:172.21.15.61:6808/94350 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcc30149790 con 0x7fcc30142610 2023-01-01T17:40:12.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.440+0000 7fae66c48700 1 -- 172.21.15.61:0/4251102714 wait complete. 2023-01-01T17:40:12.467 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.440+0000 7fb5c2047700 1 -- 172.21.15.61:0/2675342962 --> [v2:172.21.15.149:6800/94710,v1:172.21.15.149:6801/94710] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb5bc1553c0 con 0x7fb5bc155770 2023-01-01T17:40:12.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.441+0000 7fb5b1ffb700 1 -- 172.21.15.61:0/2675342962 <== osd.6 v2:172.21.15.149:6800/94710 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb5bc1553c0 con 0x7fb5bc155770 2023-01-01T17:40:12.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.441+0000 7fcddc8cd700 1 -- 172.21.15.61:0/664569586 --> [v2:172.21.15.61:6811/94348,v1:172.21.15.61:6813/94348] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcdd80ba0c0 con 0x7fcdb808f010 2023-01-01T17:40:12.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.441+0000 7fc737fff700 1 -- 172.21.15.61:0/1531657974 <== osd.0 v2:172.21.15.61:6824/94349 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc75006f2d0 con 0x7fc73c06d000 2023-01-01T17:40:12.468 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.441+0000 7fae66c48700 1 Processor -- start 2023-01-01T17:40:12.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.441+0000 7fb12caaf700 1 -- 172.21.15.61:0/2082694915 --> [v2:172.21.15.149:6808/94709,v1:172.21.15.149:6809/94709] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb128066190 con 0x7fb10806d020 2023-01-01T17:40:12.469 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.442+0000 7fae66c48700 1 -- start start 2023-01-01T17:40:12.470 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.442+0000 7fc755eb3700 1 -- 172.21.15.61:0/1531657974 >> [v2:172.21.15.61:6824/94349,v1:172.21.15.61:6825/94349] conn(0x7fc73c06d000 msgr2=0x7fc73c06f430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.470 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.442+0000 7fc755eb3700 1 --2- 172.21.15.61:0/1531657974 >> [v2:172.21.15.61:6824/94349,v1:172.21.15.61:6825/94349] conn(0x7fc73c06d000 0x7fc73c06f430 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.470 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.442+0000 7fc755eb3700 1 -- 172.21.15.61:0/1531657974 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fc73c063290 msgr2=0x7fc73c065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.470 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.442+0000 7fc755eb3700 1 --2- 172.21.15.61:0/1531657974 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fc73c063290 0x7fc73c065740 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc74800a510 tx=0x7fc74800d040 comp rx=0 tx=0).stop 2023-01-01T17:40:12.470 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.442+0000 7fc755eb3700 1 -- 172.21.15.61:0/1531657974 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc7500a5270 msgr2=0x7fc75014ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.470 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.442+0000 7fc755eb3700 1 --2- 172.21.15.61:0/1531657974 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc7500a5270 0x7fc75014ac30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc7500c6af0 tx=0x7fc744004750 comp rx=0 tx=0).stop 2023-01-01T17:40:12.470 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.442+0000 7fc74ffff700 1 -- 172.21.15.61:0/1531657974 reap_dead start 2023-01-01T17:40:12.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.442+0000 7fb5c2047700 1 -- 172.21.15.61:0/2675342962 >> [v2:172.21.15.149:6800/94710,v1:172.21.15.149:6801/94710] conn(0x7fb5bc155770 msgr2=0x7fb5bc0c5800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.442+0000 7fb5c2047700 1 --2- 172.21.15.61:0/2675342962 >> [v2:172.21.15.149:6800/94710,v1:172.21.15.149:6801/94710] conn(0x7fb5bc155770 0x7fb5bc0c5800 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.442+0000 7fb5c2047700 1 -- 172.21.15.61:0/2675342962 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fb5a0063290 msgr2=0x7fb5a0065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.442+0000 7fb5c2047700 1 --2- 172.21.15.61:0/2675342962 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fb5a0063290 0x7fb5a0065740 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc14d670 tx=0x7fb5ac010000 comp rx=0 tx=0).stop 2023-01-01T17:40:12.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.442+0000 7fb5c2047700 1 -- 172.21.15.61:0/2675342962 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb5bc0c4610 msgr2=0x7fb5bc151d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.471 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.442+0000 7fb5c2047700 1 --2- 172.21.15.61:0/2675342962 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb5bc0c4610 0x7fb5bc151d10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb5b400c8c0 tx=0x7fb5b400cc80 comp rx=0 tx=0).stop 2023-01-01T17:40:12.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.442+0000 7fb5c1846700 1 -- 172.21.15.61:0/2675342962 reap_dead start 2023-01-01T17:40:12.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.443+0000 7fae66c48700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae600715c0 0x7fae60162940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.443+0000 7fae66c48700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae600a5270 0x7fae600b9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.443+0000 7fae66c48700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fae600c06b0 0x7fae600a7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.443+0000 7fae66c48700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6014fd30 con 0x7fae600c06b0 2023-01-01T17:40:12.472 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.443+0000 7fae66c48700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae600bf220 con 0x7fae600a5270 2023-01-01T17:40:12.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.443+0000 7fae66c48700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae600bf7e0 con 0x7fae600715c0 2023-01-01T17:40:12.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.443+0000 7fb116ffd700 1 -- 172.21.15.61:0/2082694915 <== osd.5 v2:172.21.15.149:6808/94709 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb128066190 con 0x7fb10806d020 2023-01-01T17:40:12.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.443+0000 7fb5c2047700 1 -- 172.21.15.61:0/2675342962 shutdown_connections 2023-01-01T17:40:12.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.443+0000 7fb5c2047700 1 -- 172.21.15.61:0/2675342962 >> 172.21.15.61:0/2675342962 conn(0x7fb5bc0a8170 msgr2=0x7fb5bc0c2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:12.473 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.443+0000 7fc755eb3700 1 -- 172.21.15.61:0/1531657974 shutdown_connections 2023-01-01T17:40:12.474 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.443+0000 7fc755eb3700 1 -- 172.21.15.61:0/1531657974 >> 172.21.15.61:0/1531657974 conn(0x7fc75006b100 msgr2=0x7fc75014b890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:12.474 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.443+0000 7fae649e4700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae600715c0 0x7fae60162940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.474 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.443+0000 7fae5ffff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae600a5270 0x7fae600b9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.474 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.443+0000 7fae649e4700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae600715c0 0x7fae60162940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.61:44900/0 (socket says 172.21.15.61:44900) 2023-01-01T17:40:12.474 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.443+0000 7fae649e4700 1 -- 172.21.15.61:0/792161874 learned_addr learned my addr 172.21.15.61:0/792161874 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:12.475 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.443+0000 7fb5c2047700 1 -- 172.21.15.61:0/2675342962 shutdown_connections 2023-01-01T17:40:12.475 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.443+0000 7fae651e5700 1 --2- 172.21.15.61:0/792161874 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fae600c06b0 0x7fae600a7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.475 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.443+0000 7fcc370bd700 1 -- 172.21.15.61:0/33551629 >> [v2:172.21.15.61:6808/94350,v1:172.21.15.61:6809/94350] conn(0x7fcc30142610 msgr2=0x7fcc3014f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.475 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.443+0000 7fcc370bd700 1 --2- 172.21.15.61:0/33551629 >> [v2:172.21.15.61:6808/94350,v1:172.21.15.61:6809/94350] conn(0x7fcc30142610 0x7fcc3014f360 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.476 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.443+0000 7fae5ffff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae600a5270 0x7fae600b9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.61:42498/0 (socket says 172.21.15.61:42498) 2023-01-01T17:40:12.476 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.443+0000 7fb5c2047700 1 -- 172.21.15.61:0/2675342962 wait complete. 2023-01-01T17:40:12.476 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.443+0000 7fcc370bd700 1 -- 172.21.15.61:0/33551629 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fcc1c0632e0 msgr2=0x7fcc1c065790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.476 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.443+0000 7fcc370bd700 1 --2- 172.21.15.61:0/33551629 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fcc1c0632e0 0x7fcc1c065790 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcc30142f70 tx=0x7fcc2000f040 comp rx=0 tx=0).stop 2023-01-01T17:40:12.476 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.443+0000 7fcc370bd700 1 -- 172.21.15.61:0/33551629 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc180074f0 msgr2=0x7fcc30149250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.443+0000 7fcc370bd700 1 --2- 172.21.15.61:0/33551629 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcc180074f0 0x7fcc30149250 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcc2400e7e0 tx=0x7fcc2400eba0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.444+0000 7fcc3565a700 1 -- 172.21.15.61:0/33551629 reap_dead start 2023-01-01T17:40:12.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.443+0000 7fae651e5700 1 -- 172.21.15.61:0/792161874 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae600715c0 msgr2=0x7fae60162940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.443+0000 7fae651e5700 1 --2- 172.21.15.61:0/792161874 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fae600715c0 0x7fae60162940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.443+0000 7fae651e5700 1 -- 172.21.15.61:0/792161874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae600a5270 msgr2=0x7fae600b9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.443+0000 7fae651e5700 1 --2- 172.21.15.61:0/792161874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fae600a5270 0x7fae600b9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.477 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.443+0000 7fae651e5700 1 -- 172.21.15.61:0/792161874 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae50009550 con 0x7fae600c06b0 2023-01-01T17:40:12.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.444+0000 7fae651e5700 1 --2- 172.21.15.61:0/792161874 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fae600c06b0 0x7fae600a7740 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fae5400e7e0 tx=0x7fae5400eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.443+0000 7fb12caaf700 1 -- 172.21.15.61:0/2082694915 >> [v2:172.21.15.149:6808/94709,v1:172.21.15.149:6809/94709] conn(0x7fb10806d020 msgr2=0x7fb10806f450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.443+0000 7fb12caaf700 1 --2- 172.21.15.61:0/2082694915 >> [v2:172.21.15.149:6808/94709,v1:172.21.15.149:6809/94709] conn(0x7fb10806d020 0x7fb10806f450 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.444+0000 7fb12caaf700 1 -- 172.21.15.61:0/2082694915 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fb1080632b0 msgr2=0x7fb108065760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.444+0000 7fb12caaf700 1 --2- 172.21.15.61:0/2082694915 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fb1080632b0 0x7fb108065760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb11c0011e0 tx=0x7fb11c009040 comp rx=0 tx=0).stop 2023-01-01T17:40:12.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.444+0000 7fb12caaf700 1 -- 172.21.15.61:0/2082694915 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb12814fa20 msgr2=0x7fb1280a9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.444+0000 7fb12caaf700 1 --2- 172.21.15.61:0/2082694915 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb12814fa20 0x7fb1280a9f00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb12806c2f0 tx=0x7fb120004ad0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.444+0000 7fb126d9d700 1 -- 172.21.15.61:0/2082694915 reap_dead start 2023-01-01T17:40:12.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.444+0000 7fb12caaf700 1 -- 172.21.15.61:0/2082694915 shutdown_connections 2023-01-01T17:40:12.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.444+0000 7fb12caaf700 1 -- 172.21.15.61:0/2082694915 >> 172.21.15.61:0/2082694915 conn(0x7fb128069fb0 msgr2=0x7fb1280c3390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:12.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.444+0000 7fb12caaf700 1 -- 172.21.15.61:0/2082694915 shutdown_connections 2023-01-01T17:40:12.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.444+0000 7fb12caaf700 1 -- 172.21.15.61:0/2082694915 wait complete. 2023-01-01T17:40:12.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.444+0000 7fc755eb3700 1 -- 172.21.15.61:0/1531657974 shutdown_connections 2023-01-01T17:40:12.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.444+0000 7fc755eb3700 1 -- 172.21.15.61:0/1531657974 wait complete. 2023-01-01T17:40:12.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.444+0000 7fcc370bd700 1 -- 172.21.15.61:0/33551629 shutdown_connections 2023-01-01T17:40:12.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.444+0000 7fcc370bd700 1 -- 172.21.15.61:0/33551629 >> 172.21.15.61:0/33551629 conn(0x7fcc300c1f30 msgr2=0x7fcc30144260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:12.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.444+0000 7fcc370bd700 1 -- 172.21.15.61:0/33551629 shutdown_connections 2023-01-01T17:40:12.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.444+0000 7fae5d7fa700 1 -- 172.21.15.61:0/792161874 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5400c070 con 0x7fae600c06b0 2023-01-01T17:40:12.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.444+0000 7fae5d7fa700 1 -- 172.21.15.61:0/792161874 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae54013610 con 0x7fae600c06b0 2023-01-01T17:40:12.480 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.444+0000 7fae5d7fa700 1 -- 172.21.15.61:0/792161874 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae540139a0 con 0x7fae600c06b0 2023-01-01T17:40:12.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.444+0000 7fcc370bd700 1 -- 172.21.15.61:0/33551629 wait complete. 2023-01-01T17:40:12.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.444+0000 7fae66c48700 1 -- 172.21.15.61:0/792161874 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae600c3e40 con 0x7fae600c06b0 2023-01-01T17:40:12.481 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.445+0000 7fcdc6ffd700 1 -- 172.21.15.61:0/664569586 <== osd.1 v2:172.21.15.61:6811/94348 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcdd80ba0c0 con 0x7fcdb808f010 2023-01-01T17:40:12.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.445+0000 7fcddc8cd700 1 -- 172.21.15.61:0/664569586 >> [v2:172.21.15.61:6811/94348,v1:172.21.15.61:6813/94348] conn(0x7fcdb808f010 msgr2=0x7fcdb8091440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.482 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.445+0000 7fcddc8cd700 1 --2- 172.21.15.61:0/664569586 >> [v2:172.21.15.61:6811/94348,v1:172.21.15.61:6813/94348] conn(0x7fcdb808f010 0x7fcdb8091440 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.444+0000 7fae66c48700 1 -- 172.21.15.61:0/792161874 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae600a4ec0 con 0x7fae600c06b0 2023-01-01T17:40:12.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.445+0000 7fae66c48700 1 -- 172.21.15.61:0/792161874 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fae600c0b30 con 0x7fae600c06b0 2023-01-01T17:40:12.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.447+0000 7fae5d7fa700 1 -- 172.21.15.61:0/792161874 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7fae54023070 con 0x7fae600c06b0 2023-01-01T17:40:12.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.448+0000 7fae5d7fa700 1 --2- 172.21.15.61:0/792161874 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fae4c0632e0 0x7fae4c065790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.448+0000 7fae5d7fa700 1 -- 172.21.15.61:0/792161874 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fae540800f0 con 0x7fae600c06b0 2023-01-01T17:40:12.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.448+0000 7fae649e4700 1 --2- 172.21.15.61:0/792161874 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fae4c0632e0 0x7fae4c065790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.448+0000 7fae5d7fa700 1 --2- 172.21.15.61:0/792161874 >> [v2:172.21.15.149:6816/94711,v1:172.21.15.149:6818/94711] conn(0x7fae4c06d0d0 0x7fae4c06f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.448+0000 7fae5d7fa700 1 -- 172.21.15.61:0/792161874 --> [v2:172.21.15.149:6816/94711,v1:172.21.15.149:6818/94711] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fae4c06fbd0 con 0x7fae4c06d0d0 2023-01-01T17:40:12.483 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.448+0000 7fae5d7fa700 1 -- 172.21.15.61:0/792161874 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae540804f0 con 0x7fae600c06b0 2023-01-01T17:40:12.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.448+0000 7fae649e4700 1 --2- 172.21.15.61:0/792161874 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fae4c0632e0 0x7fae4c065790 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fae600c1780 tx=0x7fae5800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.448+0000 7fae5ffff700 1 --2- 172.21.15.61:0/792161874 >> [v2:172.21.15.149:6816/94711,v1:172.21.15.149:6818/94711] conn(0x7fae4c06d0d0 0x7fae4c06f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.449+0000 7fcddc8cd700 1 -- 172.21.15.61:0/664569586 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fcdb80852a0 msgr2=0x7fcdb8087750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.449+0000 7fcddc8cd700 1 --2- 172.21.15.61:0/664569586 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fcdb80852a0 0x7fcdb8087750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc0017a0 tx=0x7fcdcc001430 comp rx=0 tx=0).stop 2023-01-01T17:40:12.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.449+0000 7fcddc8cd700 1 -- 172.21.15.61:0/664569586 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcdd80b8df0 msgr2=0x7fcdd81e4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.449+0000 7fcddc8cd700 1 --2- 172.21.15.61:0/664569586 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcdd80b8df0 0x7fcdd81e4700 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8016040 tx=0x7fcdc80047c0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.449+0000 7fcdd6d9d700 1 -- 172.21.15.61:0/664569586 reap_dead start 2023-01-01T17:40:12.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.449+0000 7fae5ffff700 1 --2- 172.21.15.61:0/792161874 >> [v2:172.21.15.149:6816/94711,v1:172.21.15.149:6818/94711] conn(0x7fae4c06d0d0 0x7fae4c06f500 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.450+0000 7fae5d7fa700 1 -- 172.21.15.61:0/792161874 <== osd.4 v2:172.21.15.149:6816/94711 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24745 (crc 0 0 0) 0x7fae4c06fbd0 con 0x7fae4c06d0d0 2023-01-01T17:40:12.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.453+0000 7fcddc8cd700 1 -- 172.21.15.61:0/664569586 shutdown_connections 2023-01-01T17:40:12.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.453+0000 7fcddc8cd700 1 -- 172.21.15.61:0/664569586 >> 172.21.15.61:0/664569586 conn(0x7fcdd806b100 msgr2=0x7fcdd81503f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:12.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.455+0000 7fcddc8cd700 1 -- 172.21.15.61:0/664569586 shutdown_connections 2023-01-01T17:40:12.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.455+0000 7fcddc8cd700 1 -- 172.21.15.61:0/664569586 wait complete. 2023-01-01T17:40:12.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.459+0000 7fc2c8d14700 1 -- 172.21.15.61:0/1616259924 --> [v2:172.21.15.149:6817/94734,v1:172.21.15.149:6819/94734] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc2a8002d40 con 0x7fc2a406d100 2023-01-01T17:40:12.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.462+0000 7fc2baffd700 1 -- 172.21.15.61:0/1616259924 <== osd.7 v2:172.21.15.149:6817/94734 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc2a8002d40 con 0x7fc2a406d100 2023-01-01T17:40:12.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.464+0000 7fc2c8d14700 1 -- 172.21.15.61:0/1616259924 >> [v2:172.21.15.149:6817/94734,v1:172.21.15.149:6819/94734] conn(0x7fc2a406d100 msgr2=0x7fc2a406f530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.464+0000 7fc2c8d14700 1 --2- 172.21.15.61:0/1616259924 >> [v2:172.21.15.149:6817/94734,v1:172.21.15.149:6819/94734] conn(0x7fc2a406d100 0x7fc2a406f530 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.464+0000 7fc2c8d14700 1 -- 172.21.15.61:0/1616259924 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fc2a4063310 msgr2=0x7fc2a40657c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.464+0000 7fc2c8d14700 1 --2- 172.21.15.61:0/1616259924 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fc2a4063310 0x7fc2a40657c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4153900 tx=0x7fc2b4009040 comp rx=0 tx=0).stop 2023-01-01T17:40:12.487 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.464+0000 7fc2c8d14700 1 -- 172.21.15.61:0/1616259924 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc2c406fc40 msgr2=0x7fc2c414b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.488 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.464+0000 7fc2c8d14700 1 --2- 172.21.15.61:0/1616259924 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fc2c406fc40 0x7fc2c414b200 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac00bf10 tx=0x7fc2ac004750 comp rx=0 tx=0).stop 2023-01-01T17:40:12.488 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.465+0000 7fc2c2d9d700 1 -- 172.21.15.61:0/1616259924 reap_dead start 2023-01-01T17:40:12.488 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.466+0000 7fb0b6a62700 1 -- 172.21.15.61:0/2348108258 --> [v2:172.21.15.61:6800/94347,v1:172.21.15.61:6801/94347] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb0b0066190 con 0x7fb0b00bb820 2023-01-01T17:40:12.489 INFO:teuthology.orchestra.run.smithi061.stdout:55834574856 2023-01-01T17:40:12.489 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-01-01T17:40:12.490 INFO:teuthology.orchestra.run.smithi061.stdout:55834574856 2023-01-01T17:40:12.490 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-01-01T17:40:12.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.468+0000 7fc2c8d14700 1 -- 172.21.15.61:0/1616259924 shutdown_connections 2023-01-01T17:40:12.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.468+0000 7fc2c8d14700 1 -- 172.21.15.61:0/1616259924 >> 172.21.15.61:0/1616259924 conn(0x7fc2c40c1f30 msgr2=0x7fc2c4069f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:12.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.468+0000 7fc2c8d14700 1 -- 172.21.15.61:0/1616259924 shutdown_connections 2023-01-01T17:40:12.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.468+0000 7fc2c8d14700 1 -- 172.21.15.61:0/1616259924 wait complete. 2023-01-01T17:40:12.492 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.469+0000 7fb0acff9700 1 -- 172.21.15.61:0/2348108258 <== osd.3 v2:172.21.15.61:6800/94347 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb0b0066190 con 0x7fb0b00bb820 2023-01-01T17:40:12.492 INFO:teuthology.orchestra.run.smithi061.stdout:55834574856 2023-01-01T17:40:12.493 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-01-01T17:40:12.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.471+0000 7fb0b6a62700 1 -- 172.21.15.61:0/2348108258 >> [v2:172.21.15.61:6800/94347,v1:172.21.15.61:6801/94347] conn(0x7fb0b00bb820 msgr2=0x7fb0b014e930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.471+0000 7fb0b6a62700 1 --2- 172.21.15.61:0/2348108258 >> [v2:172.21.15.61:6800/94347,v1:172.21.15.61:6801/94347] conn(0x7fb0b00bb820 0x7fb0b014e930 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.471+0000 7fb0b6a62700 1 -- 172.21.15.61:0/2348108258 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fb09c063290 msgr2=0x7fb09c065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.471+0000 7fb0b6a62700 1 --2- 172.21.15.61:0/2348108258 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fb09c063290 0x7fb09c065740 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb0b006bbe0 tx=0x7fb0a800d040 comp rx=0 tx=0).stop 2023-01-01T17:40:12.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.471+0000 7fb0b6a62700 1 -- 172.21.15.61:0/2348108258 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb0b00a3f90 msgr2=0x7fb0b006f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.471+0000 7fb0b6a62700 1 --2- 172.21.15.61:0/2348108258 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fb0b00a3f90 0x7fb0b006f870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0014040 tx=0x7fb0a0004750 comp rx=0 tx=0).stop 2023-01-01T17:40:12.494 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.471+0000 7fb0b4fff700 1 -- 172.21.15.61:0/2348108258 reap_dead start 2023-01-01T17:40:12.494 INFO:teuthology.orchestra.run.smithi061.stdout:55834574856 2023-01-01T17:40:12.495 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-01-01T17:40:12.495 INFO:teuthology.orchestra.run.smithi061.stdout:55834574856 2023-01-01T17:40:12.496 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-01-01T17:40:12.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.482+0000 7fb0b6a62700 1 -- 172.21.15.61:0/2348108258 shutdown_connections 2023-01-01T17:40:12.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.482+0000 7fb0b6a62700 1 -- 172.21.15.61:0/2348108258 >> 172.21.15.61:0/2348108258 conn(0x7fb0b0069fb0 msgr2=0x7fb0b00a5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:12.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.482+0000 7fb0b6a62700 1 -- 172.21.15.61:0/2348108258 shutdown_connections 2023-01-01T17:40:12.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.482+0000 7fb0b6a62700 1 -- 172.21.15.61:0/2348108258 wait complete. 2023-01-01T17:40:12.497 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.485+0000 7fae66c48700 1 -- 172.21.15.61:0/792161874 --> [v2:172.21.15.149:6816/94711,v1:172.21.15.149:6818/94711] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fae600bf950 con 0x7fae4c06d0d0 2023-01-01T17:40:12.498 INFO:teuthology.orchestra.run.smithi061.stdout:55834574856 2023-01-01T17:40:12.498 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-01-01T17:40:12.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.486+0000 7fae5d7fa700 1 -- 172.21.15.61:0/792161874 <== osd.4 v2:172.21.15.149:6816/94711 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fae600bf950 con 0x7fae4c06d0d0 2023-01-01T17:40:12.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.486+0000 7fae66c48700 1 -- 172.21.15.61:0/792161874 >> [v2:172.21.15.149:6816/94711,v1:172.21.15.149:6818/94711] conn(0x7fae4c06d0d0 msgr2=0x7fae4c06f500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.486+0000 7fae66c48700 1 --2- 172.21.15.61:0/792161874 >> [v2:172.21.15.149:6816/94711,v1:172.21.15.149:6818/94711] conn(0x7fae4c06d0d0 0x7fae4c06f500 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.487+0000 7fae66c48700 1 -- 172.21.15.61:0/792161874 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fae4c0632e0 msgr2=0x7fae4c065790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.487+0000 7fae66c48700 1 --2- 172.21.15.61:0/792161874 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fae4c0632e0 0x7fae4c065790 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fae600c1780 tx=0x7fae5800b040 comp rx=0 tx=0).stop 2023-01-01T17:40:12.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.487+0000 7fae66c48700 1 -- 172.21.15.61:0/792161874 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fae600c06b0 msgr2=0x7fae600a7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.487+0000 7fae66c48700 1 --2- 172.21.15.61:0/792161874 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fae600c06b0 0x7fae600a7740 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fae5400e7e0 tx=0x7fae5400eaf0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.487+0000 7fae651e5700 1 -- 172.21.15.61:0/792161874 reap_dead start 2023-01-01T17:40:12.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.487+0000 7fae66c48700 1 -- 172.21.15.61:0/792161874 shutdown_connections 2023-01-01T17:40:12.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.487+0000 7fae66c48700 1 -- 172.21.15.61:0/792161874 >> 172.21.15.61:0/792161874 conn(0x7fae6006b100 msgr2=0x7fae60156730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:12.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.487+0000 7fae66c48700 1 -- 172.21.15.61:0/792161874 shutdown_connections 2023-01-01T17:40:12.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.487+0000 7fae66c48700 1 -- 172.21.15.61:0/792161874 wait complete. 2023-01-01T17:40:12.501 INFO:teuthology.orchestra.run.smithi061.stdout:55834574856 2023-01-01T17:40:12.502 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-01-01T17:40:12.503 INFO:teuthology.orchestra.run.smithi061.stdout:55834574856 2023-01-01T17:40:12.503 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-01-01T17:40:12.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.669+0000 7f1098c65700 1 Processor -- start 2023-01-01T17:40:12.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.670+0000 7f1098c65700 1 -- start start 2023-01-01T17:40:12.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.671+0000 7f1098c65700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f10940a6e50 0x7f109414c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.671+0000 7f1098c65700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f109414fa20 0x7f10940c1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.671+0000 7f1098c65700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f109414ff30 con 0x7f10940c1b60 2023-01-01T17:40:12.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.671+0000 7f1098c65700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f109406ada0 con 0x7f10940a6e50 2023-01-01T17:40:12.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.671+0000 7f1098c65700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10940bf6c0 con 0x7f109414fa20 2023-01-01T17:40:12.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.672+0000 7f1092d9d700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f10940c1b60 0x7f109406b230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40518/0 (socket says 172.21.15.61:40518) 2023-01-01T17:40:12.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.672+0000 7f1092d9d700 1 -- 172.21.15.61:0/3858456899 learned_addr learned my addr 172.21.15.61:0/3858456899 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:40:12.674 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.673+0000 7f109259c700 1 --2- 172.21.15.61:0/3858456899 >> v2:172.21.15.61:3300/0 conn(0x7f10940a6e50 0x7f109414c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.673+0000 7f109259c700 1 -- 172.21.15.61:0/3858456899 >> v2:172.21.15.149:3300/0 conn(0x7f109414fa20 msgr2=0x7f10940c1620 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-01-01T17:40:12.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.673+0000 7f109259c700 1 --2- 172.21.15.61:0/3858456899 >> v2:172.21.15.149:3300/0 conn(0x7f109414fa20 0x7f10940c1620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.673+0000 7f109259c700 1 -- 172.21.15.61:0/3858456899 >> v1:172.21.15.61:6789/0 conn(0x7f10940c1b60 legacy=0x7f109406b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.673+0000 7f109259c700 1 -- 172.21.15.61:0/3858456899 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10940bf9a0 con 0x7f10940a6e50 2023-01-01T17:40:12.675 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.674+0000 7f109259c700 1 --2- 172.21.15.61:0/3858456899 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f10940a6e50 0x7f109414c5b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f10940c5d10 tx=0x7f1088009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c239b7c22dbabbcb server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.679+0000 7f109159a700 1 -- 172.21.15.61:0/3858456899 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1088011830 con 0x7f10940a6e50 2023-01-01T17:40:12.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.679+0000 7f109159a700 1 -- 172.21.15.61:0/3858456899 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1088011990 con 0x7f10940a6e50 2023-01-01T17:40:12.680 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.679+0000 7f109159a700 1 -- 172.21.15.61:0/3858456899 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1088011d20 con 0x7f10940a6e50 2023-01-01T17:40:12.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.681+0000 7f1098c65700 1 -- 172.21.15.61:0/3858456899 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f10940a6e50 msgr2=0x7f109414c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.681+0000 7f1098c65700 1 --2- 172.21.15.61:0/3858456899 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f10940a6e50 0x7f109414c5b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f10940c5d10 tx=0x7f1088009b20 comp rx=0 tx=0).stop 2023-01-01T17:40:12.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.681+0000 7f1098c65700 1 -- 172.21.15.61:0/3858456899 shutdown_connections 2023-01-01T17:40:12.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.681+0000 7f1098c65700 1 --2- 172.21.15.61:0/3858456899 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f10940a6e50 0x7f109414c5b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.681+0000 7f1098c65700 1 --2- 172.21.15.61:0/3858456899 >> v2:172.21.15.149:3300/0 conn(0x7f109414fa20 0x7f10940c1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.681+0000 7f1098c65700 1 -- 172.21.15.61:0/3858456899 >> 172.21.15.61:0/3858456899 conn(0x7f1094069fb0 msgr2=0x7f10940a6740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:12.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.684+0000 7f1098c65700 1 -- 172.21.15.61:0/3858456899 shutdown_connections 2023-01-01T17:40:12.686 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.684+0000 7f1098c65700 1 -- 172.21.15.61:0/3858456899 wait complete. 2023-01-01T17:40:12.687 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.686+0000 7f1098c65700 1 Processor -- start 2023-01-01T17:40:12.688 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.686+0000 7f1098c65700 1 -- start start 2023-01-01T17:40:12.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.687+0000 7f1098c65700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10940a6e50 0x7f10941ec880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.687+0000 7f1098c65700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10940c1b60 0x7f10940b7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.687+0000 7f1098c65700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f109414fa20 0x7f10940b7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.687+0000 7f1098c65700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1094150ed0 con 0x7f109414fa20 2023-01-01T17:40:12.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.687+0000 7f1098c65700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109415c1e0 con 0x7f10940a6e50 2023-01-01T17:40:12.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.687+0000 7f1098c65700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f109415c550 con 0x7f10940c1b60 2023-01-01T17:40:12.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.688+0000 7f109259c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10940a6e50 0x7f10941ec880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.688+0000 7f1092d9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f109414fa20 0x7f10940b7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.688+0000 7f1092d9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f109414fa20 0x7f10940b7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46676/0 (socket says 172.21.15.61:46676) 2023-01-01T17:40:12.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.688+0000 7f1092d9d700 1 -- 172.21.15.61:0/118769869 learned_addr learned my addr 172.21.15.61:0/118769869 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:12.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.688+0000 7f1091d9b700 1 --2- 172.21.15.61:0/118769869 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10940c1b60 0x7f10940b7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.689+0000 7f1092d9d700 1 -- 172.21.15.61:0/118769869 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10940c1b60 msgr2=0x7f10940b7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.689+0000 7f1092d9d700 1 --2- 172.21.15.61:0/118769869 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10940c1b60 0x7f10940b7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.689+0000 7f1092d9d700 1 -- 172.21.15.61:0/118769869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10940a6e50 msgr2=0x7f10941ec880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.689+0000 7f1092d9d700 1 --2- 172.21.15.61:0/118769869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10940a6e50 0x7f10941ec880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.689+0000 7f1092d9d700 1 -- 172.21.15.61:0/118769869 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10880094a0 con 0x7f109414fa20 2023-01-01T17:40:12.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.689+0000 7f1092d9d700 1 --2- 172.21.15.61:0/118769869 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f109414fa20 0x7f10940b7980 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f108c00caa0 tx=0x7f108c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.700+0000 7f1082ffd700 1 -- 172.21.15.61:0/118769869 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c00aaa0 con 0x7f109414fa20 2023-01-01T17:40:12.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.700+0000 7f1082ffd700 1 -- 172.21.15.61:0/118769869 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108c00ac00 con 0x7f109414fa20 2023-01-01T17:40:12.700 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.700+0000 7f1082ffd700 1 -- 172.21.15.61:0/118769869 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c012400 con 0x7f109414fa20 2023-01-01T17:40:12.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.700+0000 7f1098c65700 1 -- 172.21.15.61:0/118769869 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10940bef20 con 0x7f109414fa20 2023-01-01T17:40:12.701 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.700+0000 7f1098c65700 1 -- 172.21.15.61:0/118769869 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10940c3200 con 0x7f109414fa20 2023-01-01T17:40:12.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.702+0000 7f1082ffd700 1 -- 172.21.15.61:0/118769869 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f108c019030 con 0x7f109414fa20 2023-01-01T17:40:12.703 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.703+0000 7f1082ffd700 1 --2- 172.21.15.61:0/118769869 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f1074063360 0x7f1074065810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.703+0000 7f1082ffd700 1 -- 172.21.15.61:0/118769869 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f108c07f890 con 0x7f109414fa20 2023-01-01T17:40:12.704 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.704+0000 7f109259c700 1 --2- 172.21.15.61:0/118769869 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f1074063360 0x7f1074065810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.705 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.705+0000 7f109259c700 1 --2- 172.21.15.61:0/118769869 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f1074063360 0x7f1074065810 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f10880090b0 tx=0x7f1088008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.707 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.707+0000 7f1098c65700 1 -- 172.21.15.61:0/118769869 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10780052f0 con 0x7f109414fa20 2023-01-01T17:40:12.716 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.716+0000 7f1082ffd700 1 -- 172.21.15.61:0/118769869 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f108c04aa30 con 0x7f109414fa20 2023-01-01T17:40:12.746 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.745+0000 7f03f5226700 1 Processor -- start 2023-01-01T17:40:12.746 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.745+0000 7f03f5226700 1 -- start start 2023-01-01T17:40:12.749 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.746+0000 7f03f5226700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f03f00a3f90 0x7f03f00b7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.750 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.746+0000 7f03f5226700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f03f00bf590 0x7f03f00c1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.750 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.746+0000 7f03f5226700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f00c0e50 con 0x7f03f00c1b60 2023-01-01T17:40:12.750 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.746+0000 7f03f5226700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f006c5b0 con 0x7f03f00bf590 2023-01-01T17:40:12.750 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.746+0000 7f03f5226700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00c4a90 con 0x7f03f00a3f90 2023-01-01T17:40:12.750 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.747+0000 7f03ee59c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f03f00bf590 0x7f03f00c1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.750 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.747+0000 7f03ee59c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f03f00bf590 0x7f03f00c1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46682/0 (socket says 172.21.15.61:46682) 2023-01-01T17:40:12.750 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.747+0000 7f03ee59c700 1 -- 172.21.15.61:0/1061357306 learned_addr learned my addr 172.21.15.61:0/1061357306 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:12.750 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.747+0000 7f03ee59c700 1 -- 172.21.15.61:0/1061357306 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f03f00a3f90 msgr2=0x7f03f00b7910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:40:12.750 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.747+0000 7f03ee59c700 1 --2- 172.21.15.61:0/1061357306 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f03f00a3f90 0x7f03f00b7910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.750 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.747+0000 7f03ee59c700 1 -- 172.21.15.61:0/1061357306 >> v1:172.21.15.61:6789/0 conn(0x7f03f00c1b60 legacy=0x7f03f006ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:12.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.747+0000 7f03ee59c700 1 -- 172.21.15.61:0/1061357306 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f00b8160 con 0x7f03f00bf590 2023-01-01T17:40:12.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.748+0000 7f03ee59c700 1 --2- 172.21.15.61:0/1061357306 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f03f00bf590 0x7f03f00c1620 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f03e00098f0 tx=0x7f03e0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63756384d1dd4010 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.748+0000 7f03edd9b700 1 -- 172.21.15.61:0/1061357306 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e0004230 con 0x7f03f00bf590 2023-01-01T17:40:12.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.748+0000 7f03edd9b700 1 -- 172.21.15.61:0/1061357306 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e0004390 con 0x7f03f00bf590 2023-01-01T17:40:12.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.748+0000 7f03edd9b700 1 -- 172.21.15.61:0/1061357306 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e00036a0 con 0x7f03f00bf590 2023-01-01T17:40:12.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.749+0000 7f03f5226700 1 -- 172.21.15.61:0/1061357306 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f03f00bf590 msgr2=0x7f03f00c1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.749+0000 7f03f5226700 1 --2- 172.21.15.61:0/1061357306 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f03f00bf590 0x7f03f00c1620 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f03e00098f0 tx=0x7f03e0009c00 comp rx=0 tx=0).stop 2023-01-01T17:40:12.751 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.750+0000 7f03f5226700 1 -- 172.21.15.61:0/1061357306 shutdown_connections 2023-01-01T17:40:12.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.750+0000 7f03f5226700 1 --2- 172.21.15.61:0/1061357306 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f03f00a3f90 0x7f03f00b7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.750+0000 7f03f5226700 1 --2- 172.21.15.61:0/1061357306 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f03f00bf590 0x7f03f00c1620 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.752 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.750+0000 7f03f5226700 1 -- 172.21.15.61:0/1061357306 >> 172.21.15.61:0/1061357306 conn(0x7f03f0069fb0 msgr2=0x7f03f00a6740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:12.753 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.753+0000 7f03f5226700 1 -- 172.21.15.61:0/1061357306 shutdown_connections 2023-01-01T17:40:12.754 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.753+0000 7f03f5226700 1 -- 172.21.15.61:0/1061357306 wait complete. 2023-01-01T17:40:12.755 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.755+0000 7f2df3b1d700 1 Processor -- start 2023-01-01T17:40:12.756 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.756+0000 7f2df3b1d700 1 -- start start 2023-01-01T17:40:12.756 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.756+0000 7fd000cc4700 1 Processor -- start 2023-01-01T17:40:12.756 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.756+0000 7f03f5226700 1 Processor -- start 2023-01-01T17:40:12.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.757+0000 7f2df3b1d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f2dec150680 0x7f2dec0713f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.757+0000 7f2df3b1d700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dec0c13e0 con 0x7f2dec06ace0 2023-01-01T17:40:12.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.757+0000 7f2df3b1d700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dec153c00 con 0x7f2dec0c0e50 2023-01-01T17:40:12.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.757+0000 7f2df3b1d700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dec06c9c0 con 0x7f2dec150680 2023-01-01T17:40:12.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.757+0000 7f2df18b9700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f2dec150680 0x7f2dec0713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.757+0000 7f2df20ba700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f2dec06ace0 0x7f2dec06b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40538/0 (socket says 172.21.15.61:40538) 2023-01-01T17:40:12.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.757+0000 7f2df20ba700 1 -- 172.21.15.61:0/2579113863 learned_addr learned my addr 172.21.15.61:0/2579113863 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:40:12.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.756+0000 7fd000cc4700 1 -- start start 2023-01-01T17:40:12.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.757+0000 7fd000cc4700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fcffc0c5470 0x7fcffc0c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.757+0000 7fd000cc4700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcffc0ae3d0 0x7fcffc0c73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.758 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.757+0000 7fd000cc4700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcffc0695d0 con 0x7fcffc157e20 2023-01-01T17:40:12.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.757+0000 7fd000cc4700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcffc15b320 con 0x7fcffc0c5470 2023-01-01T17:40:12.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.757+0000 7fd000cc4700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc069870 con 0x7fcffc0ae3d0 2023-01-01T17:40:12.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.758+0000 7f2df08b7700 1 -- 172.21.15.61:0/2579113863 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2789513000 0 0) 0x7f2dec0c13e0 con 0x7f2dec06ace0 2023-01-01T17:40:12.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.758+0000 7f2df08b7700 1 -- 172.21.15.61:0/2579113863 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dd80035b0 con 0x7f2dec06ace0 2023-01-01T17:40:12.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.758+0000 7fcffa59c700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fcffc157e20 0x7fcffc069f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40542/0 (socket says 172.21.15.61:40542) 2023-01-01T17:40:12.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.758+0000 7fcffa59c700 1 -- 172.21.15.61:0/3927643756 learned_addr learned my addr 172.21.15.61:0/3927643756 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:40:12.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.756+0000 7f03f5226700 1 -- start start 2023-01-01T17:40:12.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.757+0000 7f03f5226700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f03f00a3f90 0x7f03f01eca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.757+0000 7f03f5226700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03f00bf590 0x7f03f0154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.757+0000 7f03f5226700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f03f00c1b60 0x7f03f01ea130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.757+0000 7f03f5226700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f01505a0 con 0x7f03f00a3f90 2023-01-01T17:40:12.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.757+0000 7f03f5226700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00a61f0 con 0x7f03f00bf590 2023-01-01T17:40:12.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.757+0000 7f03f5226700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f01ea670 con 0x7f03f00c1b60 2023-01-01T17:40:12.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.758+0000 7f03ee59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03f00bf590 0x7f03f0154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.758+0000 7f03ee59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03f00bf590 0x7f03f0154aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.61:42532/0 (socket says 172.21.15.61:42532) 2023-01-01T17:40:12.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.758+0000 7f03ee59c700 1 -- 172.21.15.61:0/3405281924 learned_addr learned my addr 172.21.15.61:0/3405281924 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:12.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.758+0000 7f03eed9d700 1 --2- 172.21.15.61:0/3405281924 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f03f00a3f90 0x7f03f01eca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.758+0000 7f03ef59e700 1 --2- 172.21.15.61:0/3405281924 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f03f00c1b60 0x7f03f01ea130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.758+0000 7f2df08b7700 1 -- 172.21.15.61:0/2579113863 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 378841168 0 0) 0x7f2dd80035b0 con 0x7f2dec06ace0 2023-01-01T17:40:12.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.758+0000 7f2df08b7700 1 -- 172.21.15.61:0/2579113863 >> v2:172.21.15.61:3300/0 conn(0x7f2dec150680 msgr2=0x7f2dec0713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:12.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.758+0000 7f2df08b7700 1 --2- 172.21.15.61:0/2579113863 >> v2:172.21.15.61:3300/0 conn(0x7f2dec150680 0x7f2dec0713f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.758+0000 7f2df08b7700 1 -- 172.21.15.61:0/2579113863 >> v1:172.21.15.149:6789/0 conn(0x7f2dec0c0e50 legacy=0x7f2dec0c1620 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-01-01T17:40:12.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.758+0000 7f2df08b7700 1 -- 172.21.15.61:0/2579113863 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dec153ee0 con 0x7f2dec06ace0 2023-01-01T17:40:12.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.758+0000 7f2df08b7700 1 -- 172.21.15.61:0/2579113863 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586489653 0 0) 0x7f2de8001670 con 0x7f2dec06ace0 2023-01-01T17:40:12.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.758+0000 7f4056a34700 1 Processor -- start 2023-01-01T17:40:12.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.758+0000 7f2df08b7700 1 -- 172.21.15.61:0/2579113863 >> v1:172.21.15.61:6789/0 conn(0x7f2dec06ace0 legacy=0x7f2dec06b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.758+0000 7f2df08b7700 1 --2- 172.21.15.61:0/2579113863 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2dd8003a50 0x7f2dd8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.758+0000 7f2df08b7700 1 --2- 172.21.15.61:0/2579113863 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dd8004850 0x7f2dd8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.758+0000 7f2df08b7700 1 --2- 172.21.15.61:0/2579113863 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2dd8005200 0x7f2dd800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.762 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.758+0000 7f2df08b7700 1 -- 172.21.15.61:0/2579113863 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec06c9c0 con 0x7f2dd8005200 2023-01-01T17:40:12.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.758+0000 7f2df08b7700 1 -- 172.21.15.61:0/2579113863 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd800c0c0 con 0x7f2dd8004850 2023-01-01T17:40:12.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.758+0000 7f2df08b7700 1 -- 172.21.15.61:0/2579113863 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd800c280 con 0x7f2dd8003a50 2023-01-01T17:40:12.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.758+0000 7f4056a34700 1 -- start start 2023-01-01T17:40:12.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.758+0000 7f2df10b8700 1 --2- 172.21.15.61:0/2579113863 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dd8004850 0x7f2dd8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.763 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.758+0000 7f03eed9d700 1 -- 172.21.15.61:0/3405281924 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f03f00c1b60 msgr2=0x7f03f01ea130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.758+0000 7f03eed9d700 1 --2- 172.21.15.61:0/3405281924 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f03f00c1b60 0x7f03f01ea130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.758+0000 7f03eed9d700 1 -- 172.21.15.61:0/3405281924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03f00bf590 msgr2=0x7f03f0154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.758+0000 7f03eed9d700 1 --2- 172.21.15.61:0/3405281924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03f00bf590 0x7f03f0154aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.758+0000 7f03eed9d700 1 -- 172.21.15.61:0/3405281924 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e0009550 con 0x7f03f00a3f90 2023-01-01T17:40:12.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.758+0000 7f03ee59c700 1 --2- 172.21.15.61:0/3405281924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03f00bf590 0x7f03f0154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-01T17:40:12.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.758+0000 7f03ef59e700 1 --2- 172.21.15.61:0/3405281924 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f03f00c1b60 0x7f03f01ea130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-01T17:40:12.764 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.759+0000 7f2df20ba700 1 --2- 172.21.15.61:0/2579113863 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2dd8005200 0x7f2dd800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.765 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.759+0000 7fcff959a700 1 -- 172.21.15.61:0/3927643756 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1696704410 0 0) 0x7fcffc0695d0 con 0x7fcffc157e20 2023-01-01T17:40:12.765 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.759+0000 7fcff959a700 1 -- 172.21.15.61:0/3927643756 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfe40035b0 con 0x7fcffc157e20 2023-01-01T17:40:12.765 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.759+0000 7f03eed9d700 1 --2- 172.21.15.61:0/3405281924 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f03f00a3f90 0x7f03f01eca20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f03e4009fd0 tx=0x7f03e400b770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.765 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.759+0000 7fcff959a700 1 -- 172.21.15.61:0/3927643756 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4011085572 0 0) 0x7fcfe40035b0 con 0x7fcffc157e20 2023-01-01T17:40:12.766 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.759+0000 7fcff959a700 1 -- 172.21.15.61:0/3927643756 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcffc0ae3d0 msgr2=0x7fcffc0c73b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:40:12.766 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.759+0000 7fcff959a700 1 --2- 172.21.15.61:0/3927643756 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcffc0ae3d0 0x7fcffc0c73b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.766 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.759+0000 7fcff959a700 1 -- 172.21.15.61:0/3927643756 >> v2:172.21.15.149:3300/0 conn(0x7fcffc0c5470 msgr2=0x7fcffc0c6e70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:40:12.766 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.759+0000 7fcff959a700 1 --2- 172.21.15.61:0/3927643756 >> v2:172.21.15.149:3300/0 conn(0x7fcffc0c5470 0x7fcffc0c6e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.766 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.759+0000 7fcff959a700 1 -- 172.21.15.61:0/3927643756 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcffc069b50 con 0x7fcffc157e20 2023-01-01T17:40:12.766 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.759+0000 7fcff959a700 1 -- 172.21.15.61:0/3927643756 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586489653 0 0) 0x7fcff40019f0 con 0x7fcffc157e20 2023-01-01T17:40:12.766 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.759+0000 7fcff959a700 1 -- 172.21.15.61:0/3927643756 >> v1:172.21.15.61:6789/0 conn(0x7fcffc157e20 legacy=0x7fcffc069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.766 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.759+0000 7fcff959a700 1 --2- 172.21.15.61:0/3927643756 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcfe4003a00 0x7fcfe4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.766 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.759+0000 7fcff959a700 1 --2- 172.21.15.61:0/3927643756 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcfe4004850 0x7fcfe4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.766 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.759+0000 7fcff959a700 1 --2- 172.21.15.61:0/3927643756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcfe40052d0 0x7fcfe400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.766 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.759+0000 7fcff959a700 1 -- 172.21.15.61:0/3927643756 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc15b320 con 0x7fcfe4004850 2023-01-01T17:40:12.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.759+0000 7f2df10b8700 1 -- 172.21.15.61:0/2579113863 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2dd8003a50 msgr2=0x7f2dd8003e40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-01-01T17:40:12.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.759+0000 7f2df10b8700 1 --2- 172.21.15.61:0/2579113863 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2dd8003a50 0x7f2dd8003e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.759+0000 7f2df10b8700 1 -- 172.21.15.61:0/2579113863 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2dd8005200 msgr2=0x7f2dd800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:12.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.759+0000 7f2df10b8700 1 --2- 172.21.15.61:0/2579113863 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2dd8005200 0x7f2dd800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.759+0000 7f2df10b8700 1 -- 172.21.15.61:0/2579113863 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd80035b0 con 0x7f2dd8004850 2023-01-01T17:40:12.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.759+0000 7fcff959a700 1 -- 172.21.15.61:0/3927643756 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc069870 con 0x7fcfe40052d0 2023-01-01T17:40:12.767 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.759+0000 7fcff959a700 1 -- 172.21.15.61:0/3927643756 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe400c260 con 0x7fcfe4003a00 2023-01-01T17:40:12.768 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.759+0000 7f4056a34700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4050157050 0x7f405015e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.768 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.759+0000 7f4056a34700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f405006f1e0 con 0x7f405006a640 2023-01-01T17:40:12.768 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.759+0000 7f4056a34700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40500716e0 con 0x7f40500c1ad0 2023-01-01T17:40:12.768 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.759+0000 7f4056a34700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f405006f710 con 0x7f4050157050 2023-01-01T17:40:12.768 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.760+0000 7f2df20ba700 1 -- 172.21.15.61:0/2579113863 reap_dead start 2023-01-01T17:40:12.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.759+0000 7f03d77fe700 1 -- 172.21.15.61:0/3405281924 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e4011830 con 0x7f03f00a3f90 2023-01-01T17:40:12.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.760+0000 7f03d77fe700 1 -- 172.21.15.61:0/3405281924 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e40119b0 con 0x7f03f00a3f90 2023-01-01T17:40:12.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.760+0000 7f03d77fe700 1 -- 172.21.15.61:0/3405281924 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e4011d60 con 0x7f03f00a3f90 2023-01-01T17:40:12.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.760+0000 7f03f5226700 1 -- 172.21.15.61:0/3405281924 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f0158010 con 0x7f03f00a3f90 2023-01-01T17:40:12.769 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.760+0000 7f03f5226700 1 -- 172.21.15.61:0/3405281924 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f00c1080 con 0x7f03f00a3f90 2023-01-01T17:40:12.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.760+0000 7f2df10b8700 1 --2- 172.21.15.61:0/2579113863 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dd8004850 0x7f2dd8004cc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2de4009e60 tx=0x7f2dd8005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec417cf6cde4073a server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.760+0000 7f404ffff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f405006a640 0x7f4050152de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40562/0 (socket says 172.21.15.61:40562) 2023-01-01T17:40:12.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.760+0000 7f404ffff700 1 -- 172.21.15.61:0/1035737857 learned_addr learned my addr 172.21.15.61:0/1035737857 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:40:12.770 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.760+0000 7f2df08b7700 1 -- 172.21.15.61:0/2579113863 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de400baa0 con 0x7f2dd8004850 2023-01-01T17:40:12.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.760+0000 7f4054fd1700 1 --2- 172.21.15.61:0/1035737857 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4050157050 0x7f405015e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.760+0000 7f2df08b7700 1 -- 172.21.15.61:0/2579113863 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de400bc20 con 0x7f2dd8004850 2023-01-01T17:40:12.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.760+0000 7f2df08b7700 1 -- 172.21.15.61:0/2579113863 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de4015420 con 0x7f2dd8004850 2023-01-01T17:40:12.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.761+0000 7f2df3b1d700 1 -- 172.21.15.61:0/2579113863 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dd8004850 msgr2=0x7f2dd8004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.761+0000 7f2df3b1d700 1 --2- 172.21.15.61:0/2579113863 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dd8004850 0x7f2dd8004cc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2de4009e60 tx=0x7f2dd8005880 comp rx=0 tx=0).stop 2023-01-01T17:40:12.771 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.761+0000 7fcffad9d700 1 --2- 172.21.15.61:0/3927643756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcfe40052d0 0x7fcfe400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.761+0000 7f3b8e3b9700 1 Processor -- start 2023-01-01T17:40:12.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.762+0000 7f2df3b1d700 1 -- 172.21.15.61:0/2579113863 shutdown_connections 2023-01-01T17:40:12.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.762+0000 7f2df3b1d700 1 --2- 172.21.15.61:0/2579113863 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dd8004850 0x7f2dd8004cc0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.772 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.762+0000 7f2df3b1d700 1 -- 172.21.15.61:0/2579113863 >> 172.21.15.61:0/2579113863 conn(0x7f2dec069fb0 msgr2=0x7f2dec0a6740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:12.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.762+0000 7f4054fd1700 1 -- 172.21.15.61:0/1035737857 >> v1:172.21.15.149:6789/0 conn(0x7f40500c1ad0 legacy=0x7f405014ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.773 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.762+0000 7f4054fd1700 1 -- 172.21.15.61:0/1035737857 >> v1:172.21.15.61:6789/0 conn(0x7f405006a640 legacy=0x7f4050152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.762+0000 7f4054fd1700 1 -- 172.21.15.61:0/1035737857 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405006dba0 con 0x7f4050157050 2023-01-01T17:40:12.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.762+0000 7fcffad9d700 1 -- 172.21.15.61:0/3927643756 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcfe4003a00 msgr2=0x7fcfe4003e10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-01-01T17:40:12.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.762+0000 7fcffad9d700 1 --2- 172.21.15.61:0/3927643756 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcfe4003a00 0x7fcfe4003e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.774 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.762+0000 7fcffad9d700 1 -- 172.21.15.61:0/3927643756 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcfe4004850 msgr2=0x7fcfe4004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:12.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.762+0000 7fcffad9d700 1 --2- 172.21.15.61:0/3927643756 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcfe4004850 0x7fcfe4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.762+0000 7fcffad9d700 1 -- 172.21.15.61:0/3927643756 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcffc069b50 con 0x7fcfe40052d0 2023-01-01T17:40:12.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.762+0000 7fcffad9d700 1 --2- 172.21.15.61:0/3927643756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcfe40052d0 0x7fcfe400ba10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcfec006fd0 tx=0x7fcfe4005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aeee6d0692bb6a3 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.762+0000 7fcff959a700 1 -- 172.21.15.61:0/3927643756 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec011420 con 0x7fcfe40052d0 2023-01-01T17:40:12.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.762+0000 7fcff959a700 1 -- 172.21.15.61:0/3927643756 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfec011580 con 0x7fcfe40052d0 2023-01-01T17:40:12.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.762+0000 7fcff959a700 1 -- 172.21.15.61:0/3927643756 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec011930 con 0x7fcfe40052d0 2023-01-01T17:40:12.775 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.762+0000 7f3b8e3b9700 1 -- start start 2023-01-01T17:40:12.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.763+0000 7f3b8e3b9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3b880a4220 0x7f3b8806c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.763+0000 7f3b8e3b9700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3b8806b380 0x7f3b880c0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.763+0000 7f3b8e3b9700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b880bf590 con 0x7f3b880b7ef0 2023-01-01T17:40:12.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.763+0000 7f3b8e3b9700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b88157fb0 con 0x7f3b8806b380 2023-01-01T17:40:12.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.763+0000 7f3b8e3b9700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b880bfac0 con 0x7f3b880a4220 2023-01-01T17:40:12.776 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.762+0000 7f03d77fe700 1 -- 172.21.15.61:0/3405281924 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f03e4021070 con 0x7f03f00a3f90 2023-01-01T17:40:12.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.762+0000 7f03d77fe700 1 --2- 172.21.15.61:0/3405281924 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f03dc063360 0x7f03dc065810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.763+0000 7f03d77fe700 1 -- 172.21.15.61:0/3405281924 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f03e407fbb0 con 0x7f03f00a3f90 2023-01-01T17:40:12.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.763+0000 7f03ee59c700 1 --2- 172.21.15.61:0/3405281924 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f03dc063360 0x7f03dc065810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.777 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.763+0000 7f2df3b1d700 1 -- 172.21.15.61:0/2579113863 shutdown_connections 2023-01-01T17:40:12.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.763+0000 7fd000cc4700 1 -- 172.21.15.61:0/3927643756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcfe40052d0 msgr2=0x7fcfe400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.763+0000 7fd000cc4700 1 --2- 172.21.15.61:0/3927643756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcfe40052d0 0x7fcfe400ba10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcfec006fd0 tx=0x7fcfe4005880 comp rx=0 tx=0).stop 2023-01-01T17:40:12.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.763+0000 7fcffad9d700 1 -- 172.21.15.61:0/3927643756 reap_dead start 2023-01-01T17:40:12.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.763+0000 7f3b8c956700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3b8806b380 0x7f3b880c0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.778 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.764+0000 7f3b8c956700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3b8806b380 0x7f3b880c0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46720/0 (socket says 172.21.15.61:46720) 2023-01-01T17:40:12.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.764+0000 7f3b8c956700 1 -- 172.21.15.61:0/4205471793 learned_addr learned my addr 172.21.15.61:0/4205471793 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:12.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.764+0000 7fd000cc4700 1 -- 172.21.15.61:0/3927643756 shutdown_connections 2023-01-01T17:40:12.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.764+0000 7fd000cc4700 1 -- 172.21.15.61:0/3927643756 >> 172.21.15.61:0/3927643756 conn(0x7fcffc0c58f0 msgr2=0x7fcffc0c5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:12.779 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.764+0000 7f03f5226700 1 -- 172.21.15.61:0/3405281924 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03d00052f0 con 0x7f03f00a3f90 2023-01-01T17:40:12.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.764+0000 7f03ee59c700 1 --2- 172.21.15.61:0/3405281924 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f03dc063360 0x7f03dc065810 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f03f015b870 tx=0x7f03e0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.764+0000 7f3b8c956700 1 -- 172.21.15.61:0/4205471793 >> v2:172.21.15.149:3300/0 conn(0x7f3b880a4220 msgr2=0x7f3b8806c6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-01-01T17:40:12.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.764+0000 7f3b8c956700 1 --2- 172.21.15.61:0/4205471793 >> v2:172.21.15.149:3300/0 conn(0x7f3b880a4220 0x7f3b8806c6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.764+0000 7f3b8c956700 1 -- 172.21.15.61:0/4205471793 >> v1:172.21.15.149:6789/0 conn(0x7f3b880b7ef0 legacy=0x7f3b8806ac70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-01-01T17:40:12.780 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.764+0000 7f3b8c956700 1 -- 172.21.15.61:0/4205471793 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b880c1cd0 con 0x7f3b8806b380 2023-01-01T17:40:12.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.764+0000 7f2df3b1d700 1 -- 172.21.15.61:0/2579113863 wait complete. 2023-01-01T17:40:12.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.765+0000 7f2df3b1d700 1 Processor -- start 2023-01-01T17:40:12.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.766+0000 7f2df3b1d700 1 -- start start 2023-01-01T17:40:12.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.762+0000 7f4054fd1700 1 --2- 172.21.15.61:0/1035737857 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4050157050 0x7f405015e770 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4048009df0 tx=0x7f404800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73db853ad2a37324 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.781 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.762+0000 7f404effd700 1 -- 172.21.15.61:0/1035737857 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404800e070 con 0x7f4050157050 2023-01-01T17:40:12.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.762+0000 7f404effd700 1 -- 172.21.15.61:0/1035737857 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404800bad0 con 0x7f4050157050 2023-01-01T17:40:12.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.762+0000 7f404effd700 1 -- 172.21.15.61:0/1035737857 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404800be60 con 0x7f4050157050 2023-01-01T17:40:12.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.763+0000 7f4056a34700 1 -- 172.21.15.61:0/1035737857 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4050157050 msgr2=0x7f405015e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.763+0000 7f4056a34700 1 --2- 172.21.15.61:0/1035737857 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4050157050 0x7f405015e770 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4048009df0 tx=0x7f404800b330 comp rx=0 tx=0).stop 2023-01-01T17:40:12.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.764+0000 7f4056a34700 1 -- 172.21.15.61:0/1035737857 shutdown_connections 2023-01-01T17:40:12.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.764+0000 7f4056a34700 1 --2- 172.21.15.61:0/1035737857 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4050157050 0x7f405015e770 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.764+0000 7f4056a34700 1 -- 172.21.15.61:0/1035737857 >> 172.21.15.61:0/1035737857 conn(0x7f40500c1f30 msgr2=0x7f40500c2330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:12.782 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.765+0000 7fd000cc4700 1 -- 172.21.15.61:0/3927643756 shutdown_connections 2023-01-01T17:40:12.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.765+0000 7f3b8c956700 1 --2- 172.21.15.61:0/4205471793 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3b8806b380 0x7f3b880c0f90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3b88071b90 tx=0x7f3b8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68fd6ac586e5a187 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.765+0000 7fd000cc4700 1 -- 172.21.15.61:0/3927643756 wait complete. 2023-01-01T17:40:12.783 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.766+0000 7f4056a34700 1 -- 172.21.15.61:0/1035737857 shutdown_connections 2023-01-01T17:40:12.784 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.767+0000 7fd000cc4700 1 Processor -- start 2023-01-01T17:40:12.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.767+0000 7f2df3b1d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2dd8004850 0x7f2dec0be120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.767+0000 7f2df3b1d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dec0aa690 0x7f2dec0a80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.767+0000 7f2df3b1d700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2dec0a85e0 0x7f2dec1e85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.767+0000 7f2df3b1d700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec1e8190 con 0x7f2dd8004850 2023-01-01T17:40:12.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.767+0000 7f2df3b1d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec154760 con 0x7f2dec0aa690 2023-01-01T17:40:12.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.767+0000 7f2df3b1d700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec1549b0 con 0x7f2dec0a85e0 2023-01-01T17:40:12.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.767+0000 7f2df18b9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2dd8004850 0x7f2dec0be120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.785 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.767+0000 7f2df18b9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2dd8004850 0x7f2dec0be120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46726/0 (socket says 172.21.15.61:46726) 2023-01-01T17:40:12.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.767+0000 7f2df18b9700 1 -- 172.21.15.61:0/730373438 learned_addr learned my addr 172.21.15.61:0/730373438 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:12.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.768+0000 7f2df10b8700 1 --2- 172.21.15.61:0/730373438 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dec0aa690 0x7f2dec0a80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.768+0000 7f2df20ba700 1 --2- 172.21.15.61:0/730373438 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2dec0a85e0 0x7f2dec1e85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.767+0000 7fd000cc4700 1 -- start start 2023-01-01T17:40:12.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.768+0000 7fd000cc4700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcfe40052d0 0x7fcffc148d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.768+0000 7fd000cc4700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcffc162220 0x7fcffc14de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.786 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.768+0000 7fd000cc4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcffc14e350 0x7fcffc0a8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.766+0000 7f4056a34700 1 -- 172.21.15.61:0/1035737857 wait complete. 2023-01-01T17:40:12.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.768+0000 7fd000cc4700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc149290 con 0x7fcffc162220 2023-01-01T17:40:12.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.768+0000 7fd000cc4700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc14c460 con 0x7fcffc14e350 2023-01-01T17:40:12.787 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.768+0000 7fd000cc4700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc14b850 con 0x7fcfe40052d0 2023-01-01T17:40:12.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.768+0000 7f4056a34700 1 Processor -- start 2023-01-01T17:40:12.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.768+0000 7f2df18b9700 1 -- 172.21.15.61:0/730373438 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2dec0a85e0 msgr2=0x7f2dec1e85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.768+0000 7f2df18b9700 1 --2- 172.21.15.61:0/730373438 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2dec0a85e0 0x7f2dec1e85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.768+0000 7f2df18b9700 1 -- 172.21.15.61:0/730373438 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dec0aa690 msgr2=0x7f2dec0a80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.768+0000 7f2df18b9700 1 --2- 172.21.15.61:0/730373438 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dec0aa690 0x7f2dec0a80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.788 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.768+0000 7f2df18b9700 1 -- 172.21.15.61:0/730373438 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dec150a50 con 0x7f2dd8004850 2023-01-01T17:40:12.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.768+0000 7fcff9d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcffc162220 0x7fcffc14de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.768+0000 7fcff9d9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcffc162220 0x7fcffc14de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46734/0 (socket says 172.21.15.61:46734) 2023-01-01T17:40:12.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.768+0000 7fcff9d9b700 1 -- 172.21.15.61:0/3023725539 learned_addr learned my addr 172.21.15.61:0/3023725539 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:12.789 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.769+0000 7fcffa59c700 1 --2- 172.21.15.61:0/3023725539 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcfe40052d0 0x7fcffc148d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.769+0000 7f2df18b9700 1 --2- 172.21.15.61:0/730373438 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2dd8004850 0x7f2dec0be120 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc00e8e0 tx=0x7f2ddc00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.769+0000 7fcff9d9b700 1 -- 172.21.15.61:0/3023725539 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcfe40052d0 msgr2=0x7fcffc148d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.769+0000 7fcff9d9b700 1 --2- 172.21.15.61:0/3023725539 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcfe40052d0 0x7fcffc148d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.769+0000 7fcff9d9b700 1 -- 172.21.15.61:0/3023725539 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcffc14e350 msgr2=0x7fcffc0a8a40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-01-01T17:40:12.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.769+0000 7fcff9d9b700 1 --2- 172.21.15.61:0/3023725539 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcffc14e350 0x7fcffc0a8a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.790 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.769+0000 7fcff9d9b700 1 -- 172.21.15.61:0/3023725539 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcffc1581f0 con 0x7fcffc162220 2023-01-01T17:40:12.791 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.768+0000 7f4056a34700 1 -- start start 2023-01-01T17:40:12.791 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.769+0000 7fcff9d9b700 1 --2- 172.21.15.61:0/3023725539 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcffc162220 0x7fcffc14de10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcff000b450 tx=0x7fcff000b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.792 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.769+0000 7f4056a34700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f405006a640 0x7f40501f0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.792 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.770+0000 7f4056a34700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f40500c1ad0 0x7f405014d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.792 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.770+0000 7f4056a34700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4050157050 0x7f405014d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.792 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.770+0000 7f4056a34700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40500a9a30 con 0x7f40500c1ad0 2023-01-01T17:40:12.792 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.770+0000 7f4056a34700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405006d980 con 0x7f405006a640 2023-01-01T17:40:12.792 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.770+0000 7f4056a34700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40500a9120 con 0x7f4050157050 2023-01-01T17:40:12.793 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.770+0000 7f404f7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f40500c1ad0 0x7f405014d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.793 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.770+0000 7f404f7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f40500c1ad0 0x7f405014d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46738/0 (socket says 172.21.15.61:46738) 2023-01-01T17:40:12.793 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.770+0000 7f404f7fe700 1 -- 172.21.15.61:0/3418847726 learned_addr learned my addr 172.21.15.61:0/3418847726 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:12.793 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.770+0000 7f4054fd1700 1 --2- 172.21.15.61:0/3418847726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4050157050 0x7f405014d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.793 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.770+0000 7f404f7fe700 1 -- 172.21.15.61:0/3418847726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4050157050 msgr2=0x7f405014d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.793 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.770+0000 7f404f7fe700 1 --2- 172.21.15.61:0/3418847726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4050157050 0x7f405014d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.793 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.770+0000 7f404f7fe700 1 -- 172.21.15.61:0/3418847726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f405006a640 msgr2=0x7f40501f0390 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-01-01T17:40:12.793 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.770+0000 7f404f7fe700 1 --2- 172.21.15.61:0/3418847726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f405006a640 0x7f40501f0390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.793 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.770+0000 7f404f7fe700 1 -- 172.21.15.61:0/3418847726 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4048009a70 con 0x7f40500c1ad0 2023-01-01T17:40:12.794 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.770+0000 7f4054fd1700 1 --2- 172.21.15.61:0/3418847726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4050157050 0x7f405014d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-01-01T17:40:12.794 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.770+0000 7f404f7fe700 1 --2- 172.21.15.61:0/3418847726 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f40500c1ad0 0x7f405014d490 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f404000c730 tx=0x7f404000ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.794 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.772+0000 7fcfeaffd700 1 -- 172.21.15.61:0/3023725539 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff0011830 con 0x7fcffc162220 2023-01-01T17:40:12.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.772+0000 7f3b86ffd700 1 -- 172.21.15.61:0/4205471793 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8000e070 con 0x7f3b8806b380 2023-01-01T17:40:12.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.772+0000 7f03d77fe700 1 -- 172.21.15.61:0/3405281924 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f03e4015020 con 0x7f03f00a3f90 2023-01-01T17:40:12.795 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.772+0000 7f2de27fc700 1 -- 172.21.15.61:0/730373438 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc013680 con 0x7f2dd8004850 2023-01-01T17:40:12.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.772+0000 7f404cff9700 1 -- 172.21.15.61:0/3418847726 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40400054e0 con 0x7f40500c1ad0 2023-01-01T17:40:12.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.772+0000 7f404cff9700 1 -- 172.21.15.61:0/3418847726 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4040003680 con 0x7f40500c1ad0 2023-01-01T17:40:12.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.772+0000 7f404cff9700 1 -- 172.21.15.61:0/3418847726 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4040003a30 con 0x7f40500c1ad0 2023-01-01T17:40:12.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.772+0000 7fd000cc4700 1 -- 172.21.15.61:0/3023725539 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcffc15b600 con 0x7fcffc162220 2023-01-01T17:40:12.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.772+0000 7fd000cc4700 1 -- 172.21.15.61:0/3023725539 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcffc06a640 con 0x7fcffc162220 2023-01-01T17:40:12.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.772+0000 7fcfeaffd700 1 -- 172.21.15.61:0/3023725539 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff0011990 con 0x7fcffc162220 2023-01-01T17:40:12.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.772+0000 7fcfeaffd700 1 -- 172.21.15.61:0/3023725539 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff0011d00 con 0x7fcffc162220 2023-01-01T17:40:12.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.772+0000 7f2de27fc700 1 -- 172.21.15.61:0/730373438 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ddc0137e0 con 0x7f2dd8004850 2023-01-01T17:40:12.797 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.772+0000 7f2de27fc700 1 -- 172.21.15.61:0/730373438 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc013b70 con 0x7f2dd8004850 2023-01-01T17:40:12.798 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.772+0000 7f3b86ffd700 1 -- 172.21.15.61:0/4205471793 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b80003a20 con 0x7f3b8806b380 2023-01-01T17:40:12.798 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.772+0000 7f3b86ffd700 1 -- 172.21.15.61:0/4205471793 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b80003dd0 con 0x7f3b8806b380 2023-01-01T17:40:12.798 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.774+0000 7f3b8e3b9700 1 -- 172.21.15.61:0/4205471793 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3b8806b380 msgr2=0x7f3b880c0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.798 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.774+0000 7f3b8e3b9700 1 --2- 172.21.15.61:0/4205471793 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3b8806b380 0x7f3b880c0f90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3b88071b90 tx=0x7f3b8000b330 comp rx=0 tx=0).stop 2023-01-01T17:40:12.798 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.774+0000 7f3b8e3b9700 1 -- 172.21.15.61:0/4205471793 shutdown_connections 2023-01-01T17:40:12.798 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.774+0000 7f3b8e3b9700 1 --2- 172.21.15.61:0/4205471793 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3b8806b380 0x7f3b880c0f90 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.798 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.774+0000 7f3b8e3b9700 1 --2- 172.21.15.61:0/4205471793 >> v2:172.21.15.149:3300/0 conn(0x7f3b880a4220 0x7f3b8806c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.798 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.774+0000 7f3b8e3b9700 1 -- 172.21.15.61:0/4205471793 >> 172.21.15.61:0/4205471793 conn(0x7f3b880a6740 msgr2=0x7f3b880a6b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:12.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.774+0000 7f4056a34700 1 -- 172.21.15.61:0/3418847726 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4050156570 con 0x7f40500c1ad0 2023-01-01T17:40:12.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.775+0000 7f4056a34700 1 -- 172.21.15.61:0/3418847726 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f405006f430 con 0x7f40500c1ad0 2023-01-01T17:40:12.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.774+0000 7fcfeaffd700 1 -- 172.21.15.61:0/3023725539 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7fcff0021070 con 0x7fcffc162220 2023-01-01T17:40:12.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.775+0000 7fd000cc4700 1 -- 172.21.15.61:0/3023725539 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe00052f0 con 0x7fcffc162220 2023-01-01T17:40:12.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.775+0000 7fcfeaffd700 1 --2- 172.21.15.61:0/3023725539 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fcfdc063260 0x7fcfdc065710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.775+0000 7fcfeaffd700 1 -- 172.21.15.61:0/3023725539 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcff007fa10 con 0x7fcffc162220 2023-01-01T17:40:12.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.776+0000 7fcffa59c700 1 --2- 172.21.15.61:0/3023725539 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fcfdc063260 0x7fcfdc065710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.776+0000 7f3b8e3b9700 1 -- 172.21.15.61:0/4205471793 shutdown_connections 2023-01-01T17:40:12.800 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.776+0000 7f3b8e3b9700 1 -- 172.21.15.61:0/4205471793 wait complete. 2023-01-01T17:40:12.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.776+0000 7f404cff9700 1 -- 172.21.15.61:0/3418847726 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f4040019030 con 0x7f40500c1ad0 2023-01-01T17:40:12.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.777+0000 7f404cff9700 1 --2- 172.21.15.61:0/3418847726 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f403c063310 0x7f403c0657c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.777+0000 7f404ffff700 1 --2- 172.21.15.61:0/3418847726 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f403c063310 0x7f403c0657c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.801 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.778+0000 7f3b8e3b9700 1 Processor -- start 2023-01-01T17:40:12.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.778+0000 7f404ffff700 1 --2- 172.21.15.61:0/3418847726 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f403c063310 0x7f403c0657c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4044001560 tx=0x7f4044007ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.778+0000 7f3b8e3b9700 1 -- start start 2023-01-01T17:40:12.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.779+0000 7f2df3b1d700 1 -- 172.21.15.61:0/730373438 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dec06c5e0 con 0x7f2dd8004850 2023-01-01T17:40:12.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.779+0000 7f2df3b1d700 1 -- 172.21.15.61:0/730373438 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dec0bf720 con 0x7f2dd8004850 2023-01-01T17:40:12.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.779+0000 7fcffa59c700 1 --2- 172.21.15.61:0/3023725539 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fcfdc063260 0x7fcfdc065710 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcff4001b20 tx=0x7fcff4001ef0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.779+0000 7f3b8e3b9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b8806b380 0x7f3b880a85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.779+0000 7f3b8e3b9700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3b880a4220 0x7f3b88144af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.779+0000 7f3b8e3b9700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b880b7ef0 0x7f3b881556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.779+0000 7f3b8e3b9700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b880a9410 con 0x7f3b880a4220 2023-01-01T17:40:12.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.779+0000 7f3b8e3b9700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b880c53b0 con 0x7f3b8806b380 2023-01-01T17:40:12.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.779+0000 7f3b8e3b9700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b880a5750 con 0x7f3b880b7ef0 2023-01-01T17:40:12.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.779+0000 7f3b87fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b8806b380 0x7f3b880a85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.779+0000 7f3b87fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b8806b380 0x7f3b880a85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.61:42584/0 (socket says 172.21.15.61:42584) 2023-01-01T17:40:12.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.779+0000 7f3b87fff700 1 -- 172.21.15.61:0/90632244 learned_addr learned my addr 172.21.15.61:0/90632244 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:12.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.780+0000 7f4056a34700 1 -- 172.21.15.61:0/3418847726 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4050156850 con 0x7f40500c1ad0 2023-01-01T17:40:12.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.780+0000 7f2df3b1d700 1 -- 172.21.15.61:0/730373438 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dec0a89b0 con 0x7f2dd8004850 2023-01-01T17:40:12.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.782+0000 7f3b8c956700 1 --2- 172.21.15.61:0/90632244 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b880b7ef0 0x7f3b881556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.782+0000 7f3b877fe700 1 --2- 172.21.15.61:0/90632244 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3b880a4220 0x7f3b88144af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.782+0000 7f3b877fe700 1 -- 172.21.15.61:0/90632244 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b880b7ef0 msgr2=0x7f3b881556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.806 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.782+0000 7f3b877fe700 1 --2- 172.21.15.61:0/90632244 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b880b7ef0 0x7f3b881556a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.806 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.782+0000 7f3b877fe700 1 -- 172.21.15.61:0/90632244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b8806b380 msgr2=0x7f3b880a85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.806 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.782+0000 7f3b877fe700 1 --2- 172.21.15.61:0/90632244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b8806b380 0x7f3b880a85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.806 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.782+0000 7f3b877fe700 1 -- 172.21.15.61:0/90632244 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b80009b30 con 0x7f3b880a4220 2023-01-01T17:40:12.806 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.782+0000 7fcfeaffd700 1 -- 172.21.15.61:0/3023725539 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7fcff0052200 con 0x7fcffc162220 2023-01-01T17:40:12.806 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.783+0000 7f3b877fe700 1 --2- 172.21.15.61:0/90632244 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3b880a4220 0x7f3b88144af0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3b7800b410 tx=0x7f3b78009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.785+0000 7f404cff9700 1 -- 172.21.15.61:0/3418847726 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4040052050 con 0x7f40500c1ad0 2023-01-01T17:40:12.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.786+0000 7f2de27fc700 1 -- 172.21.15.61:0/730373438 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f2ddc019030 con 0x7f2dd8004850 2023-01-01T17:40:12.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.787+0000 7f2de27fc700 1 --2- 172.21.15.61:0/730373438 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f2dd0063290 0x7f2dd0065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.787+0000 7f2de27fc700 1 -- 172.21.15.61:0/730373438 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2ddc080360 con 0x7f2dd8004850 2023-01-01T17:40:12.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.787+0000 7f2df10b8700 1 --2- 172.21.15.61:0/730373438 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f2dd0063290 0x7f2dd0065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.788+0000 7f2df10b8700 1 --2- 172.21.15.61:0/730373438 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f2dd0063290 0x7f2dd0065740 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2de4017040 tx=0x7f2de4011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.809 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.790+0000 7f3b84ff9700 1 -- 172.21.15.61:0/90632244 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b78011830 con 0x7f3b880a4220 2023-01-01T17:40:12.809 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.792+0000 7f3b8e3b9700 1 -- 172.21.15.61:0/90632244 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b880b7be0 con 0x7f3b880a4220 2023-01-01T17:40:12.809 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.792+0000 7f3b8e3b9700 1 -- 172.21.15.61:0/90632244 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b880bf7e0 con 0x7f3b880a4220 2023-01-01T17:40:12.809 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.795+0000 7f2de27fc700 1 -- 172.21.15.61:0/730373438 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f2ddc04f0b0 con 0x7f2dd8004850 2023-01-01T17:40:12.809 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.797+0000 7f3b8e3b9700 1 -- 172.21.15.61:0/90632244 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b881583e0 con 0x7f3b880a4220 2023-01-01T17:40:12.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.803+0000 7f404cff9700 1 -- 172.21.15.61:0/3418847726 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f4040084060 con 0x7f40500c1ad0 2023-01-01T17:40:12.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.802+0000 7f3b84ff9700 1 -- 172.21.15.61:0/90632244 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b78011990 con 0x7f3b880a4220 2023-01-01T17:40:12.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.802+0000 7f3b84ff9700 1 -- 172.21.15.61:0/90632244 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b78011d00 con 0x7f3b880a4220 2023-01-01T17:40:12.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.804+0000 7f3b84ff9700 1 -- 172.21.15.61:0/90632244 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f3b78021070 con 0x7f3b880a4220 2023-01-01T17:40:12.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.804+0000 7f3b84ff9700 1 --2- 172.21.15.61:0/90632244 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3b74063290 0x7f3b74065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.805+0000 7f3b84ff9700 1 -- 172.21.15.61:0/90632244 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3b78080120 con 0x7f3b880a4220 2023-01-01T17:40:12.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.806+0000 7f3b84ff9700 1 -- 172.21.15.61:0/90632244 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f3b7804ef10 con 0x7f3b880a4220 2023-01-01T17:40:12.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.821+0000 7f3b87fff700 1 --2- 172.21.15.61:0/90632244 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3b74063290 0x7f3b74065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.821 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.821+0000 7f3b87fff700 1 --2- 172.21.15.61:0/90632244 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3b74063290 0x7f3b74065740 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3b880715e0 tx=0x7f3b7c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.827 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.827+0000 7f98a80a3700 1 Processor -- start 2023-01-01T17:40:12.829 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.828+0000 7f44e1f56700 1 Processor -- start 2023-01-01T17:40:12.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.829+0000 7f44e1f56700 1 -- start start 2023-01-01T17:40:12.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.827+0000 7f98a80a3700 1 -- start start 2023-01-01T17:40:12.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.829+0000 7f98a80a3700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f98a014c640 0x7f98a00c1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.829+0000 7f98a80a3700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98a006b940 0x7f98a0159920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.829+0000 7f98a80a3700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98a014ff30 con 0x7f98a014fa20 2023-01-01T17:40:12.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.829+0000 7f98a80a3700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98a006ada0 con 0x7f98a014c640 2023-01-01T17:40:12.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.829+0000 7f98a80a3700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a014ca10 con 0x7f98a006b940 2023-01-01T17:40:12.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.829+0000 7f98a6640700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98a006b940 0x7f98a0159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.829+0000 7f98a563e700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f98a014fa20 0x7f98a006b230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.61:49082/0 (socket says 172.21.15.61:49082) 2023-01-01T17:40:12.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.829+0000 7f98a563e700 1 -- 172.21.15.61:0/838727311 learned_addr learned my addr 172.21.15.61:0/838727311 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:40:12.831 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.830+0000 7f98a5e3f700 1 --2- 172.21.15.61:0/838727311 >> v2:172.21.15.61:3300/0 conn(0x7f98a014c640 0x7f98a00c1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.830+0000 7f44e1f56700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44dc0a6e50 0x7f44dc14c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.830+0000 7f44e1f56700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44dc14ff30 con 0x7f44dc06b940 2023-01-01T17:40:12.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.830+0000 7f44e1f56700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44dc06ada0 con 0x7f44dc14fa20 2023-01-01T17:40:12.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.830+0000 7f44e1f56700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44dc0c1eb0 con 0x7f44dc0a6e50 2023-01-01T17:40:12.832 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.830+0000 7f44dbfff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f44dc06b940 0x7f44dc159920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40616/0 (socket says 172.21.15.61:40616) 2023-01-01T17:40:12.833 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.830+0000 7f44dbfff700 1 -- 172.21.15.61:0/4065942129 learned_addr learned my addr 172.21.15.61:0/4065942129 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:40:12.833 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.830+0000 7f98a5e3f700 1 -- 172.21.15.61:0/838727311 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98a006b940 msgr2=0x7f98a0159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:12.833 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.830+0000 7f98a5e3f700 1 --2- 172.21.15.61:0/838727311 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98a006b940 0x7f98a0159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.833 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.830+0000 7f98a5e3f700 1 -- 172.21.15.61:0/838727311 >> v1:172.21.15.149:6789/0 conn(0x7f98a014fa20 legacy=0x7f98a006b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.833 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.830+0000 7f98a5e3f700 1 -- 172.21.15.61:0/838727311 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a00bf6c0 con 0x7f98a014c640 2023-01-01T17:40:12.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.831+0000 7f44db7fe700 1 --2- 172.21.15.61:0/4065942129 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44dc0a6e50 0x7f44dc14c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.831+0000 7f98a5e3f700 1 --2- 172.21.15.61:0/838727311 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f98a014c640 0x7f98a00c1620 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9890009840 tx=0x7f9890009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1418359a331287 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.831+0000 7f44da7fc700 1 -- 172.21.15.61:0/4065942129 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3406878195 0 0) 0x7f44dc14ff30 con 0x7f44dc06b940 2023-01-01T17:40:12.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.831+0000 7f44da7fc700 1 -- 172.21.15.61:0/4065942129 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44c40034b0 con 0x7f44dc06b940 2023-01-01T17:40:12.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.831+0000 7f44da7fc700 1 -- 172.21.15.61:0/4065942129 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3666666365 0 0) 0x7f44dc06ada0 con 0x7f44dc14fa20 2023-01-01T17:40:12.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.831+0000 7f44da7fc700 1 -- 172.21.15.61:0/4065942129 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44dc14ff30 con 0x7f44dc14fa20 2023-01-01T17:40:12.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.831+0000 7f44da7fc700 1 -- 172.21.15.61:0/4065942129 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3384424360 0 0) 0x7f44c40034b0 con 0x7f44dc06b940 2023-01-01T17:40:12.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.831+0000 7f44da7fc700 1 -- 172.21.15.61:0/4065942129 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44dc0a6e50 msgr2=0x7f44dc14c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:12.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.831+0000 7f44da7fc700 1 --2- 172.21.15.61:0/4065942129 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44dc0a6e50 0x7f44dc14c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.831+0000 7f44da7fc700 1 -- 172.21.15.61:0/4065942129 >> v1:172.21.15.149:6789/0 conn(0x7f44dc14fa20 legacy=0x7f44dc06b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.831+0000 7f44da7fc700 1 -- 172.21.15.61:0/4065942129 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44dc0bf6c0 con 0x7f44dc06b940 2023-01-01T17:40:12.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.831+0000 7f44da7fc700 1 -- 172.21.15.61:0/4065942129 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586489653 0 0) 0x7f44d0001670 con 0x7f44dc06b940 2023-01-01T17:40:12.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.831+0000 7f44da7fc700 1 -- 172.21.15.61:0/4065942129 >> v1:172.21.15.61:6789/0 conn(0x7f44dc06b940 legacy=0x7f44dc159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.831+0000 7f44da7fc700 1 --2- 172.21.15.61:0/4065942129 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44c4004ca0 0x7f44c4005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.831+0000 7f44da7fc700 1 --2- 172.21.15.61:0/4065942129 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f44c40037b0 0x7f44c4003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.831+0000 7f44da7fc700 1 --2- 172.21.15.61:0/4065942129 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44c4004330 0x7f44c400fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.831+0000 7f44da7fc700 1 -- 172.21.15.61:0/4065942129 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44dc0c1eb0 con 0x7f44c40037b0 2023-01-01T17:40:12.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.831+0000 7f44da7fc700 1 -- 172.21.15.61:0/4065942129 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c4010510 con 0x7f44c4004ca0 2023-01-01T17:40:12.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.831+0000 7f44da7fc700 1 -- 172.21.15.61:0/4065942129 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c40106d0 con 0x7f44c4004330 2023-01-01T17:40:12.836 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.832+0000 7f44db7fe700 1 --2- 172.21.15.61:0/4065942129 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44dc0a6e50 0x7f44dc14c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-01-01T17:40:12.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.832+0000 7f98a4e3d700 1 -- 172.21.15.61:0/838727311 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9890011830 con 0x7f98a014c640 2023-01-01T17:40:12.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.832+0000 7f98a4e3d700 1 -- 172.21.15.61:0/838727311 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9890011990 con 0x7f98a014c640 2023-01-01T17:40:12.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.832+0000 7f98a4e3d700 1 -- 172.21.15.61:0/838727311 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9890011d20 con 0x7f98a014c640 2023-01-01T17:40:12.837 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.832+0000 7f44daffd700 1 --2- 172.21.15.61:0/4065942129 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f44c40037b0 0x7f44c4003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.832+0000 7f44dbfff700 1 --2- 172.21.15.61:0/4065942129 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44c4004330 0x7f44c400fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.832+0000 7f44daffd700 1 -- 172.21.15.61:0/4065942129 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44c4004330 msgr2=0x7f44c400fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:12.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.832+0000 7f44daffd700 1 --2- 172.21.15.61:0/4065942129 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44c4004330 0x7f44c400fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.832+0000 7f44daffd700 1 -- 172.21.15.61:0/4065942129 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44c4004ca0 msgr2=0x7f44c4005090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-01-01T17:40:12.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.832+0000 7f44daffd700 1 --2- 172.21.15.61:0/4065942129 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44c4004ca0 0x7f44c4005090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.832+0000 7f44daffd700 1 -- 172.21.15.61:0/4065942129 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44dc0bf6c0 con 0x7f44c40037b0 2023-01-01T17:40:12.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.833+0000 7f98a80a3700 1 -- 172.21.15.61:0/838727311 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f98a014c640 msgr2=0x7f98a00c1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.838 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.833+0000 7f98a80a3700 1 --2- 172.21.15.61:0/838727311 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f98a014c640 0x7f98a00c1620 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9890009840 tx=0x7f9890009b50 comp rx=0 tx=0).stop 2023-01-01T17:40:12.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.833+0000 7f44daffd700 1 --2- 172.21.15.61:0/4065942129 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f44c40037b0 0x7f44c4003c20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f44cc001930 tx=0x7f44c4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54255319ec51b06d server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.833+0000 7f98a80a3700 1 -- 172.21.15.61:0/838727311 shutdown_connections 2023-01-01T17:40:12.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.833+0000 7f98a80a3700 1 --2- 172.21.15.61:0/838727311 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98a006b940 0x7f98a0159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.833+0000 7f98a80a3700 1 --2- 172.21.15.61:0/838727311 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f98a014c640 0x7f98a00c1620 secure :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9890009840 tx=0x7f9890009b50 comp rx=0 tx=0).stop 2023-01-01T17:40:12.839 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.833+0000 7f98a80a3700 1 -- 172.21.15.61:0/838727311 >> 172.21.15.61:0/838727311 conn(0x7f98a0069fb0 msgr2=0x7f98a00a6740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:12.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.833+0000 7f44da7fc700 1 -- 172.21.15.61:0/4065942129 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc0052d0 con 0x7f44c40037b0 2023-01-01T17:40:12.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.833+0000 7f44da7fc700 1 -- 172.21.15.61:0/4065942129 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44cc005430 con 0x7f44c40037b0 2023-01-01T17:40:12.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.833+0000 7f44da7fc700 1 -- 172.21.15.61:0/4065942129 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc0038c0 con 0x7f44c40037b0 2023-01-01T17:40:12.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.834+0000 7f44e1f56700 1 -- 172.21.15.61:0/4065942129 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f44c40037b0 msgr2=0x7f44c4003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.840 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.834+0000 7f44e1f56700 1 --2- 172.21.15.61:0/4065942129 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f44c40037b0 0x7f44c4003c20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f44cc001930 tx=0x7f44c4004770 comp rx=0 tx=0).stop 2023-01-01T17:40:12.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.836+0000 7f44dbfff700 1 -- 172.21.15.61:0/4065942129 reap_dead start 2023-01-01T17:40:12.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.836+0000 7f44e1f56700 1 -- 172.21.15.61:0/4065942129 shutdown_connections 2023-01-01T17:40:12.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.836+0000 7f44e1f56700 1 -- 172.21.15.61:0/4065942129 >> 172.21.15.61:0/4065942129 conn(0x7f44dc069fb0 msgr2=0x7f44dc0a6740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:12.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.840+0000 7f44e1f56700 1 -- 172.21.15.61:0/4065942129 shutdown_connections 2023-01-01T17:40:12.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.840+0000 7f98a80a3700 1 -- 172.21.15.61:0/838727311 shutdown_connections 2023-01-01T17:40:12.841 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.840+0000 7f44e1f56700 1 -- 172.21.15.61:0/4065942129 wait complete. 2023-01-01T17:40:12.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.840+0000 7f98a80a3700 1 -- 172.21.15.61:0/838727311 wait complete. 2023-01-01T17:40:12.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.842+0000 7f98a80a3700 1 Processor -- start 2023-01-01T17:40:12.842 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.842+0000 7f44e1f56700 1 Processor -- start 2023-01-01T17:40:12.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.842+0000 7f44e1f56700 1 -- start start 2023-01-01T17:40:12.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.843+0000 7f44e1f56700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f44dc0a4da0 0x7f44dc070280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.843+0000 7f44e1f56700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44dc0a5170 0x7f44dc0be150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.843+0000 7f44e1f56700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44dc14bf80 0x7f44dc0be690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.843+0000 7f44e1f56700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44dc0a9790 con 0x7f44dc0a4da0 2023-01-01T17:40:12.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.843+0000 7f44e1f56700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44dc14b880 con 0x7f44dc14bf80 2023-01-01T17:40:12.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.843+0000 7f44e1f56700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44dc06f2b0 con 0x7f44dc0a5170 2023-01-01T17:40:12.844 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.842+0000 7f98a80a3700 1 -- start start 2023-01-01T17:40:12.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.843+0000 7f98a80a3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98a006b940 0x7f98a00a21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.843+0000 7f98a80a3700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98a014fa20 0x7f98a015ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.843+0000 7f98a80a3700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f98a015b090 0x7f98a00a5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.843+0000 7f98a80a3700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a00aaa00 con 0x7f98a015b090 2023-01-01T17:40:12.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.843+0000 7f98a80a3700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a00aa7b0 con 0x7f98a006b940 2023-01-01T17:40:12.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.843+0000 7f98a80a3700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a00a6dd0 con 0x7f98a014fa20 2023-01-01T17:40:12.845 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.844+0000 7f44daffd700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44dc0a5170 0x7f44dc0be150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.844+0000 7f44daffd700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44dc0a5170 0x7f44dc0be150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.61:45022/0 (socket says 172.21.15.61:45022) 2023-01-01T17:40:12.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.844+0000 7f44daffd700 1 -- 172.21.15.61:0/161758177 learned_addr learned my addr 172.21.15.61:0/161758177 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:12.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.844+0000 7f98a5e3f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98a006b940 0x7f98a00a21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.844+0000 7f98a5e3f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98a006b940 0x7f98a00a21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.61:42614/0 (socket says 172.21.15.61:42614) 2023-01-01T17:40:12.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.844+0000 7f98a5e3f700 1 -- 172.21.15.61:0/1086359623 learned_addr learned my addr 172.21.15.61:0/1086359623 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:12.846 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.844+0000 7f44dbfff700 1 --2- 172.21.15.61:0/161758177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44dc14bf80 0x7f44dc0be690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.844+0000 7f98a563e700 1 --2- 172.21.15.61:0/1086359623 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98a014fa20 0x7f98a015ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.844+0000 7f44daffd700 1 -- 172.21.15.61:0/161758177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44dc14bf80 msgr2=0x7f44dc0be690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.844+0000 7f44daffd700 1 --2- 172.21.15.61:0/161758177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44dc14bf80 0x7f44dc0be690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.844+0000 7f44daffd700 1 -- 172.21.15.61:0/161758177 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f44dc0a4da0 msgr2=0x7f44dc070280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.844+0000 7f44daffd700 1 --2- 172.21.15.61:0/161758177 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f44dc0a4da0 0x7f44dc070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.847 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.844+0000 7f44daffd700 1 -- 172.21.15.61:0/161758177 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44dc0c3200 con 0x7f44dc0a5170 2023-01-01T17:40:12.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.845+0000 7f98a5e3f700 1 -- 172.21.15.61:0/1086359623 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98a014fa20 msgr2=0x7f98a015ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.845+0000 7f98a5e3f700 1 --2- 172.21.15.61:0/1086359623 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98a014fa20 0x7f98a015ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.845+0000 7f98a5e3f700 1 -- 172.21.15.61:0/1086359623 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f98a015b090 msgr2=0x7f98a00a5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:12.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.845+0000 7f98a5e3f700 1 --2- 172.21.15.61:0/1086359623 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f98a015b090 0x7f98a00a5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:12.848 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.845+0000 7f98a5e3f700 1 -- 172.21.15.61:0/1086359623 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98900094a0 con 0x7f98a006b940 2023-01-01T17:40:12.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.845+0000 7f44daffd700 1 --2- 172.21.15.61:0/161758177 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44dc0a5170 0x7f44dc0be150 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f44cc00c3c0 tx=0x7f44cc0012d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.845+0000 7f44c3fff700 1 -- 172.21.15.61:0/161758177 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc007240 con 0x7f44dc0a5170 2023-01-01T17:40:12.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.845+0000 7f44c3fff700 1 -- 172.21.15.61:0/161758177 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44cc0073c0 con 0x7f44dc0a5170 2023-01-01T17:40:12.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.845+0000 7f44c3fff700 1 -- 172.21.15.61:0/161758177 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc001d60 con 0x7f44dc0a5170 2023-01-01T17:40:12.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.845+0000 7f44e1f56700 1 -- 172.21.15.61:0/161758177 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44dc0bf9a0 con 0x7f44dc0a5170 2023-01-01T17:40:12.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.845+0000 7f44e1f56700 1 -- 172.21.15.61:0/161758177 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44dc0bef20 con 0x7f44dc0a5170 2023-01-01T17:40:12.849 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.848+0000 7f44c3fff700 1 -- 172.21.15.61:0/161758177 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f44cc02e070 con 0x7f44dc0a5170 2023-01-01T17:40:12.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.848+0000 7f98a5e3f700 1 --2- 172.21.15.61:0/1086359623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98a006b940 0x7f98a00a21f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9890009b90 tx=0x7f9890004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.848+0000 7f44c3fff700 1 --2- 172.21.15.61:0/161758177 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f44c8063390 0x7f44c8065840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.850 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.848+0000 7f44c3fff700 1 -- 172.21.15.61:0/161758177 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f44cc080c70 con 0x7f44dc0a5170 2023-01-01T17:40:12.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.849+0000 7f44e1f56700 1 -- 172.21.15.61:0/161758177 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44bc0052f0 con 0x7f44dc0a5170 2023-01-01T17:40:12.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.849+0000 7f44db7fe700 1 --2- 172.21.15.61:0/161758177 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f44c8063390 0x7f44c8065840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.850+0000 7f44db7fe700 1 --2- 172.21.15.61:0/161758177 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f44c8063390 0x7f44c8065840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f44dc067e10 tx=0x7f44d400a7b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.854+0000 7f98967fc700 1 -- 172.21.15.61:0/1086359623 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98900042c0 con 0x7f98a006b940 2023-01-01T17:40:12.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.854+0000 7f98a80a3700 1 -- 172.21.15.61:0/1086359623 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a00c3200 con 0x7f98a006b940 2023-01-01T17:40:12.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.854+0000 7f98a80a3700 1 -- 172.21.15.61:0/1086359623 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a00bf9a0 con 0x7f98a006b940 2023-01-01T17:40:12.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.854+0000 7f44c3fff700 1 -- 172.21.15.61:0/161758177 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f44cc04f9c0 con 0x7f44dc0a5170 2023-01-01T17:40:12.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.854+0000 7f98967fc700 1 -- 172.21.15.61:0/1086359623 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989001f070 con 0x7f98a006b940 2023-01-01T17:40:12.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.861+0000 7f98967fc700 1 -- 172.21.15.61:0/1086359623 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98900036a0 con 0x7f98a006b940 2023-01-01T17:40:12.865 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.861+0000 7f98967fc700 1 -- 172.21.15.61:0/1086359623 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f989002a020 con 0x7f98a006b940 2023-01-01T17:40:12.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.861+0000 7f98967fc700 1 --2- 172.21.15.61:0/1086359623 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f98840633e0 0x7f9884065890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:12.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.862+0000 7f98967fc700 1 -- 172.21.15.61:0/1086359623 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9890081000 con 0x7f98a006b940 2023-01-01T17:40:12.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.863+0000 7f98a80a3700 1 -- 172.21.15.61:0/1086359623 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98880052f0 con 0x7f98a006b940 2023-01-01T17:40:12.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.863+0000 7f98a563e700 1 --2- 172.21.15.61:0/1086359623 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f98840633e0 0x7f9884065890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:12.866 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.864+0000 7f98a563e700 1 --2- 172.21.15.61:0/1086359623 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f98840633e0 0x7f9884065890 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f98a00c43d0 tx=0x7f989c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:12.870 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:12.870+0000 7f98967fc700 1 -- 172.21.15.61:0/1086359623 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f989004fda0 con 0x7f98a006b940 2023-01-01T17:40:13.101 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.101+0000 7f1098c65700 1 -- 172.21.15.61:0/118769869 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f10780055a0 con 0x7f109414fa20 2023-01-01T17:40:13.101 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.101+0000 7f1082ffd700 1 -- 172.21.15.61:0/118769869 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f108c017020 con 0x7f109414fa20 2023-01-01T17:40:13.105 INFO:teuthology.orchestra.run.smithi061.stdout:55834574855 2023-01-01T17:40:13.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.105+0000 7f1098c65700 1 -- 172.21.15.61:0/118769869 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f1074063360 msgr2=0x7f1074065810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:13.105 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.105+0000 7f1098c65700 1 --2- 172.21.15.61:0/118769869 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f1074063360 0x7f1074065810 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f10880090b0 tx=0x7f1088008030 comp rx=0 tx=0).stop 2023-01-01T17:40:13.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.105+0000 7f1098c65700 1 -- 172.21.15.61:0/118769869 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f109414fa20 msgr2=0x7f10940b7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:13.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.105+0000 7f1098c65700 1 --2- 172.21.15.61:0/118769869 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f109414fa20 0x7f10940b7980 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f108c00caa0 tx=0x7f108c00cdb0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.105+0000 7f1098c65700 1 -- 172.21.15.61:0/118769869 shutdown_connections 2023-01-01T17:40:13.106 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.105+0000 7f1098c65700 1 --2- 172.21.15.61:0/118769869 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f1074063360 0x7f1074065810 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f10880090b0 tx=0x7f1088008030 comp rx=0 tx=0).stop 2023-01-01T17:40:13.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.105+0000 7f1098c65700 1 --2- 172.21.15.61:0/118769869 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f109414fa20 0x7f10940b7980 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.105+0000 7f1098c65700 1 --2- 172.21.15.61:0/118769869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10940a6e50 0x7f10941ec880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.105+0000 7f1098c65700 1 --2- 172.21.15.61:0/118769869 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f10940c1b60 0x7f10940b7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.105+0000 7f1098c65700 1 -- 172.21.15.61:0/118769869 >> 172.21.15.61:0/118769869 conn(0x7f1094069fb0 msgr2=0x7f10940a58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:13.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.106+0000 7f1098c65700 1 -- 172.21.15.61:0/118769869 shutdown_connections 2023-01-01T17:40:13.107 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.106+0000 7f1098c65700 1 -- 172.21.15.61:0/118769869 wait complete. 2023-01-01T17:40:13.125 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.6 2023-01-01T17:40:13.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.150+0000 7f03f5226700 1 -- 172.21.15.61:0/3405281924 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f03d00055a0 con 0x7f03f00a3f90 2023-01-01T17:40:13.151 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.151+0000 7f03d77fe700 1 -- 172.21.15.61:0/3405281924 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f03e404e900 con 0x7f03f00a3f90 2023-01-01T17:40:13.152 INFO:teuthology.orchestra.run.smithi061.stdout:55834574855 2023-01-01T17:40:13.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.154+0000 7f03f5226700 1 -- 172.21.15.61:0/3405281924 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f03dc063360 msgr2=0x7f03dc065810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:13.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.154+0000 7f03f5226700 1 --2- 172.21.15.61:0/3405281924 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f03dc063360 0x7f03dc065810 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f03f015b870 tx=0x7f03e0008030 comp rx=0 tx=0).stop 2023-01-01T17:40:13.157 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.154+0000 7f03f5226700 1 -- 172.21.15.61:0/3405281924 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f03f00a3f90 msgr2=0x7f03f01eca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:13.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.154+0000 7f03f5226700 1 --2- 172.21.15.61:0/3405281924 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f03f00a3f90 0x7f03f01eca20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f03e4009fd0 tx=0x7f03e400b770 comp rx=0 tx=0).stop 2023-01-01T17:40:13.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.154+0000 7f03f5226700 1 -- 172.21.15.61:0/3405281924 shutdown_connections 2023-01-01T17:40:13.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.154+0000 7f03f5226700 1 --2- 172.21.15.61:0/3405281924 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f03f00c1b60 0x7f03f01ea130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.154+0000 7f03f5226700 1 --2- 172.21.15.61:0/3405281924 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f03dc063360 0x7f03dc065810 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.154+0000 7f03f5226700 1 --2- 172.21.15.61:0/3405281924 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f03f00a3f90 0x7f03f01eca20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.154+0000 7f03f5226700 1 --2- 172.21.15.61:0/3405281924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03f00bf590 0x7f03f0154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.154+0000 7f03f5226700 1 -- 172.21.15.61:0/3405281924 >> 172.21.15.61:0/3405281924 conn(0x7f03f0069fb0 msgr2=0x7f03f00c4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:13.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.154+0000 7f03f5226700 1 -- 172.21.15.61:0/3405281924 shutdown_connections 2023-01-01T17:40:13.158 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.154+0000 7f03f5226700 1 -- 172.21.15.61:0/3405281924 wait complete. 2023-01-01T17:40:13.167 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.5 2023-01-01T17:40:13.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.168+0000 7fd000cc4700 1 -- 172.21.15.61:0/3023725539 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcfe00055a0 con 0x7fcffc162220 2023-01-01T17:40:13.168 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.168+0000 7fcfeaffd700 1 -- 172.21.15.61:0/3023725539 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcff0011e60 con 0x7fcffc162220 2023-01-01T17:40:13.169 INFO:teuthology.orchestra.run.smithi061.stdout:55834574855 2023-01-01T17:40:13.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.170+0000 7fd000cc4700 1 -- 172.21.15.61:0/3023725539 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fcfdc063260 msgr2=0x7fcfdc065710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:13.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.170+0000 7fd000cc4700 1 --2- 172.21.15.61:0/3023725539 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fcfdc063260 0x7fcfdc065710 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcff4001b20 tx=0x7fcff4001ef0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.170+0000 7fd000cc4700 1 -- 172.21.15.61:0/3023725539 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcffc162220 msgr2=0x7fcffc14de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:13.171 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.170+0000 7fd000cc4700 1 --2- 172.21.15.61:0/3023725539 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcffc162220 0x7fcffc14de10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcff000b450 tx=0x7fcff000b760 comp rx=0 tx=0).stop 2023-01-01T17:40:13.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.172+0000 7fd000cc4700 1 -- 172.21.15.61:0/3023725539 shutdown_connections 2023-01-01T17:40:13.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.172+0000 7fd000cc4700 1 --2- 172.21.15.61:0/3023725539 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcffc14e350 0x7fcffc0a8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.172+0000 7fd000cc4700 1 --2- 172.21.15.61:0/3023725539 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcfe40052d0 0x7fcffc148d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.172+0000 7fd000cc4700 1 --2- 172.21.15.61:0/3023725539 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fcfdc063260 0x7fcfdc065710 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.172+0000 7fd000cc4700 1 --2- 172.21.15.61:0/3023725539 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcffc162220 0x7fcffc14de10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.172 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.172+0000 7fd000cc4700 1 -- 172.21.15.61:0/3023725539 >> 172.21.15.61:0/3023725539 conn(0x7fcffc0c58f0 msgr2=0x7fcffc0c6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:13.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.175+0000 7fd000cc4700 1 -- 172.21.15.61:0/3023725539 shutdown_connections 2023-01-01T17:40:13.175 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.175+0000 7fd000cc4700 1 -- 172.21.15.61:0/3023725539 wait complete. 2023-01-01T17:40:13.185 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.185+0000 7f2df3b1d700 1 -- 172.21.15.61:0/730373438 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2dec066190 con 0x7f2dd8004850 2023-01-01T17:40:13.186 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.185+0000 7f2de27fc700 1 -- 172.21.15.61:0/730373438 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2ddc0526d0 con 0x7f2dd8004850 2023-01-01T17:40:13.186 INFO:teuthology.orchestra.run.smithi061.stdout:55834574855 2023-01-01T17:40:13.188 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.2 2023-01-01T17:40:13.189 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.189+0000 7f2df3b1d700 1 -- 172.21.15.61:0/730373438 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f2dd0063290 msgr2=0x7f2dd0065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:13.189 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.189+0000 7f2df3b1d700 1 --2- 172.21.15.61:0/730373438 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f2dd0063290 0x7f2dd0065740 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2de4017040 tx=0x7f2de4011000 comp rx=0 tx=0).stop 2023-01-01T17:40:13.189 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.189+0000 7f2df3b1d700 1 -- 172.21.15.61:0/730373438 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2dd8004850 msgr2=0x7f2dec0be120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:13.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.189+0000 7f2df3b1d700 1 --2- 172.21.15.61:0/730373438 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2dd8004850 0x7f2dec0be120 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc00e8e0 tx=0x7f2ddc00ebf0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.189+0000 7f2df3b1d700 1 -- 172.21.15.61:0/730373438 shutdown_connections 2023-01-01T17:40:13.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.189+0000 7f2df3b1d700 1 --2- 172.21.15.61:0/730373438 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2dec0a85e0 0x7f2dec1e85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.189+0000 7f2df3b1d700 1 --2- 172.21.15.61:0/730373438 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f2dd0063290 0x7f2dd0065740 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.189+0000 7f2df3b1d700 1 --2- 172.21.15.61:0/730373438 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2dd8004850 0x7f2dec0be120 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.189+0000 7f2df3b1d700 1 --2- 172.21.15.61:0/730373438 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2dec0aa690 0x7f2dec0a80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.189+0000 7f2df3b1d700 1 -- 172.21.15.61:0/730373438 >> 172.21.15.61:0/730373438 conn(0x7f2dec069fb0 msgr2=0x7f2dec0a5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:13.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.189+0000 7f2df3b1d700 1 -- 172.21.15.61:0/730373438 shutdown_connections 2023-01-01T17:40:13.190 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.189+0000 7f2df3b1d700 1 -- 172.21.15.61:0/730373438 wait complete. 2023-01-01T17:40:13.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.189+0000 7f3b8e3b9700 1 -- 172.21.15.61:0/90632244 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f3b88066190 con 0x7f3b880a4220 2023-01-01T17:40:13.191 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.190+0000 7f3b84ff9700 1 -- 172.21.15.61:0/90632244 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3b78011e60 con 0x7f3b880a4220 2023-01-01T17:40:13.191 INFO:teuthology.orchestra.run.smithi061.stdout:55834574855 2023-01-01T17:40:13.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.193+0000 7f3b8e3b9700 1 -- 172.21.15.61:0/90632244 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3b74063290 msgr2=0x7f3b74065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:13.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.193+0000 7f3b8e3b9700 1 --2- 172.21.15.61:0/90632244 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3b74063290 0x7f3b74065740 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3b880715e0 tx=0x7f3b7c008040 comp rx=0 tx=0).stop 2023-01-01T17:40:13.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.193+0000 7f3b8e3b9700 1 -- 172.21.15.61:0/90632244 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3b880a4220 msgr2=0x7f3b88144af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:13.193 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.193+0000 7f3b8e3b9700 1 --2- 172.21.15.61:0/90632244 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3b880a4220 0x7f3b88144af0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3b7800b410 tx=0x7f3b78009f90 comp rx=0 tx=0).stop 2023-01-01T17:40:13.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.194+0000 7f3b8e3b9700 1 -- 172.21.15.61:0/90632244 shutdown_connections 2023-01-01T17:40:13.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.194+0000 7f3b8e3b9700 1 --2- 172.21.15.61:0/90632244 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3b880b7ef0 0x7f3b881556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.194+0000 7f3b8e3b9700 1 --2- 172.21.15.61:0/90632244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b8806b380 0x7f3b880a85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.194+0000 7f3b8e3b9700 1 --2- 172.21.15.61:0/90632244 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3b74063290 0x7f3b74065740 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.194+0000 7f3b8e3b9700 1 --2- 172.21.15.61:0/90632244 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3b880a4220 0x7f3b88144af0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.194+0000 7f3b8e3b9700 1 -- 172.21.15.61:0/90632244 >> 172.21.15.61:0/90632244 conn(0x7f3b880a6740 msgr2=0x7f3b880c1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:13.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.194+0000 7f3b8e3b9700 1 -- 172.21.15.61:0/90632244 shutdown_connections 2023-01-01T17:40:13.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.194+0000 7f3b8e3b9700 1 -- 172.21.15.61:0/90632244 wait complete. 2023-01-01T17:40:13.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.194+0000 7f4056a34700 1 -- 172.21.15.61:0/3418847726 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f405006e700 con 0x7f40500c1ad0 2023-01-01T17:40:13.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.194+0000 7f404cff9700 1 -- 172.21.15.61:0/3418847726 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4040017070 con 0x7f40500c1ad0 2023-01-01T17:40:13.196 INFO:teuthology.orchestra.run.smithi061.stdout:55834574855 2023-01-01T17:40:13.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.197+0000 7f4056a34700 1 -- 172.21.15.61:0/3418847726 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f403c063310 msgr2=0x7f403c0657c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:13.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.197+0000 7f4056a34700 1 --2- 172.21.15.61:0/3418847726 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f403c063310 0x7f403c0657c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4044001560 tx=0x7f4044007ad0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.198+0000 7f4056a34700 1 -- 172.21.15.61:0/3418847726 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f40500c1ad0 msgr2=0x7f405014d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:13.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.198+0000 7f4056a34700 1 --2- 172.21.15.61:0/3418847726 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f40500c1ad0 0x7f405014d490 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f404000c730 tx=0x7f404000ca40 comp rx=0 tx=0).stop 2023-01-01T17:40:13.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.198+0000 7f4056a34700 1 -- 172.21.15.61:0/3418847726 shutdown_connections 2023-01-01T17:40:13.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.198+0000 7f4056a34700 1 --2- 172.21.15.61:0/3418847726 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4050157050 0x7f405014d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.198+0000 7f4056a34700 1 --2- 172.21.15.61:0/3418847726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f405006a640 0x7f40501f0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.198+0000 7f4056a34700 1 --2- 172.21.15.61:0/3418847726 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f403c063310 0x7f403c0657c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.198+0000 7f4056a34700 1 --2- 172.21.15.61:0/3418847726 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f40500c1ad0 0x7f405014d490 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.198+0000 7f4056a34700 1 -- 172.21.15.61:0/3418847726 >> 172.21.15.61:0/3418847726 conn(0x7f40500c1f30 msgr2=0x7f40500c4930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:13.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.198+0000 7f4056a34700 1 -- 172.21.15.61:0/3418847726 shutdown_connections 2023-01-01T17:40:13.199 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.198+0000 7f4056a34700 1 -- 172.21.15.61:0/3418847726 wait complete. 2023-01-01T17:40:13.205 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.0 2023-01-01T17:40:13.213 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.7 2023-01-01T17:40:13.214 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2023-01-01T17:40:13.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.230+0000 7f44e1f56700 1 -- 172.21.15.61:0/161758177 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f44bc0055a0 con 0x7f44dc0a5170 2023-01-01T17:40:13.231 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.230+0000 7f44c3fff700 1 -- 172.21.15.61:0/161758177 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f44cc02c030 con 0x7f44dc0a5170 2023-01-01T17:40:13.231 INFO:teuthology.orchestra.run.smithi061.stdout:55834574855 2023-01-01T17:40:13.233 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.232+0000 7f44e1f56700 1 -- 172.21.15.61:0/161758177 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f44c8063390 msgr2=0x7f44c8065840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:13.233 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.232+0000 7f44e1f56700 1 --2- 172.21.15.61:0/161758177 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f44c8063390 0x7f44c8065840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f44dc067e10 tx=0x7f44d400a7b0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.233 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.232+0000 7f44e1f56700 1 -- 172.21.15.61:0/161758177 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44dc0a5170 msgr2=0x7f44dc0be150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:13.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.232+0000 7f44e1f56700 1 --2- 172.21.15.61:0/161758177 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44dc0a5170 0x7f44dc0be150 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f44cc00c3c0 tx=0x7f44cc0012d0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.232+0000 7f44e1f56700 1 -- 172.21.15.61:0/161758177 shutdown_connections 2023-01-01T17:40:13.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.232+0000 7f44e1f56700 1 --2- 172.21.15.61:0/161758177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44dc14bf80 0x7f44dc0be690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.232+0000 7f44e1f56700 1 --2- 172.21.15.61:0/161758177 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f44c8063390 0x7f44c8065840 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.232+0000 7f44e1f56700 1 --2- 172.21.15.61:0/161758177 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f44dc0a4da0 0x7f44dc070280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.232+0000 7f44e1f56700 1 --2- 172.21.15.61:0/161758177 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44dc0a5170 0x7f44dc0be150 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.232+0000 7f44e1f56700 1 -- 172.21.15.61:0/161758177 >> 172.21.15.61:0/161758177 conn(0x7f44dc069fb0 msgr2=0x7f44dc0c3390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:13.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.232+0000 7f44e1f56700 1 -- 172.21.15.61:0/161758177 shutdown_connections 2023-01-01T17:40:13.235 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.232+0000 7f44e1f56700 1 -- 172.21.15.61:0/161758177 wait complete. 2023-01-01T17:40:13.235 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.233+0000 7f98a80a3700 1 -- 172.21.15.61:0/1086359623 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f98880055a0 con 0x7f98a006b940 2023-01-01T17:40:13.235 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.233+0000 7f98967fc700 1 -- 172.21.15.61:0/1086359623 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9890015030 con 0x7f98a006b940 2023-01-01T17:40:13.235 INFO:teuthology.orchestra.run.smithi061.stdout:55834574855 2023-01-01T17:40:13.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.236+0000 7f98a80a3700 1 -- 172.21.15.61:0/1086359623 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f98840633e0 msgr2=0x7f9884065890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:13.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.236+0000 7f98a80a3700 1 --2- 172.21.15.61:0/1086359623 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f98840633e0 0x7f9884065890 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f98a00c43d0 tx=0x7f989c009040 comp rx=0 tx=0).stop 2023-01-01T17:40:13.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.236+0000 7f98a80a3700 1 -- 172.21.15.61:0/1086359623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98a006b940 msgr2=0x7f98a00a21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:13.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.236+0000 7f98a80a3700 1 --2- 172.21.15.61:0/1086359623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98a006b940 0x7f98a00a21f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9890009b90 tx=0x7f9890004750 comp rx=0 tx=0).stop 2023-01-01T17:40:13.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.236+0000 7f98a80a3700 1 -- 172.21.15.61:0/1086359623 shutdown_connections 2023-01-01T17:40:13.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.236+0000 7f98a80a3700 1 --2- 172.21.15.61:0/1086359623 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f98840633e0 0x7f9884065890 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.236+0000 7f98a80a3700 1 --2- 172.21.15.61:0/1086359623 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f98a015b090 0x7f98a00a5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.236+0000 7f98a80a3700 1 --2- 172.21.15.61:0/1086359623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98a006b940 0x7f98a00a21f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.236+0000 7f98a80a3700 1 --2- 172.21.15.61:0/1086359623 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f98a014fa20 0x7f98a015ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:13.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.236+0000 7f98a80a3700 1 -- 172.21.15.61:0/1086359623 >> 172.21.15.61:0/1086359623 conn(0x7f98a0069fb0 msgr2=0x7f98a014d030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:13.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.236+0000 7f98a80a3700 1 -- 172.21.15.61:0/1086359623 shutdown_connections 2023-01-01T17:40:13.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:13.236+0000 7f98a80a3700 1 -- 172.21.15.61:0/1086359623 wait complete. 2023-01-01T17:40:13.246 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.3 2023-01-01T17:40:13.249 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.4 2023-01-01T17:40:14.126 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-01-01T17:40:14.169 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-01-01T17:40:14.189 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-01-01T17:40:14.207 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-01-01T17:40:14.214 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-01-01T17:40:14.215 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-01-01T17:40:14.247 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-01-01T17:40:14.250 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-01-01T17:40:14.294 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.293+0000 7f3d87249700 1 Processor -- start 2023-01-01T17:40:14.295 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.293+0000 7f3d87249700 1 -- start start 2023-01-01T17:40:14.295 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.294+0000 7f3d87249700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3d800bf590 0x7f3d80071160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.295 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.294+0000 7f3d87249700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d800a4040 0x7f3d800c3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.296 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.294+0000 7f3d87249700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d800c13f0 con 0x7f3d800716a0 2023-01-01T17:40:14.296 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.294+0000 7f3d87249700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d80089480 con 0x7f3d800bf590 2023-01-01T17:40:14.296 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.294+0000 7f3d87249700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8006c170 con 0x7f3d800a4040 2023-01-01T17:40:14.296 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.295+0000 7f3d7ffff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f3d800716a0 0x7f3d800c1620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40644/0 (socket says 172.21.15.61:40644) 2023-01-01T17:40:14.296 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.295+0000 7f3d7ffff700 1 -- 172.21.15.61:0/2137201967 learned_addr learned my addr 172.21.15.61:0/2137201967 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:40:14.296 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.295+0000 7f3d857e6700 1 --2- 172.21.15.61:0/2137201967 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d800a4040 0x7f3d800c3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.296 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.295+0000 7f3d84fe5700 1 --2- 172.21.15.61:0/2137201967 >> v2:172.21.15.61:3300/0 conn(0x7f3d800bf590 0x7f3d80071160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.297 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.295+0000 7f3d7f7fe700 1 -- 172.21.15.61:0/2137201967 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3113166193 0 0) 0x7f3d800c13f0 con 0x7f3d800716a0 2023-01-01T17:40:14.297 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.296+0000 7f3d7f7fe700 1 -- 172.21.15.61:0/2137201967 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d680035b0 con 0x7f3d800716a0 2023-01-01T17:40:14.297 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.296+0000 7f3d84fe5700 1 -- 172.21.15.61:0/2137201967 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d800a4040 msgr2=0x7f3d800c3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:14.297 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.296+0000 7f3d84fe5700 1 --2- 172.21.15.61:0/2137201967 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d800a4040 0x7f3d800c3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.297 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.296+0000 7f3d84fe5700 1 -- 172.21.15.61:0/2137201967 >> v1:172.21.15.61:6789/0 conn(0x7f3d800716a0 legacy=0x7f3d800c1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.297 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.296+0000 7f3d84fe5700 1 -- 172.21.15.61:0/2137201967 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d800c3b60 con 0x7f3d800bf590 2023-01-01T17:40:14.297 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.296+0000 7f3d84fe5700 1 --2- 172.21.15.61:0/2137201967 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3d800bf590 0x7f3d80071160 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3d70009870 tx=0x7f3d70009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74382a1a55cb049 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:14.298 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.296+0000 7f3d7f7fe700 1 -- 172.21.15.61:0/2137201967 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d70014e90 con 0x7f3d800bf590 2023-01-01T17:40:14.298 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.296+0000 7f3d7f7fe700 1 -- 172.21.15.61:0/2137201967 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7001c440 con 0x7f3d800bf590 2023-01-01T17:40:14.298 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.296+0000 7f3d7f7fe700 1 -- 172.21.15.61:0/2137201967 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7001c7d0 con 0x7f3d800bf590 2023-01-01T17:40:14.298 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.297+0000 7f3d87249700 1 -- 172.21.15.61:0/2137201967 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3d800bf590 msgr2=0x7f3d80071160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.298 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.297+0000 7f3d87249700 1 --2- 172.21.15.61:0/2137201967 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3d800bf590 0x7f3d80071160 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3d70009870 tx=0x7f3d70009b80 comp rx=0 tx=0).stop 2023-01-01T17:40:14.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.298+0000 7f3d87249700 1 -- 172.21.15.61:0/2137201967 shutdown_connections 2023-01-01T17:40:14.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.298+0000 7f3d87249700 1 --2- 172.21.15.61:0/2137201967 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d800a4040 0x7f3d800c3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.298+0000 7f3d87249700 1 --2- 172.21.15.61:0/2137201967 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3d800bf590 0x7f3d80071160 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.298+0000 7f3d87249700 1 -- 172.21.15.61:0/2137201967 >> 172.21.15.61:0/2137201967 conn(0x7f3d80069fb0 msgr2=0x7f3d800a6740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:14.299 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.298+0000 7f3d87249700 1 -- 172.21.15.61:0/2137201967 shutdown_connections 2023-01-01T17:40:14.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.299+0000 7f3d87249700 1 -- 172.21.15.61:0/2137201967 wait complete. 2023-01-01T17:40:14.301 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.300+0000 7f3d87249700 1 Processor -- start 2023-01-01T17:40:14.302 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.301+0000 7f3d87249700 1 -- start start 2023-01-01T17:40:14.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.302+0000 7f3d87249700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d800716a0 0x7f3d800a4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.302+0000 7f3d87249700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3d800a4040 0x7f3d80083800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.302+0000 7f3d87249700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d800bf590 0x7f3d801f7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.302+0000 7f3d87249700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d800c06a0 con 0x7f3d800a4040 2023-01-01T17:40:14.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.302+0000 7f3d87249700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d80084320 con 0x7f3d800716a0 2023-01-01T17:40:14.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.302+0000 7f3d87249700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d80088ad0 con 0x7f3d800bf590 2023-01-01T17:40:14.303 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.302+0000 7f3d84fe5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d800716a0 0x7f3d800a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.302+0000 7f3d7ffff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3d800a4040 0x7f3d80083800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.302+0000 7f3d7ffff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3d800a4040 0x7f3d80083800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46800/0 (socket says 172.21.15.61:46800) 2023-01-01T17:40:14.304 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.302+0000 7f3d7ffff700 1 -- 172.21.15.61:0/676114944 learned_addr learned my addr 172.21.15.61:0/676114944 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:14.305 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.303+0000 7f3d857e6700 1 --2- 172.21.15.61:0/676114944 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d800bf590 0x7f3d801f7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.303+0000 7f3d7ffff700 1 -- 172.21.15.61:0/676114944 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d800bf590 msgr2=0x7f3d801f7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.303+0000 7f3d7ffff700 1 --2- 172.21.15.61:0/676114944 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d800bf590 0x7f3d801f7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.303+0000 7f3d7ffff700 1 -- 172.21.15.61:0/676114944 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d800716a0 msgr2=0x7f3d800a4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.303+0000 7f3d7ffff700 1 --2- 172.21.15.61:0/676114944 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d800716a0 0x7f3d800a4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.303+0000 7f3d7ffff700 1 -- 172.21.15.61:0/676114944 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d700094a0 con 0x7f3d800a4040 2023-01-01T17:40:14.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.303+0000 7f3d7ffff700 1 --2- 172.21.15.61:0/676114944 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3d800a4040 0x7f3d80083800 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3d7400c4f0 tx=0x7f3d7400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:14.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.304+0000 7f3d7d7fa700 1 -- 172.21.15.61:0/676114944 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d74005d70 con 0x7f3d800a4040 2023-01-01T17:40:14.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.304+0000 7f3d7d7fa700 1 -- 172.21.15.61:0/676114944 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d740070d0 con 0x7f3d800a4040 2023-01-01T17:40:14.306 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.304+0000 7f3d7d7fa700 1 -- 172.21.15.61:0/676114944 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d74007440 con 0x7f3d800a4040 2023-01-01T17:40:14.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.304+0000 7f3d87249700 1 -- 172.21.15.61:0/676114944 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d8006c670 con 0x7f3d800a4040 2023-01-01T17:40:14.307 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.304+0000 7f3d87249700 1 -- 172.21.15.61:0/676114944 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d800c1110 con 0x7f3d800a4040 2023-01-01T17:40:14.308 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.307+0000 7f3d7d7fa700 1 -- 172.21.15.61:0/676114944 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f3d74019030 con 0x7f3d800a4040 2023-01-01T17:40:14.308 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.307+0000 7f3d7d7fa700 1 --2- 172.21.15.61:0/676114944 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3d6c063290 0x7f3d6c065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.308 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.308+0000 7f3d7d7fa700 1 -- 172.21.15.61:0/676114944 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3d7407f040 con 0x7f3d800a4040 2023-01-01T17:40:14.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.309+0000 7f3d84fe5700 1 --2- 172.21.15.61:0/676114944 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3d6c063290 0x7f3d6c065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.309 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.309+0000 7f3d87249700 1 -- 172.21.15.61:0/676114944 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d8006c950 con 0x7f3d800a4040 2023-01-01T17:40:14.310 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.309+0000 7f3d84fe5700 1 --2- 172.21.15.61:0/676114944 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3d6c063290 0x7f3d6c065740 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3d700090b0 tx=0x7f3d70018000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:14.317 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.317+0000 7f3d7d7fa700 1 -- 172.21.15.61:0/676114944 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f3d7404aa30 con 0x7f3d800a4040 2023-01-01T17:40:14.351 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.351+0000 7f3c5c272700 1 Processor -- start 2023-01-01T17:40:14.352 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.351+0000 7f3c5c272700 1 -- start start 2023-01-01T17:40:14.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.352+0000 7f3c5c272700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f3c5414fa20 0x7f3c5406b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.352+0000 7f3c5c272700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c5414ff30 con 0x7f3c5414c640 2023-01-01T17:40:14.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.352+0000 7f3c5c272700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c5406ada0 con 0x7f3c540c2b10 2023-01-01T17:40:14.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.352+0000 7f3c5c272700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c5414ca10 con 0x7f3c5414fa20 2023-01-01T17:40:14.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.354+0000 7f3c5a80f700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f3c540c2b10 0x7f3c54159920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.61:49128/0 (socket says 172.21.15.61:49128) 2023-01-01T17:40:14.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.354+0000 7f3c5a80f700 1 -- 172.21.15.61:0/2217328067 learned_addr learned my addr 172.21.15.61:0/2217328067 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:40:14.355 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.355+0000 7f3c5900c700 1 -- 172.21.15.61:0/2217328067 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3541121221 0 0) 0x7f3c5406ada0 con 0x7f3c540c2b10 2023-01-01T17:40:14.355 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.355+0000 7f3c5900c700 1 -- 172.21.15.61:0/2217328067 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c400035b0 con 0x7f3c540c2b10 2023-01-01T17:40:14.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.355+0000 7f3c5900c700 1 -- 172.21.15.61:0/2217328067 <== mon.1 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 338339215 0 0) 0x7f3c400035b0 con 0x7f3c540c2b10 2023-01-01T17:40:14.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.355+0000 7f3c5900c700 1 -- 172.21.15.61:0/2217328067 >> v2:172.21.15.61:3300/0 conn(0x7f3c5414fa20 msgr2=0x7f3c5406b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:14.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.355+0000 7f3c5900c700 1 --2- 172.21.15.61:0/2217328067 >> v2:172.21.15.61:3300/0 conn(0x7f3c5414fa20 0x7f3c5406b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.355+0000 7f3c5900c700 1 -- 172.21.15.61:0/2217328067 >> v1:172.21.15.61:6789/0 conn(0x7f3c5414c640 legacy=0x7f3c540c1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:14.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.355+0000 7f3c5900c700 1 -- 172.21.15.61:0/2217328067 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c540bf6c0 con 0x7f3c540c2b10 2023-01-01T17:40:14.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.355+0000 7f3c5900c700 1 -- 172.21.15.61:0/2217328067 <== mon.1 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586489653 0 0) 0x7f3c4c0019f0 con 0x7f3c540c2b10 2023-01-01T17:40:14.356 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.356+0000 7f3c5900c700 1 -- 172.21.15.61:0/2217328067 >> v1:172.21.15.149:6789/0 conn(0x7f3c540c2b10 legacy=0x7f3c54159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.356+0000 7f3c5900c700 1 --2- 172.21.15.61:0/2217328067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c40003a00 0x7f3c40003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.356+0000 7f3c5900c700 1 --2- 172.21.15.61:0/2217328067 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3c40004850 0x7f3c40004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.356+0000 7f3c5900c700 1 --2- 172.21.15.61:0/2217328067 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c40005400 0x7f3c4000cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.356+0000 7f3c5900c700 1 -- 172.21.15.61:0/2217328067 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5414ca10 con 0x7f3c40004850 2023-01-01T17:40:14.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.356+0000 7f3c5900c700 1 -- 172.21.15.61:0/2217328067 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4000d440 con 0x7f3c40003a00 2023-01-01T17:40:14.357 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.356+0000 7f3c5900c700 1 -- 172.21.15.61:0/2217328067 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4000d600 con 0x7f3c40005400 2023-01-01T17:40:14.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.359+0000 7f3c5a80f700 1 --2- 172.21.15.61:0/2217328067 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c40005400 0x7f3c4000cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.360+0000 7f3c5a80f700 1 -- 172.21.15.61:0/2217328067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c40003a00 msgr2=0x7f3c40003df0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:40:14.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.360+0000 7f3c5a80f700 1 --2- 172.21.15.61:0/2217328067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c40003a00 0x7f3c40003df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.360+0000 7f3c5a80f700 1 -- 172.21.15.61:0/2217328067 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3c40004850 msgr2=0x7f3c40004cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:40:14.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.360+0000 7f3c5a80f700 1 --2- 172.21.15.61:0/2217328067 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3c40004850 0x7f3c40004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.361 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.360+0000 7f3c5a80f700 1 -- 172.21.15.61:0/2217328067 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c540bf6c0 con 0x7f3c40005400 2023-01-01T17:40:14.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.360+0000 7f3c5a80f700 1 -- 172.21.15.61:0/2217328067 reap_dead start 2023-01-01T17:40:14.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.360+0000 7f3c5a80f700 1 --2- 172.21.15.61:0/2217328067 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c40005400 0x7f3c4000cb60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c008590 tx=0x7f3c40005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32b2cccc267c4e45 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:14.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.360+0000 7f3c5900c700 1 -- 172.21.15.61:0/2217328067 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c008310 con 0x7f3c40005400 2023-01-01T17:40:14.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.361+0000 7f3c5900c700 1 -- 172.21.15.61:0/2217328067 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4c006570 con 0x7f3c40005400 2023-01-01T17:40:14.362 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.361+0000 7f3c5900c700 1 -- 172.21.15.61:0/2217328067 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c006920 con 0x7f3c40005400 2023-01-01T17:40:14.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.363+0000 7f3c5c272700 1 -- 172.21.15.61:0/2217328067 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c40005400 msgr2=0x7f3c4000cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.363 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.363+0000 7f3c5c272700 1 --2- 172.21.15.61:0/2217328067 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c40005400 0x7f3c4000cb60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c008590 tx=0x7f3c40005880 comp rx=0 tx=0).stop 2023-01-01T17:40:14.422 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.363+0000 7f3c5c272700 1 -- 172.21.15.61:0/2217328067 shutdown_connections 2023-01-01T17:40:14.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.363+0000 7f3c5c272700 1 --2- 172.21.15.61:0/2217328067 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c40005400 0x7f3c4000cb60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.363+0000 7f3c5c272700 1 -- 172.21.15.61:0/2217328067 >> 172.21.15.61:0/2217328067 conn(0x7f3c54069fb0 msgr2=0x7f3c540a6740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:14.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.364+0000 7f3c5c272700 1 -- 172.21.15.61:0/2217328067 shutdown_connections 2023-01-01T17:40:14.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.364+0000 7f3c5c272700 1 -- 172.21.15.61:0/2217328067 wait complete. 2023-01-01T17:40:14.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.414+0000 7fde75d27700 1 Processor -- start 2023-01-01T17:40:14.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.414+0000 7fde75d27700 1 -- start start 2023-01-01T17:40:14.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.415+0000 7fde75d27700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fde700bf590 0x7fde700c3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.423 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.415+0000 7fde75d27700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fde700a4040 0x7fde700c4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.415+0000 7fde75d27700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde700c13f0 con 0x7fde700713d0 2023-01-01T17:40:14.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.415+0000 7fde75d27700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde70089480 con 0x7fde700bf590 2023-01-01T17:40:14.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.415+0000 7fde75d27700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde7006c170 con 0x7fde700a4040 2023-01-01T17:40:14.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.416+0000 7fde6f7fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fde700713d0 0x7fde700c1620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40664/0 (socket says 172.21.15.61:40664) 2023-01-01T17:40:14.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.416+0000 7fde6f7fe700 1 -- 172.21.15.61:0/251468620 learned_addr learned my addr 172.21.15.61:0/251468620 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:40:14.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.416+0000 7fde6ffff700 1 --2- 172.21.15.61:0/251468620 >> v2:172.21.15.149:3300/0 conn(0x7fde700a4040 0x7fde700c4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.424 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.416+0000 7fde6effd700 1 --2- 172.21.15.61:0/251468620 >> v2:172.21.15.61:3300/0 conn(0x7fde700bf590 0x7fde700c3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.416+0000 7fde6e7fc700 1 -- 172.21.15.61:0/251468620 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 529391694 0 0) 0x7fde700c13f0 con 0x7fde700713d0 2023-01-01T17:40:14.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.422+0000 7fde6e7fc700 1 -- 172.21.15.61:0/251468620 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde580079c0 con 0x7fde700713d0 2023-01-01T17:40:14.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.422+0000 7fde6effd700 1 -- 172.21.15.61:0/251468620 >> v2:172.21.15.149:3300/0 conn(0x7fde700a4040 msgr2=0x7fde700c4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:14.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.422+0000 7fde6effd700 1 --2- 172.21.15.61:0/251468620 >> v2:172.21.15.149:3300/0 conn(0x7fde700a4040 0x7fde700c4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.422+0000 7fde6effd700 1 -- 172.21.15.61:0/251468620 >> v1:172.21.15.61:6789/0 conn(0x7fde700713d0 legacy=0x7fde700c1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.422+0000 7fde6effd700 1 -- 172.21.15.61:0/251468620 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde700c3b60 con 0x7fde700bf590 2023-01-01T17:40:14.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.423+0000 7fde6effd700 1 --2- 172.21.15.61:0/251468620 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde700bf590 0x7fde700c3ff0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fde700b86c0 tx=0x7fde6000b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b43b4ab872939f server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:14.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.423+0000 7fde6e7fc700 1 -- 172.21.15.61:0/251468620 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde60016b80 con 0x7fde700bf590 2023-01-01T17:40:14.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.423+0000 7fde6e7fc700 1 -- 172.21.15.61:0/251468620 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde60016ce0 con 0x7fde700bf590 2023-01-01T17:40:14.425 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.423+0000 7fde6e7fc700 1 -- 172.21.15.61:0/251468620 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6000c250 con 0x7fde700bf590 2023-01-01T17:40:14.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.423+0000 7f3c5c272700 1 Processor -- start 2023-01-01T17:40:14.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.424+0000 7fde75d27700 1 -- 172.21.15.61:0/251468620 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde700bf590 msgr2=0x7fde700c3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.426 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.424+0000 7fde75d27700 1 --2- 172.21.15.61:0/251468620 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde700bf590 0x7fde700c3ff0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fde700b86c0 tx=0x7fde6000b560 comp rx=0 tx=0).stop 2023-01-01T17:40:14.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.425+0000 7fde75d27700 1 -- 172.21.15.61:0/251468620 shutdown_connections 2023-01-01T17:40:14.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.425+0000 7fde75d27700 1 --2- 172.21.15.61:0/251468620 >> v2:172.21.15.149:3300/0 conn(0x7fde700a4040 0x7fde700c4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.425+0000 7fde75d27700 1 --2- 172.21.15.61:0/251468620 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde700bf590 0x7fde700c3ff0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.425+0000 7fde75d27700 1 -- 172.21.15.61:0/251468620 >> 172.21.15.61:0/251468620 conn(0x7fde70069fb0 msgr2=0x7fde700a6740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:14.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.425+0000 7fde75d27700 1 -- 172.21.15.61:0/251468620 shutdown_connections 2023-01-01T17:40:14.427 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.425+0000 7fde75d27700 1 -- 172.21.15.61:0/251468620 wait complete. 2023-01-01T17:40:14.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.424+0000 7f3c5c272700 1 -- start start 2023-01-01T17:40:14.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.425+0000 7f3c5c272700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3c40005400 0x7f3c5414b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.425+0000 7f3c5c272700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c54147150 0x7f3c540badb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.425+0000 7f3c5c272700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c540a7a40 0x7f3c540bb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.425+0000 7f3c5c272700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c540a9220 con 0x7f3c40005400 2023-01-01T17:40:14.428 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.425+0000 7f3c5c272700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c54070d20 con 0x7f3c54147150 2023-01-01T17:40:14.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.425+0000 7f3c5c272700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c540a5220 con 0x7f3c540a7a40 2023-01-01T17:40:14.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.425+0000 7f3c5a00e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3c40005400 0x7f3c5414b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.425+0000 7f3c5a00e700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3c40005400 0x7f3c5414b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46820/0 (socket says 172.21.15.61:46820) 2023-01-01T17:40:14.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.425+0000 7f3c5a00e700 1 -- 172.21.15.61:0/2075359518 learned_addr learned my addr 172.21.15.61:0/2075359518 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:14.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.426+0000 7f3c5a00e700 1 -- 172.21.15.61:0/2075359518 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c540a7a40 msgr2=0x7f3c540bb2f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-01-01T17:40:14.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.426+0000 7f3c5a00e700 1 --2- 172.21.15.61:0/2075359518 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c540a7a40 0x7f3c540bb2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.426+0000 7f3c5a00e700 1 -- 172.21.15.61:0/2075359518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c54147150 msgr2=0x7f3c540badb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-01-01T17:40:14.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.426+0000 7f3c5a00e700 1 --2- 172.21.15.61:0/2075359518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c54147150 0x7f3c540badb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.426+0000 7f3c5a00e700 1 -- 172.21.15.61:0/2075359518 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c540c3200 con 0x7f3c40005400 2023-01-01T17:40:14.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.426+0000 7f3c5a00e700 1 --2- 172.21.15.61:0/2075359518 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3c40005400 0x7f3c5414b4c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3c5000c310 tx=0x7f3c5000c6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:14.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.426+0000 7f3c4affd700 1 -- 172.21.15.61:0/2075359518 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c500052d0 con 0x7f3c40005400 2023-01-01T17:40:14.429 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.426+0000 7f3c5c272700 1 -- 172.21.15.61:0/2075359518 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c540bf9a0 con 0x7f3c40005400 2023-01-01T17:40:14.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.426+0000 7f3c5c272700 1 -- 172.21.15.61:0/2075359518 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c540bef20 con 0x7f3c40005400 2023-01-01T17:40:14.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.427+0000 7fde75d27700 1 Processor -- start 2023-01-01T17:40:14.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.427+0000 7f3c4affd700 1 -- 172.21.15.61:0/2075359518 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c50005430 con 0x7f3c40005400 2023-01-01T17:40:14.430 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.427+0000 7f3c4affd700 1 -- 172.21.15.61:0/2075359518 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c50003880 con 0x7f3c40005400 2023-01-01T17:40:14.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.427+0000 7fde75d27700 1 -- start start 2023-01-01T17:40:14.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.428+0000 7fde75d27700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde700713d0 0x7fde700862a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.428+0000 7fde75d27700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde700a4040 0x7fde700b7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.428+0000 7fde75d27700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde700bf590 0x7fde700b8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.431 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.428+0000 7fde75d27700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde700b8580 con 0x7fde700a4040 2023-01-01T17:40:14.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.428+0000 7fde75d27700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde701f4b40 con 0x7fde700bf590 2023-01-01T17:40:14.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.428+0000 7fde75d27700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde701f4e00 con 0x7fde700713d0 2023-01-01T17:40:14.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.428+0000 7fde6effd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde700a4040 0x7fde700b7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.428+0000 7fde6effd700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde700a4040 0x7fde700b7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46830/0 (socket says 172.21.15.61:46830) 2023-01-01T17:40:14.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.428+0000 7fde6effd700 1 -- 172.21.15.61:0/3895902975 learned_addr learned my addr 172.21.15.61:0/3895902975 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:14.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.428+0000 7fde6ffff700 1 --2- 172.21.15.61:0/3895902975 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde700bf590 0x7fde700b8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.429+0000 7fde6f7fe700 1 --2- 172.21.15.61:0/3895902975 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde700713d0 0x7fde700862a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.429+0000 7fde6ffff700 1 -- 172.21.15.61:0/3895902975 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde700713d0 msgr2=0x7fde700862a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.429+0000 7fde6ffff700 1 --2- 172.21.15.61:0/3895902975 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde700713d0 0x7fde700862a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.429+0000 7fde6ffff700 1 -- 172.21.15.61:0/3895902975 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde700a4040 msgr2=0x7fde700b7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.432 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.429+0000 7fde6ffff700 1 --2- 172.21.15.61:0/3895902975 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde700a4040 0x7fde700b7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.429+0000 7fde6ffff700 1 -- 172.21.15.61:0/3895902975 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde60005f90 con 0x7fde700bf590 2023-01-01T17:40:14.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.429+0000 7fde6ffff700 1 --2- 172.21.15.61:0/3895902975 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde700bf590 0x7fde700b8040 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fde68007ae0 tx=0x7fde68007df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:14.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.429+0000 7f3c4affd700 1 -- 172.21.15.61:0/2075359518 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f3c50019030 con 0x7f3c40005400 2023-01-01T17:40:14.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.430+0000 7f3c4affd700 1 --2- 172.21.15.61:0/2075359518 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3c38063290 0x7f3c38065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.430+0000 7f3c4affd700 1 -- 172.21.15.61:0/2075359518 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3c5007f140 con 0x7f3c40005400 2023-01-01T17:40:14.433 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.429+0000 7fde57fff700 1 -- 172.21.15.61:0/3895902975 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde68003c20 con 0x7fde700bf590 2023-01-01T17:40:14.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.429+0000 7fde57fff700 1 -- 172.21.15.61:0/3895902975 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde6800f040 con 0x7fde700bf590 2023-01-01T17:40:14.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.429+0000 7fde57fff700 1 -- 172.21.15.61:0/3895902975 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6800d890 con 0x7fde700bf590 2023-01-01T17:40:14.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.429+0000 7fde75d27700 1 -- 172.21.15.61:0/3895902975 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde700c1110 con 0x7fde700bf590 2023-01-01T17:40:14.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.429+0000 7fde75d27700 1 -- 172.21.15.61:0/3895902975 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde700c0e50 con 0x7fde700bf590 2023-01-01T17:40:14.434 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.431+0000 7f3c5c272700 1 -- 172.21.15.61:0/2075359518 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c3c0052f0 con 0x7f3c40005400 2023-01-01T17:40:14.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.433+0000 7fde57fff700 1 -- 172.21.15.61:0/3895902975 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7fde68013070 con 0x7fde700bf590 2023-01-01T17:40:14.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.433+0000 7fde57fff700 1 --2- 172.21.15.61:0/3895902975 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fde5c0632e0 0x7fde5c065790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.433+0000 7fde57fff700 1 -- 172.21.15.61:0/3895902975 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fde6807f7a0 con 0x7fde700bf590 2023-01-01T17:40:14.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.434+0000 7fde6f7fe700 1 --2- 172.21.15.61:0/3895902975 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fde5c0632e0 0x7fde5c065790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.434+0000 7fde6f7fe700 1 --2- 172.21.15.61:0/3895902975 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fde5c0632e0 0x7fde5c065790 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fde64000f60 tx=0x7fde64007db0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:14.435 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.435+0000 7fde75d27700 1 -- 172.21.15.61:0/3895902975 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde500052f0 con 0x7fde700bf590 2023-01-01T17:40:14.436 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.436+0000 7fac14e5f700 1 Processor -- start 2023-01-01T17:40:14.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.436+0000 7f1bf440a700 1 Processor -- start 2023-01-01T17:40:14.437 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.436+0000 7fac14e5f700 1 -- start start 2023-01-01T17:40:14.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.438+0000 7fac14e5f700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac100714b0 0x7fac101528a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.438+0000 7fac14e5f700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fac1006fc40 0x7fac10159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.438 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.438+0000 7fac14e5f700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac1006db90 con 0x7fac1014c810 2023-01-01T17:40:14.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.438+0000 7fac14e5f700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac1006d7a0 con 0x7fac1006fc40 2023-01-01T17:40:14.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.438+0000 7fac14e5f700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac100bc3e0 con 0x7fac100714b0 2023-01-01T17:40:14.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.438+0000 7fac0ed9d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fac1006fc40 0x7fac10159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.438+0000 7fac0ed9d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7fac1006fc40 0x7fac10159bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46838/0 (socket says 172.21.15.61:46838) 2023-01-01T17:40:14.439 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.438+0000 7fac0ed9d700 1 -- 172.21.15.61:0/976830736 learned_addr learned my addr 172.21.15.61:0/976830736 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:14.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.437+0000 7f1bf440a700 1 -- start start 2023-01-01T17:40:14.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.438+0000 7f1bf440a700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1bec06b940 0x7f1bec15a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.438+0000 7f1bf440a700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bec14ff30 con 0x7f1bec14c640 2023-01-01T17:40:14.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.438+0000 7f1bf440a700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bec06ada0 con 0x7f1bec14fa20 2023-01-01T17:40:14.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.438+0000 7f1bf440a700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bec14ca10 con 0x7f1bec06b940 2023-01-01T17:40:14.440 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.439+0000 7fac0dd9b700 1 --2- 172.21.15.61:0/976830736 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac100714b0 0x7fac101528a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.439+0000 7f1bf21a6700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f1bec14c640 0x7f1bec0c1620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40692/0 (socket says 172.21.15.61:40692) 2023-01-01T17:40:14.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.439+0000 7f1bf21a6700 1 -- 172.21.15.61:0/943184727 learned_addr learned my addr 172.21.15.61:0/943184727 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:40:14.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.439+0000 7f1bf29a7700 1 --2- 172.21.15.61:0/943184727 >> v2:172.21.15.149:3300/0 conn(0x7f1bec06b940 0x7f1bec15a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.439+0000 7fac0ed9d700 1 -- 172.21.15.61:0/976830736 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac100714b0 msgr2=0x7fac101528a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:14.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.439+0000 7fac0ed9d700 1 --2- 172.21.15.61:0/976830736 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac100714b0 0x7fac101528a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.439+0000 7fac0ed9d700 1 -- 172.21.15.61:0/976830736 >> v1:172.21.15.149:6789/0 conn(0x7fac1014c810 legacy=0x7fac1006a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:14.441 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.439+0000 7fac0ed9d700 1 -- 172.21.15.61:0/976830736 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac100bc100 con 0x7fac1006fc40 2023-01-01T17:40:14.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.439+0000 7f1bf29a7700 1 -- 172.21.15.61:0/943184727 >> v1:172.21.15.149:6789/0 conn(0x7f1bec14fa20 legacy=0x7f1bec06b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:14.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.439+0000 7f1bf29a7700 1 -- 172.21.15.61:0/943184727 >> v1:172.21.15.61:6789/0 conn(0x7f1bec14c640 legacy=0x7f1bec0c1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.439+0000 7f1bf29a7700 1 -- 172.21.15.61:0/943184727 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bec0bf6c0 con 0x7f1bec06b940 2023-01-01T17:40:14.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.440+0000 7fac0ed9d700 1 --2- 172.21.15.61:0/976830736 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fac1006fc40 0x7fac10159bd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fac0800d180 tx=0x7fac0800d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb65742515c9ecd server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:14.442 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.440+0000 7f1bf29a7700 1 --2- 172.21.15.61:0/943184727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bec06b940 0x7f1bec15a930 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1be4009c80 tx=0x7f1be4009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c95c6f8681cd6f6a server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:14.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.440+0000 7f3c4affd700 1 -- 172.21.15.61:0/2075359518 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f3c5004aa30 con 0x7f3c40005400 2023-01-01T17:40:14.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.440+0000 7f3c5980d700 1 --2- 172.21.15.61:0/2075359518 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3c38063290 0x7f3c38065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.441+0000 7f3c5980d700 1 --2- 172.21.15.61:0/2075359518 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3c38063290 0x7f3c38065740 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3c44009790 tx=0x7f3c44006d70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:14.443 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.440+0000 7f1bf11a4700 1 -- 172.21.15.61:0/943184727 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be400ca70 con 0x7f1bec06b940 2023-01-01T17:40:14.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.440+0000 7f1bf11a4700 1 -- 172.21.15.61:0/943184727 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be400cbd0 con 0x7f1bec06b940 2023-01-01T17:40:14.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.440+0000 7f1bf11a4700 1 -- 172.21.15.61:0/943184727 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be4003a20 con 0x7f1bec06b940 2023-01-01T17:40:14.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.440+0000 7fac0d59a700 1 -- 172.21.15.61:0/976830736 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac08010070 con 0x7fac1006fc40 2023-01-01T17:40:14.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.440+0000 7fac0d59a700 1 -- 172.21.15.61:0/976830736 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0800dab0 con 0x7fac1006fc40 2023-01-01T17:40:14.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.440+0000 7fac0d59a700 1 -- 172.21.15.61:0/976830736 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0800de40 con 0x7fac1006fc40 2023-01-01T17:40:14.444 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.441+0000 7f1bf440a700 1 -- 172.21.15.61:0/943184727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bec06b940 msgr2=0x7f1bec15a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.441+0000 7f1bf440a700 1 --2- 172.21.15.61:0/943184727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bec06b940 0x7f1bec15a930 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1be4009c80 tx=0x7f1be4009f90 comp rx=0 tx=0).stop 2023-01-01T17:40:14.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.442+0000 7fac14e5f700 1 -- 172.21.15.61:0/976830736 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fac1006fc40 msgr2=0x7fac10159bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.442+0000 7fac14e5f700 1 --2- 172.21.15.61:0/976830736 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fac1006fc40 0x7fac10159bd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fac0800d180 tx=0x7fac0800d490 comp rx=0 tx=0).stop 2023-01-01T17:40:14.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.442+0000 7f1bf440a700 1 -- 172.21.15.61:0/943184727 shutdown_connections 2023-01-01T17:40:14.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.442+0000 7f1bf440a700 1 --2- 172.21.15.61:0/943184727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bec06b940 0x7f1bec15a930 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.445 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.442+0000 7f1bf440a700 1 -- 172.21.15.61:0/943184727 >> 172.21.15.61:0/943184727 conn(0x7f1bec069fb0 msgr2=0x7f1bec0a6740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:14.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.444+0000 7fac14e5f700 1 -- 172.21.15.61:0/976830736 shutdown_connections 2023-01-01T17:40:14.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.444+0000 7fac14e5f700 1 --2- 172.21.15.61:0/976830736 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fac1006fc40 0x7fac10159bd0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.444+0000 7fac14e5f700 1 --2- 172.21.15.61:0/976830736 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac100714b0 0x7fac101528a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.444+0000 7fac14e5f700 1 -- 172.21.15.61:0/976830736 >> 172.21.15.61:0/976830736 conn(0x7fac100c1f30 msgr2=0x7fac100c2330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:14.447 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.444+0000 7fde57fff700 1 -- 172.21.15.61:0/3895902975 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7fde6804ca30 con 0x7fde700bf590 2023-01-01T17:40:14.448 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.444+0000 7fac14e5f700 1 -- 172.21.15.61:0/976830736 shutdown_connections 2023-01-01T17:40:14.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.450+0000 7f1bf440a700 1 -- 172.21.15.61:0/943184727 shutdown_connections 2023-01-01T17:40:14.450 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.444+0000 7fac14e5f700 1 -- 172.21.15.61:0/976830736 wait complete. 2023-01-01T17:40:14.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.446+0000 7fac14e5f700 1 Processor -- start 2023-01-01T17:40:14.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.446+0000 7fac14e5f700 1 -- start start 2023-01-01T17:40:14.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.447+0000 7fac14e5f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac1006fc40 0x7fac1013e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.447+0000 7fac14e5f700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fac100714b0 0x7fac1014acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.447+0000 7fac14e5f700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac1014c810 0x7fac10142990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.447+0000 7fac14e5f700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac10089690 con 0x7fac100714b0 2023-01-01T17:40:14.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.447+0000 7fac14e5f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac10089930 con 0x7fac1006fc40 2023-01-01T17:40:14.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.447+0000 7fac14e5f700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac10089dc0 con 0x7fac1014c810 2023-01-01T17:40:14.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.448+0000 7fac0e59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac1006fc40 0x7fac1013e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.448+0000 7fac0e59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac1006fc40 0x7fac1013e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.61:42684/0 (socket says 172.21.15.61:42684) 2023-01-01T17:40:14.451 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.448+0000 7fac0e59c700 1 -- 172.21.15.61:0/3685198316 learned_addr learned my addr 172.21.15.61:0/3685198316 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:14.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.448+0000 7fac0ed9d700 1 --2- 172.21.15.61:0/3685198316 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac1014c810 0x7fac10142990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.448+0000 7fac0e59c700 1 -- 172.21.15.61:0/3685198316 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac1014c810 msgr2=0x7fac10142990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.448+0000 7fac0e59c700 1 --2- 172.21.15.61:0/3685198316 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac1014c810 0x7fac10142990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.448+0000 7fac0e59c700 1 -- 172.21.15.61:0/3685198316 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fac100714b0 msgr2=0x7fac1014acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.448+0000 7fac0e59c700 1 --2- 172.21.15.61:0/3685198316 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fac100714b0 0x7fac1014acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.448+0000 7fac0e59c700 1 -- 172.21.15.61:0/3685198316 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0800bd40 con 0x7fac1006fc40 2023-01-01T17:40:14.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.448+0000 7fac0ed9d700 1 --2- 172.21.15.61:0/3685198316 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac1014c810 0x7fac10142990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-01-01T17:40:14.452 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.448+0000 7fac0e59c700 1 --2- 172.21.15.61:0/3685198316 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac1006fc40 0x7fac1013e490 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fac0400b4a0 tx=0x7fac0400b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:14.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.451+0000 7fabfeffd700 1 -- 172.21.15.61:0/3685198316 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac04011830 con 0x7fac1006fc40 2023-01-01T17:40:14.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.451+0000 7fabfeffd700 1 -- 172.21.15.61:0/3685198316 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac04011990 con 0x7fac1006fc40 2023-01-01T17:40:14.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.451+0000 7fabfeffd700 1 -- 172.21.15.61:0/3685198316 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac04011d40 con 0x7fac1006fc40 2023-01-01T17:40:14.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.452+0000 7fac14e5f700 1 -- 172.21.15.61:0/3685198316 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac100bbb40 con 0x7fac1006fc40 2023-01-01T17:40:14.453 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.452+0000 7fac14e5f700 1 -- 172.21.15.61:0/3685198316 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac100bb860 con 0x7fac1006fc40 2023-01-01T17:40:14.454 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.453+0000 7fac14e5f700 1 -- 172.21.15.61:0/3685198316 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac1006d430 con 0x7fac1006fc40 2023-01-01T17:40:14.458 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.458+0000 7f1bf440a700 1 -- 172.21.15.61:0/943184727 wait complete. 2023-01-01T17:40:14.459 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.458+0000 7fabfeffd700 1 -- 172.21.15.61:0/3685198316 <== mon.1 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7fac0400f050 con 0x7fac1006fc40 2023-01-01T17:40:14.459 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.458+0000 7fabfeffd700 1 --2- 172.21.15.61:0/3685198316 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fabf0067770 0x7fabf0069c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.459 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.458+0000 7fabfeffd700 1 -- 172.21.15.61:0/3685198316 <== mon.1 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fac0407f960 con 0x7fac1006fc40 2023-01-01T17:40:14.459 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.459+0000 7fac0dd9b700 1 --2- 172.21.15.61:0/3685198316 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fabf0067770 0x7fabf0069c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.460+0000 7fac0dd9b700 1 --2- 172.21.15.61:0/3685198316 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fabf0067770 0x7fabf0069c20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fac00006b20 tx=0x7fac00006ab0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:14.460 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.460+0000 7f1bf440a700 1 Processor -- start 2023-01-01T17:40:14.463 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.463+0000 7fabfeffd700 1 -- 172.21.15.61:0/3685198316 <== mon.1 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7fac0404e6b0 con 0x7fac1006fc40 2023-01-01T17:40:14.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.462+0000 7f1bf440a700 1 -- start start 2023-01-01T17:40:14.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.463+0000 7f1bf440a700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1bec06b940 0x7f1bec0b9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.463+0000 7f1bf440a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bec14c640 0x7f1bec0ba2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.463+0000 7f1bf440a700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1bec14fa20 0x7f1bec1ecb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.464 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.463+0000 7f1bf440a700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec0be650 con 0x7f1bec06b940 2023-01-01T17:40:14.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.463+0000 7f1bf440a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec1ed7d0 con 0x7f1bec14c640 2023-01-01T17:40:14.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.463+0000 7f1bf440a700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bec0b9880 con 0x7f1bec14fa20 2023-01-01T17:40:14.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.463+0000 7f1bf29a7700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1bec14fa20 0x7f1bec1ecb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.463+0000 7f1bf29a7700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1bec14fa20 0x7f1bec1ecb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.61:45096/0 (socket says 172.21.15.61:45096) 2023-01-01T17:40:14.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.463+0000 7f1bf29a7700 1 -- 172.21.15.61:0/3771502803 learned_addr learned my addr 172.21.15.61:0/3771502803 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:14.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.464+0000 7f1bf29a7700 1 -- 172.21.15.61:0/3771502803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bec14c640 msgr2=0x7f1bec0ba2a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-01-01T17:40:14.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.464+0000 7f1bf29a7700 1 --2- 172.21.15.61:0/3771502803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bec14c640 0x7f1bec0ba2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.464+0000 7f1bf29a7700 1 -- 172.21.15.61:0/3771502803 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1bec06b940 msgr2=0x7f1bec0b9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.464+0000 7f1bf29a7700 1 --2- 172.21.15.61:0/3771502803 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1bec06b940 0x7f1bec0b9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.465 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.464+0000 7f1bf29a7700 1 -- 172.21.15.61:0/3771502803 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be400d040 con 0x7f1bec14fa20 2023-01-01T17:40:14.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.469+0000 7f1bf29a7700 1 --2- 172.21.15.61:0/3771502803 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1bec14fa20 0x7f1bec1ecb00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1be4004000 tx=0x7f1be4004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:14.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.478+0000 7f1be2ffd700 1 -- 172.21.15.61:0/3771502803 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be401f070 con 0x7f1bec14fa20 2023-01-01T17:40:14.478 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.478+0000 7f1be2ffd700 1 -- 172.21.15.61:0/3771502803 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be4004650 con 0x7f1bec14fa20 2023-01-01T17:40:14.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.478+0000 7f1be2ffd700 1 -- 172.21.15.61:0/3771502803 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be4004800 con 0x7f1bec14fa20 2023-01-01T17:40:14.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.478+0000 7f1bf440a700 1 -- 172.21.15.61:0/3771502803 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bec0c3200 con 0x7f1bec14fa20 2023-01-01T17:40:14.479 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.478+0000 7f1bf440a700 1 -- 172.21.15.61:0/3771502803 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bec0bf9a0 con 0x7f1bec14fa20 2023-01-01T17:40:14.484 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.484+0000 7f1be2ffd700 1 -- 172.21.15.61:0/3771502803 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f1be4017070 con 0x7f1bec14fa20 2023-01-01T17:40:14.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.485+0000 7f1be2ffd700 1 --2- 172.21.15.61:0/3771502803 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f1bd0063360 0x7f1bd0065810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.485 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.485+0000 7f1be2ffd700 1 -- 172.21.15.61:0/3771502803 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1be40812f0 con 0x7f1bec14fa20 2023-01-01T17:40:14.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.486+0000 7f1bf21a6700 1 --2- 172.21.15.61:0/3771502803 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f1bd0063360 0x7f1bd0065810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.486+0000 7f1bf21a6700 1 --2- 172.21.15.61:0/3771502803 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f1bd0063360 0x7f1bd0065810 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc00b700 tx=0x7f1bdc005b90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:14.486 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.486+0000 7f1bf440a700 1 -- 172.21.15.61:0/3771502803 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd40052f0 con 0x7f1bec14fa20 2023-01-01T17:40:14.491 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.491+0000 7f442d834700 1 Processor -- start 2023-01-01T17:40:14.492 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.492+0000 7f1be2ffd700 1 -- 172.21.15.61:0/3771502803 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f1be4050040 con 0x7f1bec14fa20 2023-01-01T17:40:14.492 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.491+0000 7f442d834700 1 -- start start 2023-01-01T17:40:14.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.492+0000 7f442d834700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4428151130 0x7f4428070fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.492+0000 7f442d834700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f442815a6d0 0x7f442815aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.492+0000 7f442d834700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f442806f300 con 0x7f44280c0b60 2023-01-01T17:40:14.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.492+0000 7f442d834700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f442806f5e0 con 0x7f4428151130 2023-01-01T17:40:14.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.492+0000 7f442d834700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44280c1450 con 0x7f442815a6d0 2023-01-01T17:40:14.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.492+0000 7f44277fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f442815a6d0 0x7f442815aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.492+0000 7f44277fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f442815a6d0 0x7f442815aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.61:42702/0 (socket says 172.21.15.61:42702) 2023-01-01T17:40:14.493 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.492+0000 7f44277fe700 1 -- 172.21.15.61:0/980923221 learned_addr learned my addr 172.21.15.61:0/980923221 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:14.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.492+0000 7f44277fe700 1 -- 172.21.15.61:0/980923221 >> v2:172.21.15.61:3300/0 conn(0x7f4428151130 msgr2=0x7f4428070fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:14.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.492+0000 7f44277fe700 1 --2- 172.21.15.61:0/980923221 >> v2:172.21.15.61:3300/0 conn(0x7f4428151130 0x7f4428070fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.495 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.492+0000 7f44277fe700 1 -- 172.21.15.61:0/980923221 >> v1:172.21.15.149:6789/0 conn(0x7f44280c0b60 legacy=0x7f44280c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:14.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.492+0000 7f44277fe700 1 -- 172.21.15.61:0/980923221 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44280c2980 con 0x7f442815a6d0 2023-01-01T17:40:14.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.493+0000 7f44277fe700 1 --2- 172.21.15.61:0/980923221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f442815a6d0 0x7f442815aaf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f44280c27d0 tx=0x7f441c009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=765e4c1af8359277 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:14.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.495+0000 7f4425ffb700 1 -- 172.21.15.61:0/980923221 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c004230 con 0x7f442815a6d0 2023-01-01T17:40:14.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.495+0000 7f4425ffb700 1 -- 172.21.15.61:0/980923221 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441c004390 con 0x7f442815a6d0 2023-01-01T17:40:14.496 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.495+0000 7f4425ffb700 1 -- 172.21.15.61:0/980923221 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c0036a0 con 0x7f442815a6d0 2023-01-01T17:40:14.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.496+0000 7f442d834700 1 -- 172.21.15.61:0/980923221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f442815a6d0 msgr2=0x7f442815aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.502 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.496+0000 7f442d834700 1 --2- 172.21.15.61:0/980923221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f442815a6d0 0x7f442815aaf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f44280c27d0 tx=0x7f441c009bd0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.502+0000 7f442d834700 1 -- 172.21.15.61:0/980923221 shutdown_connections 2023-01-01T17:40:14.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.502+0000 7f442d834700 1 --2- 172.21.15.61:0/980923221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f442815a6d0 0x7f442815aaf0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.502+0000 7f442d834700 1 --2- 172.21.15.61:0/980923221 >> v2:172.21.15.61:3300/0 conn(0x7f4428151130 0x7f4428070fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.503 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.502+0000 7f442d834700 1 -- 172.21.15.61:0/980923221 >> 172.21.15.61:0/980923221 conn(0x7f4428069360 msgr2=0x7f4428069760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:14.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.502+0000 7f442d834700 1 -- 172.21.15.61:0/980923221 shutdown_connections 2023-01-01T17:40:14.504 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.502+0000 7f442d834700 1 -- 172.21.15.61:0/980923221 wait complete. 2023-01-01T17:40:14.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.504+0000 7f442d834700 1 Processor -- start 2023-01-01T17:40:14.505 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.505+0000 7f442d834700 1 -- start start 2023-01-01T17:40:14.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.506+0000 7f442d834700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44280c0b60 0x7f442813a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.506+0000 7f442d834700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4428151130 0x7f442813e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.506+0000 7f442d834700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f442815a6d0 0x7f4428137d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.506+0000 7f442d834700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442813ae30 con 0x7f442815a6d0 2023-01-01T17:40:14.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.506+0000 7f442d834700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442813a460 con 0x7f44280c0b60 2023-01-01T17:40:14.506 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.506+0000 7f442d834700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44281f92b0 con 0x7f4428151130 2023-01-01T17:40:14.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.507+0000 7f4426ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44280c0b60 0x7f442813a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.507+0000 7f4426ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44280c0b60 0x7f442813a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.61:42708/0 (socket says 172.21.15.61:42708) 2023-01-01T17:40:14.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.507+0000 7f4426ffd700 1 -- 172.21.15.61:0/229513206 learned_addr learned my addr 172.21.15.61:0/229513206 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:14.507 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.507+0000 7f44267fc700 1 --2- 172.21.15.61:0/229513206 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4428151130 0x7f442813e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.506+0000 7fa7760df700 1 Processor -- start 2023-01-01T17:40:14.508 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.506+0000 7fa7760df700 1 -- start start 2023-01-01T17:40:14.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.507+0000 7f44267fc700 1 -- 172.21.15.61:0/229513206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44280c0b60 msgr2=0x7f442813a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.507+0000 7f44267fc700 1 --2- 172.21.15.61:0/229513206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44280c0b60 0x7f442813a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.507+0000 7f44267fc700 1 -- 172.21.15.61:0/229513206 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f442815a6d0 msgr2=0x7f4428137d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.507+0000 7f44267fc700 1 --2- 172.21.15.61:0/229513206 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f442815a6d0 0x7f4428137d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.507+0000 7f44267fc700 1 -- 172.21.15.61:0/229513206 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f441c009550 con 0x7f4428151130 2023-01-01T17:40:14.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.507+0000 7f44267fc700 1 --2- 172.21.15.61:0/229513206 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4428151130 0x7f442813e8c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f442000bd50 tx=0x7f442000bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:14.509 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.508+0000 7fa7760df700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa77015aef0 0x7fa7700c0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.508+0000 7fa7760df700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa77006a4d0 0x7fa77006a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.508+0000 7fa7760df700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7700a43d0 con 0x7fa770154530 2023-01-01T17:40:14.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.508+0000 7fa7760df700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa77015b4b0 con 0x7fa77006a4d0 2023-01-01T17:40:14.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.508+0000 7fa7760df700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7700a3e10 con 0x7fa77015aef0 2023-01-01T17:40:14.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.509+0000 7f440ffff700 1 -- 172.21.15.61:0/229513206 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442000cc30 con 0x7f4428151130 2023-01-01T17:40:14.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.509+0000 7f440ffff700 1 -- 172.21.15.61:0/229513206 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442000cdb0 con 0x7f4428151130 2023-01-01T17:40:14.510 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.509+0000 7f440ffff700 1 -- 172.21.15.61:0/229513206 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4420014680 con 0x7f4428151130 2023-01-01T17:40:14.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.509+0000 7f442d834700 1 -- 172.21.15.61:0/229513206 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4428157ee0 con 0x7f4428151130 2023-01-01T17:40:14.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.509+0000 7f442d834700 1 -- 172.21.15.61:0/229513206 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4428157c00 con 0x7f4428151130 2023-01-01T17:40:14.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.509+0000 7fa76ffff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa77006a4d0 0x7fa77006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.509+0000 7fa76effd700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa77015aef0 0x7fa7700c0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.510+0000 7fa76f7fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fa770154530 0x7fa7700c5160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.61:49202/0 (socket says 172.21.15.61:49202) 2023-01-01T17:40:14.511 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.510+0000 7fa76f7fe700 1 -- 172.21.15.61:0/545658222 learned_addr learned my addr 172.21.15.61:0/545658222 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:40:14.512 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.511+0000 7f440ffff700 1 -- 172.21.15.61:0/229513206 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f442001b030 con 0x7f4428151130 2023-01-01T17:40:14.512 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.511+0000 7f440ffff700 1 --2- 172.21.15.61:0/229513206 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f44140632e0 0x7f4414065790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.512 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.511+0000 7f440ffff700 1 -- 172.21.15.61:0/229513206 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f442007fa80 con 0x7f4428151130 2023-01-01T17:40:14.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.512+0000 7fa76ffff700 1 -- 172.21.15.61:0/545658222 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa77015aef0 msgr2=0x7fa7700c0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:14.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.512+0000 7fa76ffff700 1 --2- 172.21.15.61:0/545658222 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa77015aef0 0x7fa7700c0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.512+0000 7fa76ffff700 1 -- 172.21.15.61:0/545658222 >> v1:172.21.15.149:6789/0 conn(0x7fa770154530 legacy=0x7fa7700c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.512+0000 7fa76ffff700 1 -- 172.21.15.61:0/545658222 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7700a40f0 con 0x7fa77006a4d0 2023-01-01T17:40:14.513 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.512+0000 7fa76ffff700 1 --2- 172.21.15.61:0/545658222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa77006a4d0 0x7fa77006a910 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa768009d90 tx=0x7fa76800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc269a734434e023 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:14.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.513+0000 7fa76e7fc700 1 -- 172.21.15.61:0/545658222 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76800e070 con 0x7fa77006a4d0 2023-01-01T17:40:14.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.513+0000 7fa76e7fc700 1 -- 172.21.15.61:0/545658222 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76800bb20 con 0x7fa77006a4d0 2023-01-01T17:40:14.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.513+0000 7fa76e7fc700 1 -- 172.21.15.61:0/545658222 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa768012430 con 0x7fa77006a4d0 2023-01-01T17:40:14.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.514+0000 7fa7760df700 1 -- 172.21.15.61:0/545658222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa77006a4d0 msgr2=0x7fa77006a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.514 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.514+0000 7fa7760df700 1 --2- 172.21.15.61:0/545658222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa77006a4d0 0x7fa77006a910 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa768009d90 tx=0x7fa76800b330 comp rx=0 tx=0).stop 2023-01-01T17:40:14.515 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.514+0000 7fa7760df700 1 -- 172.21.15.61:0/545658222 shutdown_connections 2023-01-01T17:40:14.515 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.514+0000 7fa7760df700 1 --2- 172.21.15.61:0/545658222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa77006a4d0 0x7fa77006a910 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.515 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.514+0000 7fa7760df700 1 --2- 172.21.15.61:0/545658222 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa77015aef0 0x7fa7700c0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.515 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.514+0000 7fa7760df700 1 -- 172.21.15.61:0/545658222 >> 172.21.15.61:0/545658222 conn(0x7fa770069ff0 msgr2=0x7fa7700c4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:14.515 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.514+0000 7fa7760df700 1 -- 172.21.15.61:0/545658222 shutdown_connections 2023-01-01T17:40:14.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.516+0000 7f4426ffd700 1 --2- 172.21.15.61:0/229513206 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f44140632e0 0x7f4414065790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.514+0000 7fa7760df700 1 -- 172.21.15.61:0/545658222 wait complete. 2023-01-01T17:40:14.516 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.516+0000 7fa7760df700 1 Processor -- start 2023-01-01T17:40:14.518 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.516+0000 7fa7760df700 1 -- start start 2023-01-01T17:40:14.518 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.517+0000 7fa7760df700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa77006a4d0 0x7fa7701eb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.518 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.517+0000 7fa7760df700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa770154530 0x7fa7701f5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.518 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.517+0000 7fa7760df700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa77015aef0 0x7fa7701f58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.518 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.517+0000 7fa7760df700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77006f160 con 0x7fa77006a4d0 2023-01-01T17:40:14.518 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.517+0000 7fa7760df700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77006eae0 con 0x7fa77015aef0 2023-01-01T17:40:14.518 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.517+0000 7fa7760df700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa77006e800 con 0x7fa770154530 2023-01-01T17:40:14.519 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.518+0000 7f442d834700 1 -- 172.21.15.61:0/229513206 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44080052f0 con 0x7f4428151130 2023-01-01T17:40:14.519 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.518+0000 7f4426ffd700 1 --2- 172.21.15.61:0/229513206 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f44140632e0 0x7f4414065790 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4418009ad0 tx=0x7f4418009290 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:14.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.518+0000 7fa76effd700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa770154530 0x7fa7701f5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.518+0000 7fa76effd700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa770154530 0x7fa7701f5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.61:45124/0 (socket says 172.21.15.61:45124) 2023-01-01T17:40:14.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.518+0000 7fa76effd700 1 -- 172.21.15.61:0/3956161109 learned_addr learned my addr 172.21.15.61:0/3956161109 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:14.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.518+0000 7fa76ffff700 1 --2- 172.21.15.61:0/3956161109 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa77015aef0 0x7fa7701f58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.518+0000 7fa76f7fe700 1 --2- 172.21.15.61:0/3956161109 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa77006a4d0 0x7fa7701eb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.518+0000 7fa76effd700 1 -- 172.21.15.61:0/3956161109 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa77015aef0 msgr2=0x7fa7701f58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.518+0000 7fa76effd700 1 --2- 172.21.15.61:0/3956161109 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa77015aef0 0x7fa7701f58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.518+0000 7fa76effd700 1 -- 172.21.15.61:0/3956161109 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa77006a4d0 msgr2=0x7fa7701eb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.518+0000 7fa76effd700 1 --2- 172.21.15.61:0/3956161109 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa77006a4d0 0x7fa7701eb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.520 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.518+0000 7fa76effd700 1 -- 172.21.15.61:0/3956161109 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa768009a70 con 0x7fa770154530 2023-01-01T17:40:14.521 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.519+0000 7fa76f7fe700 1 --2- 172.21.15.61:0/3956161109 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa77006a4d0 0x7fa7701eb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-01-01T17:40:14.521 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.519+0000 7fa76effd700 1 --2- 172.21.15.61:0/3956161109 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa770154530 0x7fa7701f5390 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa76000e980 tx=0x7fa76000ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:14.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.525+0000 7f440ffff700 1 -- 172.21.15.61:0/229513206 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f442004e770 con 0x7f4428151130 2023-01-01T17:40:14.525 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.525+0000 7fa757fff700 1 -- 172.21.15.61:0/3956161109 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa760009710 con 0x7fa770154530 2023-01-01T17:40:14.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.525+0000 7fa757fff700 1 -- 172.21.15.61:0/3956161109 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76000eed0 con 0x7fa770154530 2023-01-01T17:40:14.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.525+0000 7fa7760df700 1 -- 172.21.15.61:0/3956161109 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa770154900 con 0x7fa770154530 2023-01-01T17:40:14.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.525+0000 7fa7760df700 1 -- 172.21.15.61:0/3956161109 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa77006cc30 con 0x7fa770154530 2023-01-01T17:40:14.526 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.525+0000 7fa757fff700 1 -- 172.21.15.61:0/3956161109 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76000ca70 con 0x7fa770154530 2023-01-01T17:40:14.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.527+0000 7fa757fff700 1 -- 172.21.15.61:0/3956161109 <== mon.2 v2:172.21.15.149:3301/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7fa760019030 con 0x7fa770154530 2023-01-01T17:40:14.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.528+0000 7fa757fff700 1 --2- 172.21.15.61:0/3956161109 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fa758063440 0x7fa7580658f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.528+0000 7fa757fff700 1 -- 172.21.15.61:0/3956161109 <== mon.2 v2:172.21.15.149:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa76007fcb0 con 0x7fa770154530 2023-01-01T17:40:14.528 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.528+0000 7fa76f7fe700 1 --2- 172.21.15.61:0/3956161109 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fa758063440 0x7fa7580658f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.529 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.529+0000 7fa76f7fe700 1 --2- 172.21.15.61:0/3956161109 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fa758063440 0x7fa7580658f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa764005910 tx=0x7fa764009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:14.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.539+0000 7fa7760df700 1 -- 172.21.15.61:0/3956161109 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7500052f0 con 0x7fa770154530 2023-01-01T17:40:14.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.539+0000 7faabb770700 1 Processor -- start 2023-01-01T17:40:14.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.539+0000 7faabb770700 1 -- start start 2023-01-01T17:40:14.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.541+0000 7faabb770700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faab40699a0 0x7faab415b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.541+0000 7faabb770700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7faab40706c0 0x7faab40c1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.541+0000 7faabb770700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faab4070c30 con 0x7faab40695d0 2023-01-01T17:40:14.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.541+0000 7faabb770700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faab40c58a0 con 0x7faab40706c0 2023-01-01T17:40:14.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.541+0000 7faabb770700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab4070f10 con 0x7faab40699a0 2023-01-01T17:40:14.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.541+0000 7faab9d0d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7faab40706c0 0x7faab40c1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.541+0000 7faab9d0d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7faab40706c0 0x7faab40c1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46892/0 (socket says 172.21.15.61:46892) 2023-01-01T17:40:14.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.541+0000 7faab9d0d700 1 -- 172.21.15.61:0/703193490 learned_addr learned my addr 172.21.15.61:0/703193490 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:14.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.541+0000 7faab8d0b700 1 --2- 172.21.15.61:0/703193490 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faab40699a0 0x7faab415b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.542+0000 7faab9d0d700 1 -- 172.21.15.61:0/703193490 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faab40699a0 msgr2=0x7faab415b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:14.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.542+0000 7faab9d0d700 1 --2- 172.21.15.61:0/703193490 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faab40699a0 0x7faab415b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.542+0000 7faab9d0d700 1 -- 172.21.15.61:0/703193490 >> v1:172.21.15.149:6789/0 conn(0x7faab40695d0 legacy=0x7faab40c3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:14.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.542+0000 7faab9d0d700 1 -- 172.21.15.61:0/703193490 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab415aa20 con 0x7faab40706c0 2023-01-01T17:40:14.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.542+0000 7faab9d0d700 1 --2- 172.21.15.61:0/703193490 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faab40706c0 0x7faab40c1100 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7faab00098f0 tx=0x7faab0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c08b69057f0d8215 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:14.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.542+0000 7faaabfff700 1 -- 172.21.15.61:0/703193490 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab0004230 con 0x7faab40706c0 2023-01-01T17:40:14.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.543+0000 7faaabfff700 1 -- 172.21.15.61:0/703193490 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab0004390 con 0x7faab40706c0 2023-01-01T17:40:14.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.543+0000 7faaabfff700 1 -- 172.21.15.61:0/703193490 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab00036a0 con 0x7faab40706c0 2023-01-01T17:40:14.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.544+0000 7faabb770700 1 -- 172.21.15.61:0/703193490 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faab40706c0 msgr2=0x7faab40c1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.544+0000 7faabb770700 1 --2- 172.21.15.61:0/703193490 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faab40706c0 0x7faab40c1100 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7faab00098f0 tx=0x7faab0009c00 comp rx=0 tx=0).stop 2023-01-01T17:40:14.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.544+0000 7fa757fff700 1 -- 172.21.15.61:0/3956161109 <== mon.2 v2:172.21.15.149:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7fa760052430 con 0x7fa770154530 2023-01-01T17:40:14.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.544+0000 7faabb770700 1 -- 172.21.15.61:0/703193490 shutdown_connections 2023-01-01T17:40:14.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.544+0000 7faabb770700 1 --2- 172.21.15.61:0/703193490 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faab40706c0 0x7faab40c1100 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.544+0000 7faabb770700 1 --2- 172.21.15.61:0/703193490 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faab40699a0 0x7faab415b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.544+0000 7faabb770700 1 -- 172.21.15.61:0/703193490 >> 172.21.15.61:0/703193490 conn(0x7faab406b100 msgr2=0x7faab40c5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:14.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.545+0000 7faabb770700 1 -- 172.21.15.61:0/703193490 shutdown_connections 2023-01-01T17:40:14.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.545+0000 7faabb770700 1 -- 172.21.15.61:0/703193490 wait complete. 2023-01-01T17:40:14.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.546+0000 7faabb770700 1 Processor -- start 2023-01-01T17:40:14.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.552+0000 7faabb770700 1 -- start start 2023-01-01T17:40:14.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.553+0000 7faabb770700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faab40695d0 0x7faab4098a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.553+0000 7faabb770700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faab40699a0 0x7faab41f8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.553+0000 7faabb770700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faab40706c0 0x7faab41eeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.553+0000 7faabb770700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab40c0340 con 0x7faab40699a0 2023-01-01T17:40:14.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.553+0000 7faabb770700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab41f9900 con 0x7faab40706c0 2023-01-01T17:40:14.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.553+0000 7faabb770700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab40c0060 con 0x7faab40695d0 2023-01-01T17:40:14.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.554+0000 7faab8d0b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faab40699a0 0x7faab41f8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.554+0000 7faab8d0b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faab40699a0 0x7faab41f8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46898/0 (socket says 172.21.15.61:46898) 2023-01-01T17:40:14.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.554+0000 7faab8d0b700 1 -- 172.21.15.61:0/44767849 learned_addr learned my addr 172.21.15.61:0/44767849 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:14.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.555+0000 7faab8d0b700 1 -- 172.21.15.61:0/44767849 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faab40695d0 msgr2=0x7faab4098a40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-01-01T17:40:14.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.555+0000 7faab8d0b700 1 --2- 172.21.15.61:0/44767849 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faab40695d0 0x7faab4098a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.555+0000 7faab8d0b700 1 -- 172.21.15.61:0/44767849 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faab40706c0 msgr2=0x7faab41eeec0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-01-01T17:40:14.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.555+0000 7faab8d0b700 1 --2- 172.21.15.61:0/44767849 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faab40706c0 0x7faab41eeec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.555+0000 7faab8d0b700 1 -- 172.21.15.61:0/44767849 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab0009550 con 0x7faab40699a0 2023-01-01T17:40:14.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.556+0000 7faab8d0b700 1 --2- 172.21.15.61:0/44767849 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faab40699a0 0x7faab41f8ce0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7faaa400c7f0 tx=0x7faaa400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:14.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.567+0000 7faaa9ffb700 1 -- 172.21.15.61:0/44767849 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa4011800 con 0x7faab40699a0 2023-01-01T17:40:14.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.567+0000 7faaa9ffb700 1 -- 172.21.15.61:0/44767849 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa4011960 con 0x7faab40699a0 2023-01-01T17:40:14.569 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.567+0000 7faaa9ffb700 1 -- 172.21.15.61:0/44767849 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa4011cd0 con 0x7faab40699a0 2023-01-01T17:40:14.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.567+0000 7faabb770700 1 -- 172.21.15.61:0/44767849 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faab415afe0 con 0x7faab40699a0 2023-01-01T17:40:14.570 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.568+0000 7faabb770700 1 -- 172.21.15.61:0/44767849 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faab415ad00 con 0x7faab40699a0 2023-01-01T17:40:14.571 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.571+0000 7faabb770700 1 -- 172.21.15.61:0/44767849 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa940052f0 con 0x7faab40699a0 2023-01-01T17:40:14.584 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.583+0000 7faaa9ffb700 1 -- 172.21.15.61:0/44767849 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7faaa4021070 con 0x7faab40699a0 2023-01-01T17:40:14.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.583+0000 7faaa9ffb700 1 --2- 172.21.15.61:0/44767849 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7faa98063390 0x7faa98065840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:14.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.584+0000 7faaa9ffb700 1 -- 172.21.15.61:0/44767849 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7faaa40800d0 con 0x7faab40699a0 2023-01-01T17:40:14.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.584+0000 7faaa9ffb700 1 -- 172.21.15.61:0/44767849 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7faaa4080550 con 0x7faab40699a0 2023-01-01T17:40:14.585 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.585+0000 7faab950c700 1 --2- 172.21.15.61:0/44767849 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7faa98063390 0x7faa98065840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:14.598 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.598+0000 7faab950c700 1 --2- 172.21.15.61:0/44767849 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7faa98063390 0x7faa98065840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faaac004880 tx=0x7faaac003e40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:14.669 INFO:teuthology.orchestra.run.smithi061.stdout:55834574856 2023-01-01T17:40:14.669 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.665+0000 7f3d87249700 1 -- 172.21.15.61:0/676114944 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f3d80089c90 con 0x7f3d800a4040 2023-01-01T17:40:14.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.666+0000 7f3d7d7fa700 1 -- 172.21.15.61:0/676114944 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3d74017030 con 0x7f3d800a4040 2023-01-01T17:40:14.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.669+0000 7f3d87249700 1 -- 172.21.15.61:0/676114944 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3d6c063290 msgr2=0x7f3d6c065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.669+0000 7f3d87249700 1 --2- 172.21.15.61:0/676114944 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3d6c063290 0x7f3d6c065740 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3d700090b0 tx=0x7f3d70018000 comp rx=0 tx=0).stop 2023-01-01T17:40:14.670 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.669+0000 7f3d87249700 1 -- 172.21.15.61:0/676114944 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3d800a4040 msgr2=0x7f3d80083800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.669+0000 7f3d87249700 1 --2- 172.21.15.61:0/676114944 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3d800a4040 0x7f3d80083800 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3d7400c4f0 tx=0x7f3d7400c8b0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.670+0000 7f3d87249700 1 -- 172.21.15.61:0/676114944 shutdown_connections 2023-01-01T17:40:14.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.670+0000 7f3d87249700 1 --2- 172.21.15.61:0/676114944 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3d800bf590 0x7f3d801f7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.670+0000 7f3d87249700 1 --2- 172.21.15.61:0/676114944 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3d800716a0 0x7f3d800a4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.670+0000 7f3d87249700 1 --2- 172.21.15.61:0/676114944 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3d6c063290 0x7f3d6c065740 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.670+0000 7f3d87249700 1 --2- 172.21.15.61:0/676114944 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3d800a4040 0x7f3d80083800 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.670+0000 7f3d87249700 1 -- 172.21.15.61:0/676114944 >> 172.21.15.61:0/676114944 conn(0x7f3d80069fb0 msgr2=0x7f3d800706e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:14.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.670+0000 7f3d87249700 1 -- 172.21.15.61:0/676114944 shutdown_connections 2023-01-01T17:40:14.671 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.670+0000 7f3d87249700 1 -- 172.21.15.61:0/676114944 wait complete. 2023-01-01T17:40:14.690 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.6 2023-01-01T17:40:14.691 DEBUG:teuthology.parallel:result is None 2023-01-01T17:40:14.756 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.756+0000 7f3c5c272700 1 -- 172.21.15.61:0/2075359518 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3c3c0055a0 con 0x7f3c40005400 2023-01-01T17:40:14.757 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.756+0000 7f3c4affd700 1 -- 172.21.15.61:0/2075359518 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3c50017070 con 0x7f3c40005400 2023-01-01T17:40:14.757 INFO:teuthology.orchestra.run.smithi061.stdout:55834574856 2023-01-01T17:40:14.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.758+0000 7f3c5c272700 1 -- 172.21.15.61:0/2075359518 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3c38063290 msgr2=0x7f3c38065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.759 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.758+0000 7f3c5c272700 1 --2- 172.21.15.61:0/2075359518 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3c38063290 0x7f3c38065740 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3c44009790 tx=0x7f3c44006d70 comp rx=0 tx=0).stop 2023-01-01T17:40:14.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.758+0000 7f3c5c272700 1 -- 172.21.15.61:0/2075359518 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3c40005400 msgr2=0x7f3c5414b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.758+0000 7f3c5c272700 1 --2- 172.21.15.61:0/2075359518 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3c40005400 0x7f3c5414b4c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3c5000c310 tx=0x7f3c5000c6d0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.760 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.759+0000 7f3c5c272700 1 -- 172.21.15.61:0/2075359518 shutdown_connections 2023-01-01T17:40:14.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.759+0000 7f3c5c272700 1 --2- 172.21.15.61:0/2075359518 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f3c540a7a40 0x7f3c540bb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.759+0000 7f3c5c272700 1 --2- 172.21.15.61:0/2075359518 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f3c38063290 0x7f3c38065740 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.759+0000 7f3c5c272700 1 --2- 172.21.15.61:0/2075359518 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f3c40005400 0x7f3c5414b4c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.759+0000 7f3c5c272700 1 --2- 172.21.15.61:0/2075359518 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c54147150 0x7f3c540badb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.759+0000 7f3c5c272700 1 -- 172.21.15.61:0/2075359518 >> 172.21.15.61:0/2075359518 conn(0x7f3c54069fb0 msgr2=0x7f3c541d9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:14.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.761+0000 7f3c5c272700 1 -- 172.21.15.61:0/2075359518 shutdown_connections 2023-01-01T17:40:14.761 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.761+0000 7f3c5c272700 1 -- 172.21.15.61:0/2075359518 wait complete. 2023-01-01T17:40:14.774 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.5 2023-01-01T17:40:14.774 DEBUG:teuthology.parallel:result is None 2023-01-01T17:40:14.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.829+0000 7fde75d27700 1 -- 172.21.15.61:0/3895902975 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fde500055a0 con 0x7fde700bf590 2023-01-01T17:40:14.830 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.830+0000 7fde57fff700 1 -- 172.21.15.61:0/3895902975 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fde6804e490 con 0x7fde700bf590 2023-01-01T17:40:14.830 INFO:teuthology.orchestra.run.smithi061.stdout:55834574856 2023-01-01T17:40:14.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.833+0000 7fde75d27700 1 -- 172.21.15.61:0/3895902975 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fde5c0632e0 msgr2=0x7fde5c065790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.833+0000 7fde75d27700 1 --2- 172.21.15.61:0/3895902975 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fde5c0632e0 0x7fde5c065790 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fde64000f60 tx=0x7fde64007db0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.833+0000 7fde75d27700 1 -- 172.21.15.61:0/3895902975 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde700bf590 msgr2=0x7fde700b8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.833+0000 7fde75d27700 1 --2- 172.21.15.61:0/3895902975 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde700bf590 0x7fde700b8040 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fde68007ae0 tx=0x7fde68007df0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.833+0000 7fde75d27700 1 -- 172.21.15.61:0/3895902975 shutdown_connections 2023-01-01T17:40:14.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.833+0000 7fde75d27700 1 --2- 172.21.15.61:0/3895902975 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde700bf590 0x7fde700b8040 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.833+0000 7fde75d27700 1 --2- 172.21.15.61:0/3895902975 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fde700713d0 0x7fde700862a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.834 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.833+0000 7fde75d27700 1 --2- 172.21.15.61:0/3895902975 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fde5c0632e0 0x7fde5c065790 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.833+0000 7fde75d27700 1 --2- 172.21.15.61:0/3895902975 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fde700a4040 0x7fde700b7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.833+0000 7fde75d27700 1 -- 172.21.15.61:0/3895902975 >> 172.21.15.61:0/3895902975 conn(0x7fde70069fb0 msgr2=0x7fde700a4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:14.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.834+0000 7fde75d27700 1 -- 172.21.15.61:0/3895902975 shutdown_connections 2023-01-01T17:40:14.835 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.835+0000 7fde75d27700 1 -- 172.21.15.61:0/3895902975 wait complete. 2023-01-01T17:40:14.848 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2023-01-01T17:40:14.848 DEBUG:teuthology.parallel:result is None 2023-01-01T17:40:14.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.850+0000 7fac14e5f700 1 -- 172.21.15.61:0/3685198316 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fac100668a0 con 0x7fac1006fc40 2023-01-01T17:40:14.851 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.851+0000 7fabfeffd700 1 -- 172.21.15.61:0/3685198316 <== mon.1 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fac04051cd0 con 0x7fac1006fc40 2023-01-01T17:40:14.852 INFO:teuthology.orchestra.run.smithi061.stdout:55834574856 2023-01-01T17:40:14.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.853+0000 7fac14e5f700 1 -- 172.21.15.61:0/3685198316 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fabf0067770 msgr2=0x7fabf0069c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.853+0000 7fac14e5f700 1 --2- 172.21.15.61:0/3685198316 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fabf0067770 0x7fabf0069c20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fac00006b20 tx=0x7fac00006ab0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.853+0000 7fac14e5f700 1 -- 172.21.15.61:0/3685198316 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac1006fc40 msgr2=0x7fac1013e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.853+0000 7fac14e5f700 1 --2- 172.21.15.61:0/3685198316 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac1006fc40 0x7fac1013e490 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fac0400b4a0 tx=0x7fac0400b7b0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.854 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.854+0000 7fac14e5f700 1 -- 172.21.15.61:0/3685198316 shutdown_connections 2023-01-01T17:40:14.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.854+0000 7fac14e5f700 1 --2- 172.21.15.61:0/3685198316 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fac1014c810 0x7fac10142990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.854+0000 7fac14e5f700 1 --2- 172.21.15.61:0/3685198316 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac1006fc40 0x7fac1013e490 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.854+0000 7fac14e5f700 1 --2- 172.21.15.61:0/3685198316 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fabf0067770 0x7fabf0069c20 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.854+0000 7fac14e5f700 1 --2- 172.21.15.61:0/3685198316 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fac100714b0 0x7fac1014acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.854+0000 7fac14e5f700 1 -- 172.21.15.61:0/3685198316 >> 172.21.15.61:0/3685198316 conn(0x7fac100c1f30 msgr2=0x7fac101414d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:14.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.854+0000 7fac14e5f700 1 -- 172.21.15.61:0/3685198316 shutdown_connections 2023-01-01T17:40:14.855 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.854+0000 7fac14e5f700 1 -- 172.21.15.61:0/3685198316 wait complete. 2023-01-01T17:40:14.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.854+0000 7f1bf440a700 1 -- 172.21.15.61:0/3771502803 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f1bd40055a0 con 0x7f1bec14fa20 2023-01-01T17:40:14.856 INFO:teuthology.orchestra.run.smithi061.stdout:55834574856 2023-01-01T17:40:14.856 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.855+0000 7f1be2ffd700 1 -- 172.21.15.61:0/3771502803 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1be4053660 con 0x7f1bec14fa20 2023-01-01T17:40:14.858 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.858+0000 7f1bf440a700 1 -- 172.21.15.61:0/3771502803 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f1bd0063360 msgr2=0x7f1bd0065810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.858+0000 7f1bf440a700 1 --2- 172.21.15.61:0/3771502803 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f1bd0063360 0x7f1bd0065810 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc00b700 tx=0x7f1bdc005b90 comp rx=0 tx=0).stop 2023-01-01T17:40:14.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.858+0000 7f1bf440a700 1 -- 172.21.15.61:0/3771502803 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1bec14fa20 msgr2=0x7f1bec1ecb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.858+0000 7f1bf440a700 1 --2- 172.21.15.61:0/3771502803 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1bec14fa20 0x7f1bec1ecb00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1be4004000 tx=0x7f1be4004b40 comp rx=0 tx=0).stop 2023-01-01T17:40:14.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.858+0000 7f1bf440a700 1 -- 172.21.15.61:0/3771502803 shutdown_connections 2023-01-01T17:40:14.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.858+0000 7f1bf440a700 1 --2- 172.21.15.61:0/3771502803 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1bec14fa20 0x7f1bec1ecb00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.858+0000 7f1bf440a700 1 --2- 172.21.15.61:0/3771502803 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f1bd0063360 0x7f1bd0065810 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc00b700 tx=0x7f1bdc005b90 comp rx=0 tx=0).stop 2023-01-01T17:40:14.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.858+0000 7f1bf440a700 1 --2- 172.21.15.61:0/3771502803 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1bec06b940 0x7f1bec0b9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.858+0000 7f1bf440a700 1 --2- 172.21.15.61:0/3771502803 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bec14c640 0x7f1bec0ba2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.859 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.858+0000 7f1bf440a700 1 -- 172.21.15.61:0/3771502803 >> 172.21.15.61:0/3771502803 conn(0x7f1bec069fb0 msgr2=0x7f1bec0a5900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:14.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.863+0000 7f1bf440a700 1 -- 172.21.15.61:0/3771502803 shutdown_connections 2023-01-01T17:40:14.863 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.863+0000 7f1bf440a700 1 -- 172.21.15.61:0/3771502803 wait complete. 2023-01-01T17:40:14.868 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.2 2023-01-01T17:40:14.868 DEBUG:teuthology.parallel:result is None 2023-01-01T17:40:14.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.7 2023-01-01T17:40:14.876 DEBUG:teuthology.parallel:result is None 2023-01-01T17:40:14.899 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.899+0000 7f442d834700 1 -- 172.21.15.61:0/229513206 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f44080055a0 con 0x7f4428151130 2023-01-01T17:40:14.900 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.899+0000 7f440ffff700 1 -- 172.21.15.61:0/229513206 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4420019020 con 0x7f4428151130 2023-01-01T17:40:14.900 INFO:teuthology.orchestra.run.smithi061.stdout:55834574856 2023-01-01T17:40:14.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.902+0000 7f442d834700 1 -- 172.21.15.61:0/229513206 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f44140632e0 msgr2=0x7f4414065790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.902+0000 7f442d834700 1 --2- 172.21.15.61:0/229513206 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f44140632e0 0x7f4414065790 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4418009ad0 tx=0x7f4418009290 comp rx=0 tx=0).stop 2023-01-01T17:40:14.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.902+0000 7f442d834700 1 -- 172.21.15.61:0/229513206 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4428151130 msgr2=0x7f442813e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.902 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.902+0000 7f442d834700 1 --2- 172.21.15.61:0/229513206 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4428151130 0x7f442813e8c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f442000bd50 tx=0x7f442000bd80 comp rx=0 tx=0).stop 2023-01-01T17:40:14.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.902+0000 7f442d834700 1 -- 172.21.15.61:0/229513206 shutdown_connections 2023-01-01T17:40:14.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.902+0000 7f442d834700 1 --2- 172.21.15.61:0/229513206 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f44140632e0 0x7f4414065790 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.902+0000 7f442d834700 1 --2- 172.21.15.61:0/229513206 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f442815a6d0 0x7f4428137d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.902+0000 7f442d834700 1 --2- 172.21.15.61:0/229513206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44280c0b60 0x7f442813a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.902+0000 7f442d834700 1 --2- 172.21.15.61:0/229513206 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4428151130 0x7f442813e8c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.902+0000 7f442d834700 1 -- 172.21.15.61:0/229513206 >> 172.21.15.61:0/229513206 conn(0x7f4428069360 msgr2=0x7f4428154f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:14.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.902+0000 7f442d834700 1 -- 172.21.15.61:0/229513206 shutdown_connections 2023-01-01T17:40:14.903 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.902+0000 7f442d834700 1 -- 172.21.15.61:0/229513206 wait complete. 2023-01-01T17:40:14.914 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2023-01-01T17:40:14.915 DEBUG:teuthology.parallel:result is None 2023-01-01T17:40:14.934 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.934+0000 7fa7760df700 1 -- 172.21.15.61:0/3956161109 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa7500055a0 con 0x7fa770154530 2023-01-01T17:40:14.935 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.934+0000 7fa757fff700 1 -- 172.21.15.61:0/3956161109 <== mon.2 v2:172.21.15.149:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa760021030 con 0x7fa770154530 2023-01-01T17:40:14.935 INFO:teuthology.orchestra.run.smithi061.stdout:55834574856 2023-01-01T17:40:14.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.937+0000 7fa7760df700 1 -- 172.21.15.61:0/3956161109 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fa758063440 msgr2=0x7fa7580658f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.937 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.937+0000 7fa7760df700 1 --2- 172.21.15.61:0/3956161109 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fa758063440 0x7fa7580658f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa764005910 tx=0x7fa764009040 comp rx=0 tx=0).stop 2023-01-01T17:40:14.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.937+0000 7fa7760df700 1 -- 172.21.15.61:0/3956161109 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa770154530 msgr2=0x7fa7701f5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.937+0000 7fa7760df700 1 --2- 172.21.15.61:0/3956161109 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa770154530 0x7fa7701f5390 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa76000e980 tx=0x7fa76000ec90 comp rx=0 tx=0).stop 2023-01-01T17:40:14.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.937+0000 7fa7760df700 1 -- 172.21.15.61:0/3956161109 shutdown_connections 2023-01-01T17:40:14.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.937+0000 7fa7760df700 1 --2- 172.21.15.61:0/3956161109 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa77015aef0 0x7fa7701f58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.937+0000 7fa7760df700 1 --2- 172.21.15.61:0/3956161109 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fa758063440 0x7fa7580658f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.937+0000 7fa7760df700 1 --2- 172.21.15.61:0/3956161109 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fa77006a4d0 0x7fa7701eb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.937+0000 7fa7760df700 1 --2- 172.21.15.61:0/3956161109 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fa770154530 0x7fa7701f5390 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.937+0000 7fa7760df700 1 -- 172.21.15.61:0/3956161109 >> 172.21.15.61:0/3956161109 conn(0x7fa770069ff0 msgr2=0x7fa7701594d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:14.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.937+0000 7fa7760df700 1 -- 172.21.15.61:0/3956161109 shutdown_connections 2023-01-01T17:40:14.938 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.937+0000 7fa7760df700 1 -- 172.21.15.61:0/3956161109 wait complete. 2023-01-01T17:40:14.950 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2023-01-01T17:40:14.950 DEBUG:teuthology.parallel:result is None 2023-01-01T17:40:14.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.956+0000 7faabb770700 1 -- 172.21.15.61:0/44767849 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7faa94005870 con 0x7faab40699a0 2023-01-01T17:40:14.956 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.956+0000 7faaa9ffb700 1 -- 172.21.15.61:0/44767849 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faaa401f020 con 0x7faab40699a0 2023-01-01T17:40:14.957 INFO:teuthology.orchestra.run.smithi061.stdout:55834574856 2023-01-01T17:40:14.958 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.958+0000 7faabb770700 1 -- 172.21.15.61:0/44767849 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7faa98063390 msgr2=0x7faa98065840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.958+0000 7faabb770700 1 --2- 172.21.15.61:0/44767849 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7faa98063390 0x7faa98065840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faaac004880 tx=0x7faaac003e40 comp rx=0 tx=0).stop 2023-01-01T17:40:14.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.958+0000 7faabb770700 1 -- 172.21.15.61:0/44767849 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faab40699a0 msgr2=0x7faab41f8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:14.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.958+0000 7faabb770700 1 --2- 172.21.15.61:0/44767849 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faab40699a0 0x7faab41f8ce0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7faaa400c7f0 tx=0x7faaa400cbb0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.958+0000 7faabb770700 1 -- 172.21.15.61:0/44767849 shutdown_connections 2023-01-01T17:40:14.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.958+0000 7faabb770700 1 --2- 172.21.15.61:0/44767849 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faab40706c0 0x7faab41eeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.958+0000 7faabb770700 1 --2- 172.21.15.61:0/44767849 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7faab40695d0 0x7faab4098a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.958+0000 7faabb770700 1 --2- 172.21.15.61:0/44767849 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7faa98063390 0x7faa98065840 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.958+0000 7faabb770700 1 --2- 172.21.15.61:0/44767849 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7faab40699a0 0x7faab41f8ce0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:14.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.958+0000 7faabb770700 1 -- 172.21.15.61:0/44767849 >> 172.21.15.61:0/44767849 conn(0x7faab406b100 msgr2=0x7faab40ab050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:14.959 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.958+0000 7faabb770700 1 -- 172.21.15.61:0/44767849 shutdown_connections 2023-01-01T17:40:14.960 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:14.958+0000 7faabb770700 1 -- 172.21.15.61:0/44767849 wait complete. 2023-01-01T17:40:14.971 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.4 2023-01-01T17:40:14.971 DEBUG:teuthology.parallel:result is None 2023-01-01T17:40:14.971 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-01-01T17:40:14.971 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-01T17:40:15.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.134+0000 7ff3882b0700 1 Processor -- start 2023-01-01T17:40:15.135 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.134+0000 7ff3882b0700 1 -- start start 2023-01-01T17:40:15.136 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.135+0000 7ff3882b0700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3800c1ad0 0x7ff380152de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:15.136 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.135+0000 7ff3882b0700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff380157030 0x7ff380153320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:15.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.135+0000 7ff3882b0700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff38006dc10 con 0x7ff38006a640 2023-01-01T17:40:15.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.135+0000 7ff3882b0700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff380071770 con 0x7ff380157030 2023-01-01T17:40:15.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.135+0000 7ff3882b0700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff380156ba0 con 0x7ff3800c1ad0 2023-01-01T17:40:15.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.135+0000 7ff38684d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ff380157030 0x7ff380153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:15.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.135+0000 7ff38604c700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7ff38006a640 0x7ff38014ffa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40754/0 (socket says 172.21.15.61:40754) 2023-01-01T17:40:15.137 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.135+0000 7ff38604c700 1 -- 172.21.15.61:0/3221145809 learned_addr learned my addr 172.21.15.61:0/3221145809 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:40:15.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.136+0000 7ff38584b700 1 --2- 172.21.15.61:0/3221145809 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3800c1ad0 0x7ff380152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:15.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.136+0000 7ff38684d700 1 -- 172.21.15.61:0/3221145809 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3800c1ad0 msgr2=0x7ff380152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:15.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.136+0000 7ff38684d700 1 --2- 172.21.15.61:0/3221145809 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3800c1ad0 0x7ff380152de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:15.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.136+0000 7ff38684d700 1 -- 172.21.15.61:0/3221145809 >> v1:172.21.15.61:6789/0 conn(0x7ff38006a640 legacy=0x7ff38014ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:15.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.136+0000 7ff38684d700 1 -- 172.21.15.61:0/3221145809 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff38006f7a0 con 0x7ff380157030 2023-01-01T17:40:15.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.136+0000 7ff38504a700 1 -- 172.21.15.61:0/3221145809 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2845749951 0 0) 0x7ff38006dc10 con 0x7ff38006a640 2023-01-01T17:40:15.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.136+0000 7ff38684d700 1 --2- 172.21.15.61:0/3221145809 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff380157030 0x7ff380153320 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff378009d90 tx=0x7ff37800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ae3ee1848eebeb server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:15.138 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.136+0000 7ff38504a700 1 -- 172.21.15.61:0/3221145809 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37800e070 con 0x7ff380157030 2023-01-01T17:40:15.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.136+0000 7ff38504a700 1 -- 172.21.15.61:0/3221145809 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37800bbd0 con 0x7ff380157030 2023-01-01T17:40:15.139 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.136+0000 7ff38504a700 1 -- 172.21.15.61:0/3221145809 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff378012430 con 0x7ff380157030 2023-01-01T17:40:15.142 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.136+0000 7ff3882b0700 1 -- 172.21.15.61:0/3221145809 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff380157030 msgr2=0x7ff380153320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:15.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.136+0000 7ff3882b0700 1 --2- 172.21.15.61:0/3221145809 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff380157030 0x7ff380153320 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff378009d90 tx=0x7ff37800b330 comp rx=0 tx=0).stop 2023-01-01T17:40:15.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.137+0000 7ff3882b0700 1 -- 172.21.15.61:0/3221145809 shutdown_connections 2023-01-01T17:40:15.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.137+0000 7ff3882b0700 1 --2- 172.21.15.61:0/3221145809 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff380157030 0x7ff380153320 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:15.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.137+0000 7ff3882b0700 1 --2- 172.21.15.61:0/3221145809 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff3800c1ad0 0x7ff380152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:15.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.137+0000 7ff3882b0700 1 -- 172.21.15.61:0/3221145809 >> 172.21.15.61:0/3221145809 conn(0x7ff3800c1f30 msgr2=0x7ff3800c2330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:15.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.137+0000 7ff3882b0700 1 -- 172.21.15.61:0/3221145809 shutdown_connections 2023-01-01T17:40:15.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.137+0000 7ff3882b0700 1 -- 172.21.15.61:0/3221145809 wait complete. 2023-01-01T17:40:15.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.138+0000 7ff3882b0700 1 Processor -- start 2023-01-01T17:40:15.143 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.138+0000 7ff3882b0700 1 -- start start 2023-01-01T17:40:15.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.139+0000 7ff3882b0700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff38006a640 0x7ff3801e7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:15.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.139+0000 7ff3882b0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3800c1ad0 0x7ff3800bca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:15.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.139+0000 7ff3882b0700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff380157030 0x7ff38006c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:15.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.139+0000 7ff3882b0700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3800aa830 con 0x7ff380157030 2023-01-01T17:40:15.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.139+0000 7ff3882b0700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3800bf930 con 0x7ff3800c1ad0 2023-01-01T17:40:15.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.139+0000 7ff3882b0700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3800aaec0 con 0x7ff38006a640 2023-01-01T17:40:15.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.139+0000 7ff38684d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff380157030 0x7ff38006c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:15.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.139+0000 7ff38684d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff380157030 0x7ff38006c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46914/0 (socket says 172.21.15.61:46914) 2023-01-01T17:40:15.144 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.139+0000 7ff38684d700 1 -- 172.21.15.61:0/2771483862 learned_addr learned my addr 172.21.15.61:0/2771483862 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:15.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.139+0000 7ff38604c700 1 --2- 172.21.15.61:0/2771483862 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff38006a640 0x7ff3801e7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:15.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.139+0000 7ff38584b700 1 --2- 172.21.15.61:0/2771483862 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3800c1ad0 0x7ff3800bca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:15.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.140+0000 7ff38684d700 1 -- 172.21.15.61:0/2771483862 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff38006a640 msgr2=0x7ff3801e7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:15.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.140+0000 7ff38684d700 1 --2- 172.21.15.61:0/2771483862 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff38006a640 0x7ff3801e7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:15.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.140+0000 7ff38684d700 1 -- 172.21.15.61:0/2771483862 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3800c1ad0 msgr2=0x7ff3800bca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:15.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.140+0000 7ff38684d700 1 --2- 172.21.15.61:0/2771483862 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3800c1ad0 0x7ff3800bca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:15.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.140+0000 7ff38684d700 1 -- 172.21.15.61:0/2771483862 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff378009a70 con 0x7ff380157030 2023-01-01T17:40:15.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.140+0000 7ff38604c700 1 --2- 172.21.15.61:0/2771483862 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff38006a640 0x7ff3801e7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-01-01T17:40:15.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.140+0000 7ff38584b700 1 --2- 172.21.15.61:0/2771483862 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3800c1ad0 0x7ff3800bca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-01-01T17:40:15.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.140+0000 7ff38684d700 1 --2- 172.21.15.61:0/2771483862 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff380157030 0x7ff38006c590 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff378013000 tx=0x7ff378004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:15.145 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.140+0000 7ff372ffd700 1 -- 172.21.15.61:0/2771483862 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff378012430 con 0x7ff380157030 2023-01-01T17:40:15.146 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.140+0000 7ff372ffd700 1 -- 172.21.15.61:0/2771483862 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff378020070 con 0x7ff380157030 2023-01-01T17:40:15.146 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.140+0000 7ff3882b0700 1 -- 172.21.15.61:0/2771483862 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff38006f4c0 con 0x7ff380157030 2023-01-01T17:40:15.146 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.140+0000 7ff372ffd700 1 -- 172.21.15.61:0/2771483862 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff378004280 con 0x7ff380157030 2023-01-01T17:40:15.146 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.140+0000 7ff3882b0700 1 -- 172.21.15.61:0/2771483862 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff38006f1e0 con 0x7ff380157030 2023-01-01T17:40:15.146 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.141+0000 7ff3882b0700 1 -- 172.21.15.61:0/2771483862 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff380156550 con 0x7ff380157030 2023-01-01T17:40:15.146 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.141+0000 7ff372ffd700 1 -- 172.21.15.61:0/2771483862 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7ff3780043e0 con 0x7ff380157030 2023-01-01T17:40:15.146 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.142+0000 7ff372ffd700 1 --2- 172.21.15.61:0/2771483862 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7ff3640632c0 0x7ff364065770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:15.146 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.142+0000 7ff372ffd700 1 -- 172.21.15.61:0/2771483862 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff378022070 con 0x7ff380157030 2023-01-01T17:40:15.146 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.142+0000 7ff38604c700 1 --2- 172.21.15.61:0/2771483862 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7ff3640632c0 0x7ff364065770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:15.146 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.142+0000 7ff38604c700 1 --2- 172.21.15.61:0/2771483862 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7ff3640632c0 0x7ff364065770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff374000f60 tx=0x7ff374009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:15.147 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.146+0000 7ff372ffd700 1 -- 172.21.15.61:0/2771483862 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7ff378050ea0 con 0x7ff380157030 2023-01-01T17:40:15.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.336+0000 7ff3882b0700 1 -- 172.21.15.61:0/2771483862 --> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff3800ab3c0 con 0x7ff3640632c0 2023-01-01T17:40:15.346 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.346+0000 7ff372ffd700 1 -- 172.21.15.61:0/2771483862 <== mgr.4101 v2:172.21.15.61:6832/94075 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367546 (secure 0 0 0) 0x7ff3800ab3c0 con 0x7ff3640632c0 2023-01-01T17:40:15.350 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:40:15.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.349+0000 7ff3882b0700 1 -- 172.21.15.61:0/2771483862 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7ff3640632c0 msgr2=0x7ff364065770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:15.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.349+0000 7ff3882b0700 1 --2- 172.21.15.61:0/2771483862 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7ff3640632c0 0x7ff364065770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff374000f60 tx=0x7ff374009040 comp rx=0 tx=0).stop 2023-01-01T17:40:15.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.349+0000 7ff3882b0700 1 -- 172.21.15.61:0/2771483862 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff380157030 msgr2=0x7ff38006c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:15.353 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.349+0000 7ff3882b0700 1 --2- 172.21.15.61:0/2771483862 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff380157030 0x7ff38006c590 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff378013000 tx=0x7ff378004ad0 comp rx=0 tx=0).stop 2023-01-01T17:40:15.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.349+0000 7ff3882b0700 1 -- 172.21.15.61:0/2771483862 shutdown_connections 2023-01-01T17:40:15.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.349+0000 7ff3882b0700 1 --2- 172.21.15.61:0/2771483862 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7ff3640632c0 0x7ff364065770 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:15.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.349+0000 7ff3882b0700 1 --2- 172.21.15.61:0/2771483862 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ff380157030 0x7ff38006c590 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:15.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.349+0000 7ff3882b0700 1 --2- 172.21.15.61:0/2771483862 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ff38006a640 0x7ff3801e7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:15.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.349+0000 7ff3882b0700 1 --2- 172.21.15.61:0/2771483862 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff3800c1ad0 0x7ff3800bca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:15.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.349+0000 7ff3882b0700 1 -- 172.21.15.61:0/2771483862 >> 172.21.15.61:0/2771483862 conn(0x7ff3800c1f30 msgr2=0x7ff380153fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:15.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.349+0000 7ff3882b0700 1 -- 172.21.15.61:0/2771483862 shutdown_connections 2023-01-01T17:40:15.354 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.349+0000 7ff3882b0700 1 -- 172.21.15.61:0/2771483862 wait complete. 2023-01-01T17:40:15.354 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-01-01T17:40:15.362 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-01-01T17:40:14.227739+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":68672,"kb_used_data":2176,"kb_used_omap":0,"kb_used_meta":66432,"kb_avail":754906048,"statfs":{"total":773094113280,"available":773023793152,"internally_reserved":0,"allocated":2228224,"data_stored":2027824,"data_compressed":64598,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":68026368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002937"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966937+0000","last_change":"2023-01-01T17:39:52.963330+0000","last_active":"2023-01-01T17:39:56.966937+0000","last_peered":"2023-01-01T17:39:56.966937+0000","last_clean":"2023-01-01T17:39:56.966937+0000","last_became_active":"2023-01-01T17:39:52.962891+0000","last_became_peered":"2023-01-01T17:39:52.962891+0000","last_unstale":"2023-01-01T17:39:56.966937+0000","last_undegraded":"2023-01-01T17:39:56.966937+0000","last_fullsized":"2023-01-01T17:39:56.966937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:04:10.357667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971778+0000","last_change":"2023-01-01T17:39:52.971796+0000","last_active":"2023-01-01T17:39:56.971778+0000","last_peered":"2023-01-01T17:39:56.971778+0000","last_clean":"2023-01-01T17:39:56.971778+0000","last_became_active":"2023-01-01T17:39:52.971531+0000","last_became_peered":"2023-01-01T17:39:52.971531+0000","last_unstale":"2023-01-01T17:39:56.971778+0000","last_undegraded":"2023-01-01T17:39:56.971778+0000","last_fullsized":"2023-01-01T17:39:56.971778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:27:49.306438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.973554+0000","last_change":"2023-01-01T17:39:52.964674+0000","last_active":"2023-01-01T17:39:56.973554+0000","last_peered":"2023-01-01T17:39:56.973554+0000","last_clean":"2023-01-01T17:39:56.973554+0000","last_became_active":"2023-01-01T17:39:52.964407+0000","last_became_peered":"2023-01-01T17:39:52.964407+0000","last_unstale":"2023-01-01T17:39:56.973554+0000","last_undegraded":"2023-01-01T17:39:56.973554+0000","last_fullsized":"2023-01-01T17:39:56.973554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:04:29.930818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.980904+0000","last_change":"2023-01-01T17:39:52.961108+0000","last_active":"2023-01-01T17:39:56.980904+0000","last_peered":"2023-01-01T17:39:56.980904+0000","last_clean":"2023-01-01T17:39:56.980904+0000","last_became_active":"2023-01-01T17:39:52.960846+0000","last_became_peered":"2023-01-01T17:39:52.960846+0000","last_unstale":"2023-01-01T17:39:56.980904+0000","last_undegraded":"2023-01-01T17:39:56.980904+0000","last_fullsized":"2023-01-01T17:39:56.980904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:04:29.980357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.969138+0000","last_change":"2023-01-01T17:39:52.968144+0000","last_active":"2023-01-01T17:39:56.969138+0000","last_peered":"2023-01-01T17:39:56.969138+0000","last_clean":"2023-01-01T17:39:56.969138+0000","last_became_active":"2023-01-01T17:39:52.965674+0000","last_became_peered":"2023-01-01T17:39:52.965674+0000","last_unstale":"2023-01-01T17:39:56.969138+0000","last_undegraded":"2023-01-01T17:39:56.969138+0000","last_fullsized":"2023-01-01T17:39:56.969138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:38:10.525560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.974768+0000","last_change":"2023-01-01T17:39:52.964599+0000","last_active":"2023-01-01T17:39:56.974768+0000","last_peered":"2023-01-01T17:39:56.974768+0000","last_clean":"2023-01-01T17:39:56.974768+0000","last_became_active":"2023-01-01T17:39:52.964336+0000","last_became_peered":"2023-01-01T17:39:52.964336+0000","last_unstale":"2023-01-01T17:39:56.974768+0000","last_undegraded":"2023-01-01T17:39:56.974768+0000","last_fullsized":"2023-01-01T17:39:56.974768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:02:42.190753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966415+0000","last_change":"2023-01-01T17:39:52.960039+0000","last_active":"2023-01-01T17:39:56.966415+0000","last_peered":"2023-01-01T17:39:56.966415+0000","last_clean":"2023-01-01T17:39:56.966415+0000","last_became_active":"2023-01-01T17:39:52.959724+0000","last_became_peered":"2023-01-01T17:39:52.959724+0000","last_unstale":"2023-01-01T17:39:56.966415+0000","last_undegraded":"2023-01-01T17:39:56.966415+0000","last_fullsized":"2023-01-01T17:39:56.966415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T22:42:37.419622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.970407+0000","last_change":"2023-01-01T17:39:52.963027+0000","last_active":"2023-01-01T17:39:56.970407+0000","last_peered":"2023-01-01T17:39:56.970407+0000","last_clean":"2023-01-01T17:39:56.970407+0000","last_became_active":"2023-01-01T17:39:52.962713+0000","last_became_peered":"2023-01-01T17:39:52.962713+0000","last_unstale":"2023-01-01T17:39:56.970407+0000","last_undegraded":"2023-01-01T17:39:56.970407+0000","last_fullsized":"2023-01-01T17:39:56.970407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T22:42:37.419622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966304+0000","last_change":"2023-01-01T17:39:52.967957+0000","last_active":"2023-01-01T17:39:56.966304+0000","last_peered":"2023-01-01T17:39:56.966304+0000","last_clean":"2023-01-01T17:39:56.966304+0000","last_became_active":"2023-01-01T17:39:52.967249+0000","last_became_peered":"2023-01-01T17:39:52.967249+0000","last_unstale":"2023-01-01T17:39:56.966304+0000","last_undegraded":"2023-01-01T17:39:56.966304+0000","last_fullsized":"2023-01-01T17:39:56.966304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:39:12.933552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971966+0000","last_change":"2023-01-01T17:39:52.966701+0000","last_active":"2023-01-01T17:39:56.971966+0000","last_peered":"2023-01-01T17:39:56.971966+0000","last_clean":"2023-01-01T17:39:56.971966+0000","last_became_active":"2023-01-01T17:39:52.966423+0000","last_became_peered":"2023-01-01T17:39:52.966423+0000","last_unstale":"2023-01-01T17:39:56.971966+0000","last_undegraded":"2023-01-01T17:39:56.971966+0000","last_fullsized":"2023-01-01T17:39:56.971966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:12:40.598666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.972841+0000","last_change":"2023-01-01T17:39:52.961555+0000","last_active":"2023-01-01T17:39:56.972841+0000","last_peered":"2023-01-01T17:39:56.972841+0000","last_clean":"2023-01-01T17:39:56.972841+0000","last_became_active":"2023-01-01T17:39:52.961192+0000","last_became_peered":"2023-01-01T17:39:52.961192+0000","last_unstale":"2023-01-01T17:39:56.972841+0000","last_undegraded":"2023-01-01T17:39:56.972841+0000","last_fullsized":"2023-01-01T17:39:56.972841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:37:22.833792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966452+0000","last_change":"2023-01-01T17:39:52.959421+0000","last_active":"2023-01-01T17:39:56.966452+0000","last_peered":"2023-01-01T17:39:56.966452+0000","last_clean":"2023-01-01T17:39:56.966452+0000","last_became_active":"2023-01-01T17:39:52.959094+0000","last_became_peered":"2023-01-01T17:39:52.959094+0000","last_unstale":"2023-01-01T17:39:56.966452+0000","last_undegraded":"2023-01-01T17:39:56.966452+0000","last_fullsized":"2023-01-01T17:39:56.966452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:06:59.618607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.967485+0000","last_change":"2023-01-01T17:39:52.957064+0000","last_active":"2023-01-01T17:39:56.967485+0000","last_peered":"2023-01-01T17:39:56.967485+0000","last_clean":"2023-01-01T17:39:56.967485+0000","last_became_active":"2023-01-01T17:39:52.956770+0000","last_became_peered":"2023-01-01T17:39:52.956770+0000","last_unstale":"2023-01-01T17:39:56.967485+0000","last_undegraded":"2023-01-01T17:39:56.967485+0000","last_fullsized":"2023-01-01T17:39:56.967485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:05:32.452823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.970532+0000","last_change":"2023-01-01T17:39:52.964133+0000","last_active":"2023-01-01T17:39:56.970532+0000","last_peered":"2023-01-01T17:39:56.970532+0000","last_clean":"2023-01-01T17:39:56.970532+0000","last_became_active":"2023-01-01T17:39:52.963864+0000","last_became_peered":"2023-01-01T17:39:52.963864+0000","last_unstale":"2023-01-01T17:39:56.970532+0000","last_undegraded":"2023-01-01T17:39:56.970532+0000","last_fullsized":"2023-01-01T17:39:56.970532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:21:06.881543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966333+0000","last_change":"2023-01-01T17:39:52.960044+0000","last_active":"2023-01-01T17:39:56.966333+0000","last_peered":"2023-01-01T17:39:56.966333+0000","last_clean":"2023-01-01T17:39:56.966333+0000","last_became_active":"2023-01-01T17:39:52.959767+0000","last_became_peered":"2023-01-01T17:39:52.959767+0000","last_unstale":"2023-01-01T17:39:56.966333+0000","last_undegraded":"2023-01-01T17:39:56.966333+0000","last_fullsized":"2023-01-01T17:39:56.966333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:17:10.326486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.978656+0000","last_change":"2023-01-01T17:39:52.964688+0000","last_active":"2023-01-01T17:39:56.978656+0000","last_peered":"2023-01-01T17:39:56.978656+0000","last_clean":"2023-01-01T17:39:56.978656+0000","last_became_active":"2023-01-01T17:39:52.964376+0000","last_became_peered":"2023-01-01T17:39:52.964376+0000","last_unstale":"2023-01-01T17:39:56.978656+0000","last_undegraded":"2023-01-01T17:39:56.978656+0000","last_fullsized":"2023-01-01T17:39:56.978656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T02:02:52.710038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966403+0000","last_change":"2023-01-01T17:39:52.967459+0000","last_active":"2023-01-01T17:39:56.966403+0000","last_peered":"2023-01-01T17:39:56.966403+0000","last_clean":"2023-01-01T17:39:56.966403+0000","last_became_active":"2023-01-01T17:39:52.965683+0000","last_became_peered":"2023-01-01T17:39:52.965683+0000","last_unstale":"2023-01-01T17:39:56.966403+0000","last_undegraded":"2023-01-01T17:39:56.966403+0000","last_fullsized":"2023-01-01T17:39:56.966403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:17:10.326486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.972847+0000","last_change":"2023-01-01T17:39:52.961461+0000","last_active":"2023-01-01T17:39:56.972847+0000","last_peered":"2023-01-01T17:39:56.972847+0000","last_clean":"2023-01-01T17:39:56.972847+0000","last_became_active":"2023-01-01T17:39:52.961145+0000","last_became_peered":"2023-01-01T17:39:52.961145+0000","last_unstale":"2023-01-01T17:39:56.972847+0000","last_undegraded":"2023-01-01T17:39:56.972847+0000","last_fullsized":"2023-01-01T17:39:56.972847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:20:30.823975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.967766+0000","last_change":"2023-01-01T17:39:52.958062+0000","last_active":"2023-01-01T17:39:56.967766+0000","last_peered":"2023-01-01T17:39:56.967766+0000","last_clean":"2023-01-01T17:39:56.967766+0000","last_became_active":"2023-01-01T17:39:52.957780+0000","last_became_peered":"2023-01-01T17:39:52.957780+0000","last_unstale":"2023-01-01T17:39:56.967766+0000","last_undegraded":"2023-01-01T17:39:56.967766+0000","last_fullsized":"2023-01-01T17:39:56.967766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:47:32.933861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971406+0000","last_change":"2023-01-01T17:39:52.965920+0000","last_active":"2023-01-01T17:39:56.971406+0000","last_peered":"2023-01-01T17:39:56.971406+0000","last_clean":"2023-01-01T17:39:56.971406+0000","last_became_active":"2023-01-01T17:39:52.965681+0000","last_became_peered":"2023-01-01T17:39:52.965681+0000","last_unstale":"2023-01-01T17:39:56.971406+0000","last_undegraded":"2023-01-01T17:39:56.971406+0000","last_fullsized":"2023-01-01T17:39:56.971406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:28:47.766864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.967121+0000","last_change":"2023-01-01T17:39:52.955931+0000","last_active":"2023-01-01T17:39:56.967121+0000","last_peered":"2023-01-01T17:39:56.967121+0000","last_clean":"2023-01-01T17:39:56.967121+0000","last_became_active":"2023-01-01T17:39:52.955405+0000","last_became_peered":"2023-01-01T17:39:52.955405+0000","last_unstale":"2023-01-01T17:39:56.967121+0000","last_undegraded":"2023-01-01T17:39:56.967121+0000","last_fullsized":"2023-01-01T17:39:56.967121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:39:12.933552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966623+0000","last_change":"2023-01-01T17:39:52.972351+0000","last_active":"2023-01-01T17:39:56.966623+0000","last_peered":"2023-01-01T17:39:56.966623+0000","last_clean":"2023-01-01T17:39:56.966623+0000","last_became_active":"2023-01-01T17:39:52.972060+0000","last_became_peered":"2023-01-01T17:39:52.972060+0000","last_unstale":"2023-01-01T17:39:56.966623+0000","last_undegraded":"2023-01-01T17:39:56.966623+0000","last_fullsized":"2023-01-01T17:39:56.966623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:13:17.225019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971864+0000","last_change":"2023-01-01T17:39:52.959545+0000","last_active":"2023-01-01T17:39:56.971864+0000","last_peered":"2023-01-01T17:39:56.971864+0000","last_clean":"2023-01-01T17:39:56.971864+0000","last_became_active":"2023-01-01T17:39:52.959020+0000","last_became_peered":"2023-01-01T17:39:52.959020+0000","last_unstale":"2023-01-01T17:39:56.971864+0000","last_undegraded":"2023-01-01T17:39:56.971864+0000","last_fullsized":"2023-01-01T17:39:56.971864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:20:51.060158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966447+0000","last_change":"2023-01-01T17:39:52.959152+0000","last_active":"2023-01-01T17:39:56.966447+0000","last_peered":"2023-01-01T17:39:56.966447+0000","last_clean":"2023-01-01T17:39:56.966447+0000","last_became_active":"2023-01-01T17:39:52.958925+0000","last_became_peered":"2023-01-01T17:39:52.958925+0000","last_unstale":"2023-01-01T17:39:56.966447+0000","last_undegraded":"2023-01-01T17:39:56.966447+0000","last_fullsized":"2023-01-01T17:39:56.966447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:27:49.306438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.981469+0000","last_change":"2023-01-01T17:39:52.970401+0000","last_active":"2023-01-01T17:39:56.981469+0000","last_peered":"2023-01-01T17:39:56.981469+0000","last_clean":"2023-01-01T17:39:56.981469+0000","last_became_active":"2023-01-01T17:39:52.970123+0000","last_became_peered":"2023-01-01T17:39:52.970123+0000","last_unstale":"2023-01-01T17:39:56.981469+0000","last_undegraded":"2023-01-01T17:39:56.981469+0000","last_fullsized":"2023-01-01T17:39:56.981469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T22:42:37.419622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.981509+0000","last_change":"2023-01-01T17:39:52.966659+0000","last_active":"2023-01-01T17:39:56.981509+0000","last_peered":"2023-01-01T17:39:56.981509+0000","last_clean":"2023-01-01T17:39:56.981509+0000","last_became_active":"2023-01-01T17:39:52.966510+0000","last_became_peered":"2023-01-01T17:39:52.966510+0000","last_unstale":"2023-01-01T17:39:56.981509+0000","last_undegraded":"2023-01-01T17:39:56.981509+0000","last_fullsized":"2023-01-01T17:39:56.981509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:21:06.881543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971060+0000","last_change":"2023-01-01T17:39:52.965968+0000","last_active":"2023-01-01T17:39:56.971060+0000","last_peered":"2023-01-01T17:39:56.971060+0000","last_clean":"2023-01-01T17:39:56.971060+0000","last_became_active":"2023-01-01T17:39:52.965515+0000","last_became_peered":"2023-01-01T17:39:52.965515+0000","last_unstale":"2023-01-01T17:39:56.971060+0000","last_undegraded":"2023-01-01T17:39:56.971060+0000","last_fullsized":"2023-01-01T17:39:56.971060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:39:12.933552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.832942+0000","last_change":"2023-01-01T17:39:56.985909+0000","last_active":"2023-01-01T17:39:58.832942+0000","last_peered":"2023-01-01T17:39:58.832942+0000","last_clean":"2023-01-01T17:39:58.832942+0000","last_became_active":"2023-01-01T17:39:56.985529+0000","last_became_peered":"2023-01-01T17:39:56.985529+0000","last_unstale":"2023-01-01T17:39:58.832942+0000","last_undegraded":"2023-01-01T17:39:58.832942+0000","last_fullsized":"2023-01-01T17:39:58.832942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:52:49.314145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.973444+0000","last_change":"2023-01-01T17:39:52.544503+0000","last_active":"2023-01-01T17:39:56.973444+0000","last_peered":"2023-01-01T17:39:56.973444+0000","last_clean":"2023-01-01T17:39:56.973444+0000","last_became_active":"2023-01-01T17:39:52.544174+0000","last_became_peered":"2023-01-01T17:39:52.544174+0000","last_unstale":"2023-01-01T17:39:56.973444+0000","last_undegraded":"2023-01-01T17:39:56.973444+0000","last_fullsized":"2023-01-01T17:39:56.973444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:04:09.352850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.975913+0000","last_change":"2023-01-01T17:39:52.961218+0000","last_active":"2023-01-01T17:39:56.975913+0000","last_peered":"2023-01-01T17:39:56.975913+0000","last_clean":"2023-01-01T17:39:56.975913+0000","last_became_active":"2023-01-01T17:39:52.960909+0000","last_became_peered":"2023-01-01T17:39:52.960909+0000","last_unstale":"2023-01-01T17:39:56.975913+0000","last_undegraded":"2023-01-01T17:39:56.975913+0000","last_fullsized":"2023-01-01T17:39:56.975913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:27:49.306438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.397722+0000","last_change":"2023-01-01T17:39:56.983018+0000","last_active":"2023-01-01T17:39:57.397722+0000","last_peered":"2023-01-01T17:39:57.397722+0000","last_clean":"2023-01-01T17:39:57.397722+0000","last_became_active":"2023-01-01T17:39:56.981943+0000","last_became_peered":"2023-01-01T17:39:56.981943+0000","last_unstale":"2023-01-01T17:39:57.397722+0000","last_undegraded":"2023-01-01T17:39:57.397722+0000","last_fullsized":"2023-01-01T17:39:57.397722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:53:49.928875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.980811+0000","last_change":"2023-01-01T17:39:52.548955+0000","last_active":"2023-01-01T17:39:56.980811+0000","last_peered":"2023-01-01T17:39:56.980811+0000","last_clean":"2023-01-01T17:39:56.980811+0000","last_became_active":"2023-01-01T17:39:52.548746+0000","last_became_peered":"2023-01-01T17:39:52.548746+0000","last_unstale":"2023-01-01T17:39:56.980811+0000","last_undegraded":"2023-01-01T17:39:56.980811+0000","last_fullsized":"2023-01-01T17:39:56.980811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:48:45.787227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.968330+0000","last_change":"2023-01-01T17:39:52.967463+0000","last_active":"2023-01-01T17:39:56.968330+0000","last_peered":"2023-01-01T17:39:56.968330+0000","last_clean":"2023-01-01T17:39:56.968330+0000","last_became_active":"2023-01-01T17:39:52.965478+0000","last_became_peered":"2023-01-01T17:39:52.965478+0000","last_unstale":"2023-01-01T17:39:56.968330+0000","last_undegraded":"2023-01-01T17:39:56.968330+0000","last_fullsized":"2023-01-01T17:39:56.968330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T05:06:34.299709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.437445+0000","last_change":"2023-01-01T17:39:56.986080+0000","last_active":"2023-01-01T17:39:57.437445+0000","last_peered":"2023-01-01T17:39:57.437445+0000","last_clean":"2023-01-01T17:39:57.437445+0000","last_became_active":"2023-01-01T17:39:56.985584+0000","last_became_peered":"2023-01-01T17:39:56.985584+0000","last_unstale":"2023-01-01T17:39:57.437445+0000","last_undegraded":"2023-01-01T17:39:57.437445+0000","last_fullsized":"2023-01-01T17:39:57.437445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:14:54.324576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971939+0000","last_change":"2023-01-01T17:39:52.542192+0000","last_active":"2023-01-01T17:39:56.971939+0000","last_peered":"2023-01-01T17:39:56.971939+0000","last_clean":"2023-01-01T17:39:56.971939+0000","last_became_active":"2023-01-01T17:39:52.541722+0000","last_became_peered":"2023-01-01T17:39:52.541722+0000","last_unstale":"2023-01-01T17:39:56.971939+0000","last_undegraded":"2023-01-01T17:39:56.971939+0000","last_fullsized":"2023-01-01T17:39:56.971939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:05:31.448005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.981286+0000","last_change":"2023-01-01T17:39:52.963441+0000","last_active":"2023-01-01T17:39:56.981286+0000","last_peered":"2023-01-01T17:39:56.981286+0000","last_clean":"2023-01-01T17:39:56.981286+0000","last_became_active":"2023-01-01T17:39:52.963185+0000","last_became_peered":"2023-01-01T17:39:52.963185+0000","last_unstale":"2023-01-01T17:39:56.981286+0000","last_undegraded":"2023-01-01T17:39:56.981286+0000","last_fullsized":"2023-01-01T17:39:56.981286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:51:02.120858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.397417+0000","last_change":"2023-01-01T17:39:56.986618+0000","last_active":"2023-01-01T17:39:57.397417+0000","last_peered":"2023-01-01T17:39:57.397417+0000","last_clean":"2023-01-01T17:39:57.397417+0000","last_became_active":"2023-01-01T17:39:56.986194+0000","last_became_peered":"2023-01-01T17:39:56.986194+0000","last_unstale":"2023-01-01T17:39:57.397417+0000","last_undegraded":"2023-01-01T17:39:57.397417+0000","last_fullsized":"2023-01-01T17:39:57.397417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:20:54.495809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966504+0000","last_change":"2023-01-01T17:39:52.549532+0000","last_active":"2023-01-01T17:39:56.966504+0000","last_peered":"2023-01-01T17:39:56.966504+0000","last_clean":"2023-01-01T17:39:56.966504+0000","last_became_active":"2023-01-01T17:39:52.546547+0000","last_became_peered":"2023-01-01T17:39:52.546547+0000","last_unstale":"2023-01-01T17:39:56.966504+0000","last_undegraded":"2023-01-01T17:39:56.966504+0000","last_fullsized":"2023-01-01T17:39:56.966504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:04:09.352850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971830+0000","last_change":"2023-01-01T17:39:52.958851+0000","last_active":"2023-01-01T17:39:56.971830+0000","last_peered":"2023-01-01T17:39:56.971830+0000","last_clean":"2023-01-01T17:39:56.971830+0000","last_became_active":"2023-01-01T17:39:52.958452+0000","last_became_peered":"2023-01-01T17:39:52.958452+0000","last_unstale":"2023-01-01T17:39:56.971830+0000","last_undegraded":"2023-01-01T17:39:56.971830+0000","last_fullsized":"2023-01-01T17:39:56.971830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:53:46.493224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.895404+0000","last_change":"2023-01-01T17:39:56.984155+0000","last_active":"2023-01-01T17:39:58.895404+0000","last_peered":"2023-01-01T17:39:58.895404+0000","last_clean":"2023-01-01T17:39:58.895404+0000","last_became_active":"2023-01-01T17:39:56.983766+0000","last_became_peered":"2023-01-01T17:39:56.983766+0000","last_unstale":"2023-01-01T17:39:58.895404+0000","last_undegraded":"2023-01-01T17:39:58.895404+0000","last_fullsized":"2023-01-01T17:39:58.895404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:27:23.085160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971866+0000","last_change":"2023-01-01T17:39:52.543588+0000","last_active":"2023-01-01T17:39:56.971866+0000","last_peered":"2023-01-01T17:39:56.971866+0000","last_clean":"2023-01-01T17:39:56.971866+0000","last_became_active":"2023-01-01T17:39:52.543119+0000","last_became_peered":"2023-01-01T17:39:52.543119+0000","last_unstale":"2023-01-01T17:39:56.971866+0000","last_undegraded":"2023-01-01T17:39:56.971866+0000","last_fullsized":"2023-01-01T17:39:56.971866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:04:09.352850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971673+0000","last_change":"2023-01-01T17:39:52.949406+0000","last_active":"2023-01-01T17:39:56.971673+0000","last_peered":"2023-01-01T17:39:56.971673+0000","last_clean":"2023-01-01T17:39:56.971673+0000","last_became_active":"2023-01-01T17:39:52.949198+0000","last_became_peered":"2023-01-01T17:39:52.949198+0000","last_unstale":"2023-01-01T17:39:56.971673+0000","last_undegraded":"2023-01-01T17:39:56.971673+0000","last_fullsized":"2023-01-01T17:39:56.971673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:39:12.933552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.396744+0000","last_change":"2023-01-01T17:39:56.988325+0000","last_active":"2023-01-01T17:39:57.396744+0000","last_peered":"2023-01-01T17:39:57.396744+0000","last_clean":"2023-01-01T17:39:57.396744+0000","last_became_active":"2023-01-01T17:39:56.987892+0000","last_became_peered":"2023-01-01T17:39:56.987892+0000","last_unstale":"2023-01-01T17:39:57.396744+0000","last_undegraded":"2023-01-01T17:39:57.396744+0000","last_fullsized":"2023-01-01T17:39:57.396744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:59:18.287257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966680+0000","last_change":"2023-01-01T17:39:52.551693+0000","last_active":"2023-01-01T17:39:56.966680+0000","last_peered":"2023-01-01T17:39:56.966680+0000","last_clean":"2023-01-01T17:39:56.966680+0000","last_became_active":"2023-01-01T17:39:52.551402+0000","last_became_peered":"2023-01-01T17:39:52.551402+0000","last_unstale":"2023-01-01T17:39:56.966680+0000","last_undegraded":"2023-01-01T17:39:56.966680+0000","last_fullsized":"2023-01-01T17:39:56.966680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:56:28.713641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.981128+0000","last_change":"2023-01-01T17:39:52.972567+0000","last_active":"2023-01-01T17:39:56.981128+0000","last_peered":"2023-01-01T17:39:56.981128+0000","last_clean":"2023-01-01T17:39:56.981128+0000","last_became_active":"2023-01-01T17:39:52.971771+0000","last_became_peered":"2023-01-01T17:39:52.971771+0000","last_unstale":"2023-01-01T17:39:56.981128+0000","last_undegraded":"2023-01-01T17:39:56.981128+0000","last_fullsized":"2023-01-01T17:39:56.981128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T22:26:50.173884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.439549+0000","last_change":"2023-01-01T17:39:56.984259+0000","last_active":"2023-01-01T17:39:57.439549+0000","last_peered":"2023-01-01T17:39:57.439549+0000","last_clean":"2023-01-01T17:39:57.439549+0000","last_became_active":"2023-01-01T17:39:56.983826+0000","last_became_peered":"2023-01-01T17:39:56.983826+0000","last_unstale":"2023-01-01T17:39:57.439549+0000","last_undegraded":"2023-01-01T17:39:57.439549+0000","last_fullsized":"2023-01-01T17:39:57.439549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T05:23:20.710125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'9","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:40:02.106107+0000","last_change":"2023-01-01T17:39:52.542307+0000","last_active":"2023-01-01T17:40:02.106107+0000","last_peered":"2023-01-01T17:40:02.106107+0000","last_clean":"2023-01-01T17:40:02.106107+0000","last_became_active":"2023-01-01T17:39:52.542004+0000","last_became_peered":"2023-01-01T17:39:52.542004+0000","last_unstale":"2023-01-01T17:40:02.106107+0000","last_undegraded":"2023-01-01T17:40:02.106107+0000","last_fullsized":"2023-01-01T17:40:02.106107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:34:48.096366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.973005+0000","last_change":"2023-01-01T17:39:52.965551+0000","last_active":"2023-01-01T17:39:56.973005+0000","last_peered":"2023-01-01T17:39:56.973005+0000","last_clean":"2023-01-01T17:39:56.973005+0000","last_became_active":"2023-01-01T17:39:52.965295+0000","last_became_peered":"2023-01-01T17:39:52.965295+0000","last_unstale":"2023-01-01T17:39:56.973005+0000","last_undegraded":"2023-01-01T17:39:56.973005+0000","last_fullsized":"2023-01-01T17:39:56.973005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:45:24.963723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.474391+0000","last_change":"2023-01-01T17:39:56.988193+0000","last_active":"2023-01-01T17:39:58.474391+0000","last_peered":"2023-01-01T17:39:58.474391+0000","last_clean":"2023-01-01T17:39:58.474391+0000","last_became_active":"2023-01-01T17:39:56.987742+0000","last_became_peered":"2023-01-01T17:39:56.987742+0000","last_unstale":"2023-01-01T17:39:58.474391+0000","last_undegraded":"2023-01-01T17:39:58.474391+0000","last_fullsized":"2023-01-01T17:39:58.474391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:02:01.149781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.967223+0000","last_change":"2023-01-01T17:39:52.544115+0000","last_active":"2023-01-01T17:39:56.967223+0000","last_peered":"2023-01-01T17:39:56.967223+0000","last_clean":"2023-01-01T17:39:56.967223+0000","last_became_active":"2023-01-01T17:39:52.543262+0000","last_became_peered":"2023-01-01T17:39:52.543262+0000","last_unstale":"2023-01-01T17:39:56.967223+0000","last_undegraded":"2023-01-01T17:39:56.967223+0000","last_fullsized":"2023-01-01T17:39:56.967223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:04:28.975539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.976885+0000","last_change":"2023-01-01T17:39:52.961302+0000","last_active":"2023-01-01T17:39:56.976885+0000","last_peered":"2023-01-01T17:39:56.976885+0000","last_clean":"2023-01-01T17:39:56.976885+0000","last_became_active":"2023-01-01T17:39:52.960989+0000","last_became_peered":"2023-01-01T17:39:52.960989+0000","last_unstale":"2023-01-01T17:39:56.976885+0000","last_undegraded":"2023-01-01T17:39:56.976885+0000","last_fullsized":"2023-01-01T17:39:56.976885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:12:40.598666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.396961+0000","last_change":"2023-01-01T17:39:56.991710+0000","last_active":"2023-01-01T17:39:57.396961+0000","last_peered":"2023-01-01T17:39:57.396961+0000","last_clean":"2023-01-01T17:39:57.396961+0000","last_became_active":"2023-01-01T17:39:56.990850+0000","last_became_peered":"2023-01-01T17:39:56.990850+0000","last_unstale":"2023-01-01T17:39:57.396961+0000","last_undegraded":"2023-01-01T17:39:57.396961+0000","last_fullsized":"2023-01-01T17:39:57.396961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:02:01.149781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966815+0000","last_change":"2023-01-01T17:39:52.545791+0000","last_active":"2023-01-01T17:39:56.966815+0000","last_peered":"2023-01-01T17:39:56.966815+0000","last_clean":"2023-01-01T17:39:56.966815+0000","last_became_active":"2023-01-01T17:39:52.545488+0000","last_became_peered":"2023-01-01T17:39:52.545488+0000","last_unstale":"2023-01-01T17:39:56.966815+0000","last_undegraded":"2023-01-01T17:39:56.966815+0000","last_fullsized":"2023-01-01T17:39:56.966815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:56:28.713641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971022+0000","last_change":"2023-01-01T17:39:52.965778+0000","last_active":"2023-01-01T17:39:56.971022+0000","last_peered":"2023-01-01T17:39:56.971022+0000","last_clean":"2023-01-01T17:39:56.971022+0000","last_became_active":"2023-01-01T17:39:52.965147+0000","last_became_peered":"2023-01-01T17:39:52.965147+0000","last_unstale":"2023-01-01T17:39:56.971022+0000","last_undegraded":"2023-01-01T17:39:56.971022+0000","last_fullsized":"2023-01-01T17:39:56.971022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:17:10.326486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.396845+0000","last_change":"2023-01-01T17:39:56.986717+0000","last_active":"2023-01-01T17:39:57.396845+0000","last_peered":"2023-01-01T17:39:57.396845+0000","last_clean":"2023-01-01T17:39:57.396845+0000","last_became_active":"2023-01-01T17:39:56.986276+0000","last_became_peered":"2023-01-01T17:39:56.986276+0000","last_unstale":"2023-01-01T17:39:57.396845+0000","last_undegraded":"2023-01-01T17:39:57.396845+0000","last_fullsized":"2023-01-01T17:39:57.396845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:04:46.047782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966234+0000","last_change":"2023-01-01T17:39:52.544050+0000","last_active":"2023-01-01T17:39:56.966234+0000","last_peered":"2023-01-01T17:39:56.966234+0000","last_clean":"2023-01-01T17:39:56.966234+0000","last_became_active":"2023-01-01T17:39:52.543519+0000","last_became_peered":"2023-01-01T17:39:52.543519+0000","last_unstale":"2023-01-01T17:39:56.966234+0000","last_undegraded":"2023-01-01T17:39:56.966234+0000","last_fullsized":"2023-01-01T17:39:56.966234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T22:26:49.169066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.968604+0000","last_change":"2023-01-01T17:39:52.967678+0000","last_active":"2023-01-01T17:39:56.968604+0000","last_peered":"2023-01-01T17:39:56.968604+0000","last_clean":"2023-01-01T17:39:56.968604+0000","last_became_active":"2023-01-01T17:39:52.965616+0000","last_became_peered":"2023-01-01T17:39:52.965616+0000","last_unstale":"2023-01-01T17:39:56.968604+0000","last_undegraded":"2023-01-01T17:39:56.968604+0000","last_fullsized":"2023-01-01T17:39:56.968604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T22:42:37.419622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.474167+0000","last_change":"2023-01-01T17:39:56.987972+0000","last_active":"2023-01-01T17:39:58.474167+0000","last_peered":"2023-01-01T17:39:58.474167+0000","last_clean":"2023-01-01T17:39:58.474167+0000","last_became_active":"2023-01-01T17:39:56.987575+0000","last_became_peered":"2023-01-01T17:39:56.987575+0000","last_unstale":"2023-01-01T17:39:58.474167+0000","last_undegraded":"2023-01-01T17:39:58.474167+0000","last_fullsized":"2023-01-01T17:39:58.474167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T22:56:37.998610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.979048+0000","last_change":"2023-01-01T17:39:52.553331+0000","last_active":"2023-01-01T17:39:56.979048+0000","last_peered":"2023-01-01T17:39:56.979048+0000","last_clean":"2023-01-01T17:39:56.979048+0000","last_became_active":"2023-01-01T17:39:52.553030+0000","last_became_peered":"2023-01-01T17:39:52.553030+0000","last_unstale":"2023-01-01T17:39:56.979048+0000","last_undegraded":"2023-01-01T17:39:56.979048+0000","last_fullsized":"2023-01-01T17:39:56.979048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:21:53.166663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.975027+0000","last_change":"2023-01-01T17:39:52.949026+0000","last_active":"2023-01-01T17:39:56.975027+0000","last_peered":"2023-01-01T17:39:56.975027+0000","last_clean":"2023-01-01T17:39:56.975027+0000","last_became_active":"2023-01-01T17:39:52.948779+0000","last_became_peered":"2023-01-01T17:39:52.948779+0000","last_unstale":"2023-01-01T17:39:56.975027+0000","last_undegraded":"2023-01-01T17:39:56.975027+0000","last_fullsized":"2023-01-01T17:39:56.975027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T05:06:34.299709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.895796+0000","last_change":"2023-01-01T17:39:56.983900+0000","last_active":"2023-01-01T17:39:58.895796+0000","last_peered":"2023-01-01T17:39:58.895796+0000","last_clean":"2023-01-01T17:39:58.895796+0000","last_became_active":"2023-01-01T17:39:56.983523+0000","last_became_peered":"2023-01-01T17:39:56.983523+0000","last_unstale":"2023-01-01T17:39:58.895796+0000","last_undegraded":"2023-01-01T17:39:58.895796+0000","last_fullsized":"2023-01-01T17:39:58.895796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:45:28.399373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.968788+0000","last_change":"2023-01-01T17:39:52.543689+0000","last_active":"2023-01-01T17:39:56.968788+0000","last_peered":"2023-01-01T17:39:56.968788+0000","last_clean":"2023-01-01T17:39:56.968788+0000","last_became_active":"2023-01-01T17:39:52.543296+0000","last_became_peered":"2023-01-01T17:39:52.543296+0000","last_unstale":"2023-01-01T17:39:56.968788+0000","last_undegraded":"2023-01-01T17:39:56.968788+0000","last_fullsized":"2023-01-01T17:39:56.968788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T02:44:27.478991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.970314+0000","last_change":"2023-01-01T17:39:52.965596+0000","last_active":"2023-01-01T17:39:56.970314+0000","last_peered":"2023-01-01T17:39:56.970314+0000","last_clean":"2023-01-01T17:39:56.970314+0000","last_became_active":"2023-01-01T17:39:52.965299+0000","last_became_peered":"2023-01-01T17:39:52.965299+0000","last_unstale":"2023-01-01T17:39:56.970314+0000","last_undegraded":"2023-01-01T17:39:56.970314+0000","last_fullsized":"2023-01-01T17:39:56.970314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:29:27.193367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.393206+0000","last_change":"2023-01-01T17:39:56.985023+0000","last_active":"2023-01-01T17:39:57.393206+0000","last_peered":"2023-01-01T17:39:57.393206+0000","last_clean":"2023-01-01T17:39:57.393206+0000","last_became_active":"2023-01-01T17:39:56.984658+0000","last_became_peered":"2023-01-01T17:39:56.984658+0000","last_unstale":"2023-01-01T17:39:57.393206+0000","last_undegraded":"2023-01-01T17:39:57.393206+0000","last_fullsized":"2023-01-01T17:39:57.393206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:20:54.495809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.968602+0000","last_change":"2023-01-01T17:39:52.544983+0000","last_active":"2023-01-01T17:39:56.968602+0000","last_peered":"2023-01-01T17:39:56.968602+0000","last_clean":"2023-01-01T17:39:56.968602+0000","last_became_active":"2023-01-01T17:39:52.543540+0000","last_became_peered":"2023-01-01T17:39:52.543540+0000","last_unstale":"2023-01-01T17:39:56.968602+0000","last_undegraded":"2023-01-01T17:39:56.968602+0000","last_fullsized":"2023-01-01T17:39:56.968602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:51:01.116040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.975618+0000","last_change":"2023-01-01T17:39:52.961386+0000","last_active":"2023-01-01T17:39:56.975618+0000","last_peered":"2023-01-01T17:39:56.975618+0000","last_clean":"2023-01-01T17:39:56.975618+0000","last_became_active":"2023-01-01T17:39:52.961095+0000","last_became_peered":"2023-01-01T17:39:52.961095+0000","last_unstale":"2023-01-01T17:39:56.975618+0000","last_undegraded":"2023-01-01T17:39:56.975618+0000","last_fullsized":"2023-01-01T17:39:56.975618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:02:40.763669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.393555+0000","last_change":"2023-01-01T17:39:56.986859+0000","last_active":"2023-01-01T17:39:57.393555+0000","last_peered":"2023-01-01T17:39:57.393555+0000","last_clean":"2023-01-01T17:39:57.393555+0000","last_became_active":"2023-01-01T17:39:56.986501+0000","last_became_peered":"2023-01-01T17:39:56.986501+0000","last_unstale":"2023-01-01T17:39:57.393555+0000","last_undegraded":"2023-01-01T17:39:57.393555+0000","last_fullsized":"2023-01-01T17:39:57.393555+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:37:26.269443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966564+0000","last_change":"2023-01-01T17:39:52.547827+0000","last_active":"2023-01-01T17:39:56.966564+0000","last_peered":"2023-01-01T17:39:56.966564+0000","last_clean":"2023-01-01T17:39:56.966564+0000","last_became_active":"2023-01-01T17:39:52.547578+0000","last_became_peered":"2023-01-01T17:39:52.547578+0000","last_unstale":"2023-01-01T17:39:56.966564+0000","last_undegraded":"2023-01-01T17:39:56.966564+0000","last_fullsized":"2023-01-01T17:39:56.966564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:32:00.585258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.979287+0000","last_change":"2023-01-01T17:39:52.972609+0000","last_active":"2023-01-01T17:39:56.979287+0000","last_peered":"2023-01-01T17:39:56.979287+0000","last_clean":"2023-01-01T17:39:56.979287+0000","last_became_active":"2023-01-01T17:39:52.972412+0000","last_became_peered":"2023-01-01T17:39:52.972412+0000","last_unstale":"2023-01-01T17:39:56.979287+0000","last_undegraded":"2023-01-01T17:39:56.979287+0000","last_fullsized":"2023-01-01T17:39:56.979287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T02:44:28.483809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.393419+0000","last_change":"2023-01-01T17:39:56.982521+0000","last_active":"2023-01-01T17:39:57.393419+0000","last_peered":"2023-01-01T17:39:57.393419+0000","last_clean":"2023-01-01T17:39:57.393419+0000","last_became_active":"2023-01-01T17:39:56.982193+0000","last_became_peered":"2023-01-01T17:39:56.982193+0000","last_unstale":"2023-01-01T17:39:57.393419+0000","last_undegraded":"2023-01-01T17:39:57.393419+0000","last_fullsized":"2023-01-01T17:39:57.393419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:53:49.928875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.970959+0000","last_change":"2023-01-01T17:39:52.551778+0000","last_active":"2023-01-01T17:39:56.970959+0000","last_peered":"2023-01-01T17:39:56.970959+0000","last_clean":"2023-01-01T17:39:56.970959+0000","last_became_active":"2023-01-01T17:39:52.551372+0000","last_became_peered":"2023-01-01T17:39:52.551372+0000","last_unstale":"2023-01-01T17:39:56.970959+0000","last_undegraded":"2023-01-01T17:39:56.970959+0000","last_fullsized":"2023-01-01T17:39:56.970959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:06:58.613789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.968874+0000","last_change":"2023-01-01T17:39:52.958663+0000","last_active":"2023-01-01T17:39:56.968874+0000","last_peered":"2023-01-01T17:39:56.968874+0000","last_clean":"2023-01-01T17:39:56.968874+0000","last_became_active":"2023-01-01T17:39:52.958380+0000","last_became_peered":"2023-01-01T17:39:52.958380+0000","last_unstale":"2023-01-01T17:39:56.968874+0000","last_undegraded":"2023-01-01T17:39:56.968874+0000","last_fullsized":"2023-01-01T17:39:56.968874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:12:40.598666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.393440+0000","last_change":"2023-01-01T17:39:56.984062+0000","last_active":"2023-01-01T17:39:57.393440+0000","last_peered":"2023-01-01T17:39:57.393440+0000","last_clean":"2023-01-01T17:39:57.393440+0000","last_became_active":"2023-01-01T17:39:56.983629+0000","last_became_peered":"2023-01-01T17:39:56.983629+0000","last_unstale":"2023-01-01T17:39:57.393440+0000","last_undegraded":"2023-01-01T17:39:57.393440+0000","last_fullsized":"2023-01-01T17:39:57.393440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:13:20.660670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.974416+0000","last_change":"2023-01-01T17:39:52.543859+0000","last_active":"2023-01-01T17:39:56.974416+0000","last_peered":"2023-01-01T17:39:56.974416+0000","last_clean":"2023-01-01T17:39:56.974416+0000","last_became_active":"2023-01-01T17:39:52.543608+0000","last_became_peered":"2023-01-01T17:39:52.543608+0000","last_unstale":"2023-01-01T17:39:56.974416+0000","last_undegraded":"2023-01-01T17:39:56.974416+0000","last_fullsized":"2023-01-01T17:39:56.974416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:32:00.585258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971221+0000","last_change":"2023-01-01T17:39:52.955020+0000","last_active":"2023-01-01T17:39:56.971221+0000","last_peered":"2023-01-01T17:39:56.971221+0000","last_clean":"2023-01-01T17:39:56.971221+0000","last_became_active":"2023-01-01T17:39:52.954761+0000","last_became_peered":"2023-01-01T17:39:52.954761+0000","last_unstale":"2023-01-01T17:39:56.971221+0000","last_undegraded":"2023-01-01T17:39:56.971221+0000","last_fullsized":"2023-01-01T17:39:56.971221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:38:10.525560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.439777+0000","last_change":"2023-01-01T17:39:56.987402+0000","last_active":"2023-01-01T17:39:57.439777+0000","last_peered":"2023-01-01T17:39:57.439777+0000","last_clean":"2023-01-01T17:39:57.439777+0000","last_became_active":"2023-01-01T17:39:56.986985+0000","last_became_peered":"2023-01-01T17:39:56.986985+0000","last_unstale":"2023-01-01T17:39:57.439777+0000","last_undegraded":"2023-01-01T17:39:57.439777+0000","last_fullsized":"2023-01-01T17:39:57.439777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T02:27:56.672313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.980601+0000","last_change":"2023-01-01T17:39:52.545685+0000","last_active":"2023-01-01T17:39:56.980601+0000","last_peered":"2023-01-01T17:39:56.980601+0000","last_clean":"2023-01-01T17:39:56.980601+0000","last_became_active":"2023-01-01T17:39:52.545424+0000","last_became_peered":"2023-01-01T17:39:52.545424+0000","last_unstale":"2023-01-01T17:39:56.980601+0000","last_undegraded":"2023-01-01T17:39:56.980601+0000","last_fullsized":"2023-01-01T17:39:56.980601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:48:45.787227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.972715+0000","last_change":"2023-01-01T17:39:52.961138+0000","last_active":"2023-01-01T17:39:56.972715+0000","last_peered":"2023-01-01T17:39:56.972715+0000","last_clean":"2023-01-01T17:39:56.972715+0000","last_became_active":"2023-01-01T17:39:52.960867+0000","last_became_peered":"2023-01-01T17:39:52.960867+0000","last_unstale":"2023-01-01T17:39:56.972715+0000","last_undegraded":"2023-01-01T17:39:56.972715+0000","last_fullsized":"2023-01-01T17:39:56.972715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:53:46.493224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.474381+0000","last_change":"2023-01-01T17:39:56.984187+0000","last_active":"2023-01-01T17:39:58.474381+0000","last_peered":"2023-01-01T17:39:58.474381+0000","last_clean":"2023-01-01T17:39:58.474381+0000","last_became_active":"2023-01-01T17:39:56.983771+0000","last_became_peered":"2023-01-01T17:39:56.983771+0000","last_unstale":"2023-01-01T17:39:58.474381+0000","last_undegraded":"2023-01-01T17:39:58.474381+0000","last_fullsized":"2023-01-01T17:39:58.474381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:02:45.626404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.975453+0000","last_change":"2023-01-01T17:39:52.541917+0000","last_active":"2023-01-01T17:39:56.975453+0000","last_peered":"2023-01-01T17:39:56.975453+0000","last_clean":"2023-01-01T17:39:56.975453+0000","last_became_active":"2023-01-01T17:39:52.541656+0000","last_became_peered":"2023-01-01T17:39:52.541656+0000","last_unstale":"2023-01-01T17:39:56.975453+0000","last_undegraded":"2023-01-01T17:39:56.975453+0000","last_fullsized":"2023-01-01T17:39:56.975453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:47:31.929043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.972945+0000","last_change":"2023-01-01T17:39:52.960351+0000","last_active":"2023-01-01T17:39:56.972945+0000","last_peered":"2023-01-01T17:39:56.972945+0000","last_clean":"2023-01-01T17:39:56.972945+0000","last_became_active":"2023-01-01T17:39:52.960106+0000","last_became_peered":"2023-01-01T17:39:52.960106+0000","last_unstale":"2023-01-01T17:39:56.972945+0000","last_undegraded":"2023-01-01T17:39:56.972945+0000","last_fullsized":"2023-01-01T17:39:56.972945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:10:33.122278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.832775+0000","last_change":"2023-01-01T17:39:56.986969+0000","last_active":"2023-01-01T17:39:58.832775+0000","last_peered":"2023-01-01T17:39:58.832775+0000","last_clean":"2023-01-01T17:39:58.832775+0000","last_became_active":"2023-01-01T17:39:56.986612+0000","last_became_peered":"2023-01-01T17:39:56.986612+0000","last_unstale":"2023-01-01T17:39:58.832775+0000","last_undegraded":"2023-01-01T17:39:58.832775+0000","last_fullsized":"2023-01-01T17:39:58.832775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:59:32.743399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971705+0000","last_change":"2023-01-01T17:39:52.544178+0000","last_active":"2023-01-01T17:39:56.971705+0000","last_peered":"2023-01-01T17:39:56.971705+0000","last_clean":"2023-01-01T17:39:56.971705+0000","last_became_active":"2023-01-01T17:39:52.543259+0000","last_became_peered":"2023-01-01T17:39:52.543259+0000","last_unstale":"2023-01-01T17:39:56.971705+0000","last_undegraded":"2023-01-01T17:39:56.971705+0000","last_fullsized":"2023-01-01T17:39:56.971705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:04:09.352850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.981647+0000","last_change":"2023-01-01T17:39:52.966905+0000","last_active":"2023-01-01T17:39:56.981647+0000","last_peered":"2023-01-01T17:39:56.981647+0000","last_clean":"2023-01-01T17:39:56.981647+0000","last_became_active":"2023-01-01T17:39:52.966652+0000","last_became_peered":"2023-01-01T17:39:52.966652+0000","last_unstale":"2023-01-01T17:39:56.981647+0000","last_undegraded":"2023-01-01T17:39:56.981647+0000","last_fullsized":"2023-01-01T17:39:56.981647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:33:57.337802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.832482+0000","last_change":"2023-01-01T17:39:56.992320+0000","last_active":"2023-01-01T17:39:58.832482+0000","last_peered":"2023-01-01T17:39:58.832482+0000","last_clean":"2023-01-01T17:39:58.832482+0000","last_became_active":"2023-01-01T17:39:56.991958+0000","last_became_peered":"2023-01-01T17:39:56.991958+0000","last_unstale":"2023-01-01T17:39:58.832482+0000","last_undegraded":"2023-01-01T17:39:58.832482+0000","last_fullsized":"2023-01-01T17:39:58.832482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:44:25.204625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.974879+0000","last_change":"2023-01-01T17:39:52.542402+0000","last_active":"2023-01-01T17:39:56.974879+0000","last_peered":"2023-01-01T17:39:56.974879+0000","last_clean":"2023-01-01T17:39:56.974879+0000","last_became_active":"2023-01-01T17:39:52.541828+0000","last_became_peered":"2023-01-01T17:39:52.541828+0000","last_unstale":"2023-01-01T17:39:56.974879+0000","last_undegraded":"2023-01-01T17:39:56.974879+0000","last_fullsized":"2023-01-01T17:39:56.974879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:47:31.929043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.972864+0000","last_change":"2023-01-01T17:39:47.373285+0000","last_active":"2023-01-01T17:39:56.972864+0000","last_peered":"2023-01-01T17:39:56.972864+0000","last_clean":"2023-01-01T17:39:56.972864+0000","last_became_active":"2023-01-01T17:39:47.372956+0000","last_became_peered":"2023-01-01T17:39:47.372956+0000","last_unstale":"2023-01-01T17:39:56.972864+0000","last_undegraded":"2023-01-01T17:39:56.972864+0000","last_fullsized":"2023-01-01T17:39:56.972864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_clean_scrub_stamp":"2023-01-01T17:39:46.276990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:49:32.017195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971616+0000","last_change":"2023-01-01T17:39:52.949304+0000","last_active":"2023-01-01T17:39:56.971616+0000","last_peered":"2023-01-01T17:39:56.971616+0000","last_clean":"2023-01-01T17:39:56.971616+0000","last_became_active":"2023-01-01T17:39:52.949049+0000","last_became_peered":"2023-01-01T17:39:52.949049+0000","last_unstale":"2023-01-01T17:39:56.971616+0000","last_undegraded":"2023-01-01T17:39:56.971616+0000","last_fullsized":"2023-01-01T17:39:56.971616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:38:17.390301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.396068+0000","last_change":"2023-01-01T17:39:56.986230+0000","last_active":"2023-01-01T17:39:57.396068+0000","last_peered":"2023-01-01T17:39:57.396068+0000","last_clean":"2023-01-01T17:39:57.396068+0000","last_became_active":"2023-01-01T17:39:56.985563+0000","last_became_peered":"2023-01-01T17:39:56.985563+0000","last_unstale":"2023-01-01T17:39:57.396068+0000","last_undegraded":"2023-01-01T17:39:57.396068+0000","last_fullsized":"2023-01-01T17:39:57.396068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T05:39:37.898528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.975799+0000","last_change":"2023-01-01T17:39:47.302896+0000","last_active":"2023-01-01T17:39:56.975799+0000","last_peered":"2023-01-01T17:39:56.975799+0000","last_clean":"2023-01-01T17:39:56.975799+0000","last_became_active":"2023-01-01T17:39:47.302559+0000","last_became_peered":"2023-01-01T17:39:47.302559+0000","last_unstale":"2023-01-01T17:39:56.975799+0000","last_undegraded":"2023-01-01T17:39:56.975799+0000","last_fullsized":"2023-01-01T17:39:56.975799+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_clean_scrub_stamp":"2023-01-01T17:39:46.276990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:49:32.017195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.437307+0000","last_change":"2023-01-01T17:39:52.546050+0000","last_active":"2023-01-01T17:39:57.437307+0000","last_peered":"2023-01-01T17:39:57.437307+0000","last_clean":"2023-01-01T17:39:57.437307+0000","last_became_active":"2023-01-01T17:39:52.545801+0000","last_became_peered":"2023-01-01T17:39:52.545801+0000","last_unstale":"2023-01-01T17:39:57.437307+0000","last_undegraded":"2023-01-01T17:39:57.437307+0000","last_fullsized":"2023-01-01T17:39:57.437307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:34:48.096366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.975540+0000","last_change":"2023-01-01T17:39:52.963646+0000","last_active":"2023-01-01T17:39:56.975540+0000","last_peered":"2023-01-01T17:39:56.975540+0000","last_clean":"2023-01-01T17:39:56.975540+0000","last_became_active":"2023-01-01T17:39:52.963372+0000","last_became_peered":"2023-01-01T17:39:52.963372+0000","last_unstale":"2023-01-01T17:39:56.975540+0000","last_undegraded":"2023-01-01T17:39:56.975540+0000","last_fullsized":"2023-01-01T17:39:56.975540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:20:51.060158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.474248+0000","last_change":"2023-01-01T17:39:56.985447+0000","last_active":"2023-01-01T17:39:58.474248+0000","last_peered":"2023-01-01T17:39:58.474248+0000","last_clean":"2023-01-01T17:39:58.474248+0000","last_became_active":"2023-01-01T17:39:56.985061+0000","last_became_peered":"2023-01-01T17:39:56.985061+0000","last_unstale":"2023-01-01T17:39:58.474248+0000","last_undegraded":"2023-01-01T17:39:58.474248+0000","last_fullsized":"2023-01-01T17:39:58.474248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:40:46.122449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.981389+0000","last_change":"2023-01-01T17:39:47.304031+0000","last_active":"2023-01-01T17:39:56.981389+0000","last_peered":"2023-01-01T17:39:56.981389+0000","last_clean":"2023-01-01T17:39:56.981389+0000","last_became_active":"2023-01-01T17:39:47.303722+0000","last_became_peered":"2023-01-01T17:39:47.303722+0000","last_unstale":"2023-01-01T17:39:56.981389+0000","last_undegraded":"2023-01-01T17:39:56.981389+0000","last_fullsized":"2023-01-01T17:39:56.981389+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_clean_scrub_stamp":"2023-01-01T17:39:46.276990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:35:16.549190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966543+0000","last_change":"2023-01-01T17:39:47.305762+0000","last_active":"2023-01-01T17:39:56.966543+0000","last_peered":"2023-01-01T17:39:56.966543+0000","last_clean":"2023-01-01T17:39:56.966543+0000","last_became_active":"2023-01-01T17:39:47.304987+0000","last_became_peered":"2023-01-01T17:39:47.304987+0000","last_unstale":"2023-01-01T17:39:56.966543+0000","last_undegraded":"2023-01-01T17:39:56.966543+0000","last_fullsized":"2023-01-01T17:39:56.966543+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_clean_scrub_stamp":"2023-01-01T17:39:46.276990+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:21:04.167413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966426+0000","last_change":"2023-01-01T17:39:52.545184+0000","last_active":"2023-01-01T17:39:56.966426+0000","last_peered":"2023-01-01T17:39:56.966426+0000","last_clean":"2023-01-01T17:39:56.966426+0000","last_became_active":"2023-01-01T17:39:52.544797+0000","last_became_peered":"2023-01-01T17:39:52.544797+0000","last_unstale":"2023-01-01T17:39:56.966426+0000","last_undegraded":"2023-01-01T17:39:56.966426+0000","last_fullsized":"2023-01-01T17:39:56.966426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:32:00.585258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.968517+0000","last_change":"2023-01-01T17:39:52.972606+0000","last_active":"2023-01-01T17:39:56.968517+0000","last_peered":"2023-01-01T17:39:56.968517+0000","last_clean":"2023-01-01T17:39:56.968517+0000","last_became_active":"2023-01-01T17:39:52.972366+0000","last_became_peered":"2023-01-01T17:39:52.972366+0000","last_unstale":"2023-01-01T17:39:56.968517+0000","last_undegraded":"2023-01-01T17:39:56.968517+0000","last_fullsized":"2023-01-01T17:39:56.968517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:20:30.823975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.393598+0000","last_change":"2023-01-01T17:39:56.984925+0000","last_active":"2023-01-01T17:39:57.393598+0000","last_peered":"2023-01-01T17:39:57.393598+0000","last_clean":"2023-01-01T17:39:57.393598+0000","last_became_active":"2023-01-01T17:39:56.984572+0000","last_became_peered":"2023-01-01T17:39:56.984572+0000","last_unstale":"2023-01-01T17:39:57.393598+0000","last_undegraded":"2023-01-01T17:39:57.393598+0000","last_fullsized":"2023-01-01T17:39:57.393598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T05:06:37.735359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966941+0000","last_change":"2023-01-01T17:39:47.365630+0000","last_active":"2023-01-01T17:39:56.966941+0000","last_peered":"2023-01-01T17:39:56.966941+0000","last_clean":"2023-01-01T17:39:56.966941+0000","last_became_active":"2023-01-01T17:39:47.365306+0000","last_became_peered":"2023-01-01T17:39:47.365306+0000","last_unstale":"2023-01-01T17:39:56.966941+0000","last_undegraded":"2023-01-01T17:39:56.966941+0000","last_fullsized":"2023-01-01T17:39:56.966941+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_clean_scrub_stamp":"2023-01-01T17:39:46.276990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T02:18:31.270261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.980681+0000","last_change":"2023-01-01T17:39:52.548241+0000","last_active":"2023-01-01T17:39:56.980681+0000","last_peered":"2023-01-01T17:39:56.980681+0000","last_clean":"2023-01-01T17:39:56.980681+0000","last_became_active":"2023-01-01T17:39:52.547960+0000","last_became_peered":"2023-01-01T17:39:52.547960+0000","last_unstale":"2023-01-01T17:39:56.980681+0000","last_undegraded":"2023-01-01T17:39:56.980681+0000","last_fullsized":"2023-01-01T17:39:56.980681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:21:53.166663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.981566+0000","last_change":"2023-01-01T17:39:52.970894+0000","last_active":"2023-01-01T17:39:56.981566+0000","last_peered":"2023-01-01T17:39:56.981566+0000","last_clean":"2023-01-01T17:39:56.981566+0000","last_became_active":"2023-01-01T17:39:52.970617+0000","last_became_peered":"2023-01-01T17:39:52.970617+0000","last_unstale":"2023-01-01T17:39:56.981566+0000","last_undegraded":"2023-01-01T17:39:56.981566+0000","last_fullsized":"2023-01-01T17:39:56.981566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:29:27.193367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.895750+0000","last_change":"2023-01-01T17:39:56.979186+0000","last_active":"2023-01-01T17:39:58.895750+0000","last_peered":"2023-01-01T17:39:58.895750+0000","last_clean":"2023-01-01T17:39:58.895750+0000","last_became_active":"2023-01-01T17:39:56.978779+0000","last_became_peered":"2023-01-01T17:39:56.978779+0000","last_unstale":"2023-01-01T17:39:58.895750+0000","last_undegraded":"2023-01-01T17:39:58.895750+0000","last_fullsized":"2023-01-01T17:39:58.895750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:28:51.202515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966352+0000","last_change":"2023-01-01T17:39:47.365687+0000","last_active":"2023-01-01T17:39:56.966352+0000","last_peered":"2023-01-01T17:39:56.966352+0000","last_clean":"2023-01-01T17:39:56.966352+0000","last_became_active":"2023-01-01T17:39:47.365433+0000","last_became_peered":"2023-01-01T17:39:47.365433+0000","last_unstale":"2023-01-01T17:39:56.966352+0000","last_undegraded":"2023-01-01T17:39:56.966352+0000","last_fullsized":"2023-01-01T17:39:56.966352+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_clean_scrub_stamp":"2023-01-01T17:39:46.276990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:05:23.068625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971494+0000","last_change":"2023-01-01T17:39:52.542938+0000","last_active":"2023-01-01T17:39:56.971494+0000","last_peered":"2023-01-01T17:39:56.971494+0000","last_clean":"2023-01-01T17:39:56.971494+0000","last_became_active":"2023-01-01T17:39:52.542480+0000","last_became_peered":"2023-01-01T17:39:52.542480+0000","last_unstale":"2023-01-01T17:39:56.971494+0000","last_undegraded":"2023-01-01T17:39:56.971494+0000","last_fullsized":"2023-01-01T17:39:56.971494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:34:48.096366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.980422+0000","last_change":"2023-01-01T17:39:52.957732+0000","last_active":"2023-01-01T17:39:56.980422+0000","last_peered":"2023-01-01T17:39:56.980422+0000","last_clean":"2023-01-01T17:39:56.980422+0000","last_became_active":"2023-01-01T17:39:52.957531+0000","last_became_peered":"2023-01-01T17:39:52.957531+0000","last_unstale":"2023-01-01T17:39:56.980422+0000","last_undegraded":"2023-01-01T17:39:56.980422+0000","last_fullsized":"2023-01-01T17:39:56.980422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T03:53:15.558910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.437415+0000","last_change":"2023-01-01T17:39:56.985580+0000","last_active":"2023-01-01T17:39:57.437415+0000","last_peered":"2023-01-01T17:39:57.437415+0000","last_clean":"2023-01-01T17:39:57.437415+0000","last_became_active":"2023-01-01T17:39:56.985166+0000","last_became_peered":"2023-01-01T17:39:56.985166+0000","last_unstale":"2023-01-01T17:39:57.437415+0000","last_undegraded":"2023-01-01T17:39:57.437415+0000","last_fullsized":"2023-01-01T17:39:57.437415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:27:23.085160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.970225+0000","last_change":"2023-01-01T17:39:47.367908+0000","last_active":"2023-01-01T17:39:56.970225+0000","last_peered":"2023-01-01T17:39:56.970225+0000","last_clean":"2023-01-01T17:39:56.970225+0000","last_became_active":"2023-01-01T17:39:47.367631+0000","last_became_peered":"2023-01-01T17:39:47.367631+0000","last_unstale":"2023-01-01T17:39:56.970225+0000","last_undegraded":"2023-01-01T17:39:56.970225+0000","last_fullsized":"2023-01-01T17:39:56.970225+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_clean_scrub_stamp":"2023-01-01T17:39:46.276990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:35:16.549190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.973094+0000","last_change":"2023-01-01T17:39:52.546724+0000","last_active":"2023-01-01T17:39:56.973094+0000","last_peered":"2023-01-01T17:39:56.973094+0000","last_clean":"2023-01-01T17:39:56.973094+0000","last_became_active":"2023-01-01T17:39:52.546514+0000","last_became_peered":"2023-01-01T17:39:52.546514+0000","last_unstale":"2023-01-01T17:39:56.973094+0000","last_undegraded":"2023-01-01T17:39:56.973094+0000","last_fullsized":"2023-01-01T17:39:56.973094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:05:31.448005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.980812+0000","last_change":"2023-01-01T17:39:52.965004+0000","last_active":"2023-01-01T17:39:56.980812+0000","last_peered":"2023-01-01T17:39:56.980812+0000","last_clean":"2023-01-01T17:39:56.980812+0000","last_became_active":"2023-01-01T17:39:52.964483+0000","last_became_peered":"2023-01-01T17:39:52.964483+0000","last_unstale":"2023-01-01T17:39:56.980812+0000","last_undegraded":"2023-01-01T17:39:56.980812+0000","last_fullsized":"2023-01-01T17:39:56.980812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:26:59.346786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.397683+0000","last_change":"2023-01-01T17:39:56.994936+0000","last_active":"2023-01-01T17:39:57.397683+0000","last_peered":"2023-01-01T17:39:57.397683+0000","last_clean":"2023-01-01T17:39:57.397683+0000","last_became_active":"2023-01-01T17:39:56.994480+0000","last_became_peered":"2023-01-01T17:39:56.994480+0000","last_unstale":"2023-01-01T17:39:57.397683+0000","last_undegraded":"2023-01-01T17:39:57.397683+0000","last_fullsized":"2023-01-01T17:39:57.397683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:37:26.269443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.980561+0000","last_change":"2023-01-01T17:39:47.365528+0000","last_active":"2023-01-01T17:39:56.980561+0000","last_peered":"2023-01-01T17:39:56.980561+0000","last_clean":"2023-01-01T17:39:56.980561+0000","last_became_active":"2023-01-01T17:39:47.365239+0000","last_became_peered":"2023-01-01T17:39:47.365239+0000","last_unstale":"2023-01-01T17:39:56.980561+0000","last_undegraded":"2023-01-01T17:39:56.980561+0000","last_fullsized":"2023-01-01T17:39:56.980561+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_clean_scrub_stamp":"2023-01-01T17:39:46.276990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:21:04.167413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.981073+0000","last_change":"2023-01-01T17:39:52.542456+0000","last_active":"2023-01-01T17:39:56.981073+0000","last_peered":"2023-01-01T17:39:56.981073+0000","last_clean":"2023-01-01T17:39:56.981073+0000","last_became_active":"2023-01-01T17:39:52.542154+0000","last_became_peered":"2023-01-01T17:39:52.542154+0000","last_unstale":"2023-01-01T17:39:56.981073+0000","last_undegraded":"2023-01-01T17:39:56.981073+0000","last_fullsized":"2023-01-01T17:39:56.981073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:06:58.613789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.969042+0000","last_change":"2023-01-01T17:39:52.968138+0000","last_active":"2023-01-01T17:39:56.969042+0000","last_peered":"2023-01-01T17:39:56.969042+0000","last_clean":"2023-01-01T17:39:56.969042+0000","last_became_active":"2023-01-01T17:39:52.967887+0000","last_became_peered":"2023-01-01T17:39:52.967887+0000","last_unstale":"2023-01-01T17:39:56.969042+0000","last_undegraded":"2023-01-01T17:39:56.969042+0000","last_fullsized":"2023-01-01T17:39:56.969042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:38:17.390301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.436948+0000","last_change":"2023-01-01T17:39:56.992991+0000","last_active":"2023-01-01T17:39:57.436948+0000","last_peered":"2023-01-01T17:39:57.436948+0000","last_clean":"2023-01-01T17:39:57.436948+0000","last_became_active":"2023-01-01T17:39:56.986739+0000","last_became_peered":"2023-01-01T17:39:56.986739+0000","last_unstale":"2023-01-01T17:39:57.436948+0000","last_undegraded":"2023-01-01T17:39:57.436948+0000","last_fullsized":"2023-01-01T17:39:57.436948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:45:28.399373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.981191+0000","last_change":"2023-01-01T17:39:47.305897+0000","last_active":"2023-01-01T17:39:56.981191+0000","last_peered":"2023-01-01T17:39:56.981191+0000","last_clean":"2023-01-01T17:39:56.981191+0000","last_became_active":"2023-01-01T17:39:47.305590+0000","last_became_peered":"2023-01-01T17:39:47.305590+0000","last_unstale":"2023-01-01T17:39:56.981191+0000","last_undegraded":"2023-01-01T17:39:56.981191+0000","last_fullsized":"2023-01-01T17:39:56.981191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_clean_scrub_stamp":"2023-01-01T17:39:46.276990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:35:16.549190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.970834+0000","last_change":"2023-01-01T17:39:52.551958+0000","last_active":"2023-01-01T17:39:56.970834+0000","last_peered":"2023-01-01T17:39:56.970834+0000","last_clean":"2023-01-01T17:39:56.970834+0000","last_became_active":"2023-01-01T17:39:52.551432+0000","last_became_peered":"2023-01-01T17:39:52.551432+0000","last_unstale":"2023-01-01T17:39:56.970834+0000","last_undegraded":"2023-01-01T17:39:56.970834+0000","last_fullsized":"2023-01-01T17:39:56.970834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:34:48.096366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.980860+0000","last_change":"2023-01-01T17:39:52.970343+0000","last_active":"2023-01-01T17:39:56.980860+0000","last_peered":"2023-01-01T17:39:56.980860+0000","last_clean":"2023-01-01T17:39:56.980860+0000","last_became_active":"2023-01-01T17:39:52.970055+0000","last_became_peered":"2023-01-01T17:39:52.970055+0000","last_unstale":"2023-01-01T17:39:56.980860+0000","last_undegraded":"2023-01-01T17:39:56.980860+0000","last_fullsized":"2023-01-01T17:39:56.980860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:17:10.326486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.439827+0000","last_change":"2023-01-01T17:39:56.994930+0000","last_active":"2023-01-01T17:39:57.439827+0000","last_peered":"2023-01-01T17:39:57.439827+0000","last_clean":"2023-01-01T17:39:57.439827+0000","last_became_active":"2023-01-01T17:39:56.994469+0000","last_became_peered":"2023-01-01T17:39:56.994469+0000","last_unstale":"2023-01-01T17:39:57.439827+0000","last_undegraded":"2023-01-01T17:39:57.439827+0000","last_fullsized":"2023-01-01T17:39:57.439827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:27:23.085160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.969397+0000","last_change":"2023-01-01T17:39:52.553058+0000","last_active":"2023-01-01T17:39:56.969397+0000","last_peered":"2023-01-01T17:39:56.969397+0000","last_clean":"2023-01-01T17:39:56.969397+0000","last_became_active":"2023-01-01T17:39:52.552766+0000","last_became_peered":"2023-01-01T17:39:52.552766+0000","last_unstale":"2023-01-01T17:39:56.969397+0000","last_undegraded":"2023-01-01T17:39:56.969397+0000","last_fullsized":"2023-01-01T17:39:56.969397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:47:31.929043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.967297+0000","last_change":"2023-01-01T17:39:52.961138+0000","last_active":"2023-01-01T17:39:56.967297+0000","last_peered":"2023-01-01T17:39:56.967297+0000","last_clean":"2023-01-01T17:39:56.967297+0000","last_became_active":"2023-01-01T17:39:52.960885+0000","last_became_peered":"2023-01-01T17:39:52.960885+0000","last_unstale":"2023-01-01T17:39:56.967297+0000","last_undegraded":"2023-01-01T17:39:56.967297+0000","last_fullsized":"2023-01-01T17:39:56.967297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:34:49.101183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.895602+0000","last_change":"2023-01-01T17:39:56.985985+0000","last_active":"2023-01-01T17:39:58.895602+0000","last_peered":"2023-01-01T17:39:58.895602+0000","last_clean":"2023-01-01T17:39:58.895602+0000","last_became_active":"2023-01-01T17:39:56.985568+0000","last_became_peered":"2023-01-01T17:39:56.985568+0000","last_unstale":"2023-01-01T17:39:58.895602+0000","last_undegraded":"2023-01-01T17:39:58.895602+0000","last_fullsized":"2023-01-01T17:39:58.895602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:02:45.626404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.970839+0000","last_change":"2023-01-01T17:39:52.543976+0000","last_active":"2023-01-01T17:39:56.970839+0000","last_peered":"2023-01-01T17:39:56.970839+0000","last_clean":"2023-01-01T17:39:56.970839+0000","last_became_active":"2023-01-01T17:39:52.543744+0000","last_became_peered":"2023-01-01T17:39:52.543744+0000","last_unstale":"2023-01-01T17:39:56.970839+0000","last_undegraded":"2023-01-01T17:39:56.970839+0000","last_fullsized":"2023-01-01T17:39:56.970839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:32:00.585258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.972793+0000","last_change":"2023-01-01T17:39:52.957073+0000","last_active":"2023-01-01T17:39:56.972793+0000","last_peered":"2023-01-01T17:39:56.972793+0000","last_clean":"2023-01-01T17:39:56.972793+0000","last_became_active":"2023-01-01T17:39:52.956802+0000","last_became_peered":"2023-01-01T17:39:52.956802+0000","last_unstale":"2023-01-01T17:39:56.972793+0000","last_undegraded":"2023-01-01T17:39:56.972793+0000","last_fullsized":"2023-01-01T17:39:56.972793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:38:17.390301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.474123+0000","last_change":"2023-01-01T17:39:56.985478+0000","last_active":"2023-01-01T17:39:58.474123+0000","last_peered":"2023-01-01T17:39:58.474123+0000","last_clean":"2023-01-01T17:39:58.474123+0000","last_became_active":"2023-01-01T17:39:56.985070+0000","last_became_peered":"2023-01-01T17:39:56.985070+0000","last_unstale":"2023-01-01T17:39:58.474123+0000","last_undegraded":"2023-01-01T17:39:58.474123+0000","last_fullsized":"2023-01-01T17:39:58.474123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:50:42.814791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.970934+0000","last_change":"2023-01-01T17:39:52.546754+0000","last_active":"2023-01-01T17:39:56.970934+0000","last_peered":"2023-01-01T17:39:56.970934+0000","last_clean":"2023-01-01T17:39:56.970934+0000","last_became_active":"2023-01-01T17:39:52.546448+0000","last_became_peered":"2023-01-01T17:39:52.546448+0000","last_unstale":"2023-01-01T17:39:56.970934+0000","last_undegraded":"2023-01-01T17:39:56.970934+0000","last_fullsized":"2023-01-01T17:39:56.970934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:05:31.448005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.973286+0000","last_change":"2023-01-01T17:39:52.961694+0000","last_active":"2023-01-01T17:39:56.973286+0000","last_peered":"2023-01-01T17:39:56.973286+0000","last_clean":"2023-01-01T17:39:56.973286+0000","last_became_active":"2023-01-01T17:39:52.961316+0000","last_became_peered":"2023-01-01T17:39:52.961316+0000","last_unstale":"2023-01-01T17:39:56.973286+0000","last_undegraded":"2023-01-01T17:39:56.973286+0000","last_fullsized":"2023-01-01T17:39:56.973286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T05:06:34.299709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.832171+0000","last_change":"2023-01-01T17:39:56.998170+0000","last_active":"2023-01-01T17:39:58.832171+0000","last_peered":"2023-01-01T17:39:58.832171+0000","last_clean":"2023-01-01T17:39:58.832171+0000","last_became_active":"2023-01-01T17:39:56.997838+0000","last_became_peered":"2023-01-01T17:39:56.997838+0000","last_unstale":"2023-01-01T17:39:58.832171+0000","last_undegraded":"2023-01-01T17:39:58.832171+0000","last_fullsized":"2023-01-01T17:39:58.832171+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:19:24.610726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.975082+0000","last_change":"2023-01-01T17:39:52.545957+0000","last_active":"2023-01-01T17:39:56.975082+0000","last_peered":"2023-01-01T17:39:56.975082+0000","last_clean":"2023-01-01T17:39:56.975082+0000","last_became_active":"2023-01-01T17:39:52.545673+0000","last_became_peered":"2023-01-01T17:39:52.545673+0000","last_unstale":"2023-01-01T17:39:56.975082+0000","last_undegraded":"2023-01-01T17:39:56.975082+0000","last_fullsized":"2023-01-01T17:39:56.975082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:56:28.713641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971764+0000","last_change":"2023-01-01T17:39:52.959871+0000","last_active":"2023-01-01T17:39:56.971764+0000","last_peered":"2023-01-01T17:39:56.971764+0000","last_clean":"2023-01-01T17:39:56.971764+0000","last_became_active":"2023-01-01T17:39:52.959385+0000","last_became_peered":"2023-01-01T17:39:52.959385+0000","last_unstale":"2023-01-01T17:39:56.971764+0000","last_undegraded":"2023-01-01T17:39:56.971764+0000","last_fullsized":"2023-01-01T17:39:56.971764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:13:17.225019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.439450+0000","last_change":"2023-01-01T17:39:56.986617+0000","last_active":"2023-01-01T17:39:57.439450+0000","last_peered":"2023-01-01T17:39:57.439450+0000","last_clean":"2023-01-01T17:39:57.439450+0000","last_became_active":"2023-01-01T17:39:56.986236+0000","last_became_peered":"2023-01-01T17:39:56.986236+0000","last_unstale":"2023-01-01T17:39:57.439450+0000","last_undegraded":"2023-01-01T17:39:57.439450+0000","last_fullsized":"2023-01-01T17:39:57.439450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:45:28.399373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966603+0000","last_change":"2023-01-01T17:39:52.552957+0000","last_active":"2023-01-01T17:39:56.966603+0000","last_peered":"2023-01-01T17:39:56.966603+0000","last_clean":"2023-01-01T17:39:56.966603+0000","last_became_active":"2023-01-01T17:39:52.552694+0000","last_became_peered":"2023-01-01T17:39:52.552694+0000","last_unstale":"2023-01-01T17:39:56.966603+0000","last_undegraded":"2023-01-01T17:39:56.966603+0000","last_fullsized":"2023-01-01T17:39:56.966603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:05:31.448005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.978572+0000","last_change":"2023-01-01T17:39:52.959416+0000","last_active":"2023-01-01T17:39:56.978572+0000","last_peered":"2023-01-01T17:39:56.978572+0000","last_clean":"2023-01-01T17:39:56.978572+0000","last_became_active":"2023-01-01T17:39:52.959092+0000","last_became_peered":"2023-01-01T17:39:52.959092+0000","last_unstale":"2023-01-01T17:39:56.978572+0000","last_undegraded":"2023-01-01T17:39:56.978572+0000","last_fullsized":"2023-01-01T17:39:56.978572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T05:23:17.274474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.979030+0000","last_change":"2023-01-01T17:39:52.960401+0000","last_active":"2023-01-01T17:39:56.979030+0000","last_peered":"2023-01-01T17:39:56.979030+0000","last_clean":"2023-01-01T17:39:56.979030+0000","last_became_active":"2023-01-01T17:39:52.960104+0000","last_became_peered":"2023-01-01T17:39:52.960104+0000","last_unstale":"2023-01-01T17:39:56.979030+0000","last_undegraded":"2023-01-01T17:39:56.979030+0000","last_fullsized":"2023-01-01T17:39:56.979030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T22:26:50.173884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971956+0000","last_change":"2023-01-01T17:39:52.961844+0000","last_active":"2023-01-01T17:39:56.971956+0000","last_peered":"2023-01-01T17:39:56.971956+0000","last_clean":"2023-01-01T17:39:56.971956+0000","last_became_active":"2023-01-01T17:39:52.961588+0000","last_became_peered":"2023-01-01T17:39:52.961588+0000","last_unstale":"2023-01-01T17:39:56.971956+0000","last_undegraded":"2023-01-01T17:39:56.971956+0000","last_fullsized":"2023-01-01T17:39:56.971956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:38:10.525560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.974677+0000","last_change":"2023-01-01T17:39:52.965441+0000","last_active":"2023-01-01T17:39:56.974677+0000","last_peered":"2023-01-01T17:39:56.974677+0000","last_clean":"2023-01-01T17:39:56.974677+0000","last_became_active":"2023-01-01T17:39:52.965156+0000","last_became_peered":"2023-01-01T17:39:52.965156+0000","last_unstale":"2023-01-01T17:39:56.974677+0000","last_undegraded":"2023-01-01T17:39:56.974677+0000","last_fullsized":"2023-01-01T17:39:56.974677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:57:37.343251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.974315+0000","last_change":"2023-01-01T17:39:52.949007+0000","last_active":"2023-01-01T17:39:56.974315+0000","last_peered":"2023-01-01T17:39:56.974315+0000","last_clean":"2023-01-01T17:39:56.974315+0000","last_became_active":"2023-01-01T17:39:52.948731+0000","last_became_peered":"2023-01-01T17:39:52.948731+0000","last_unstale":"2023-01-01T17:39:56.974315+0000","last_undegraded":"2023-01-01T17:39:56.974315+0000","last_fullsized":"2023-01-01T17:39:56.974315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:20:30.823975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.980912+0000","last_change":"2023-01-01T17:39:52.966309+0000","last_active":"2023-01-01T17:39:56.980912+0000","last_peered":"2023-01-01T17:39:56.980912+0000","last_clean":"2023-01-01T17:39:56.980912+0000","last_became_active":"2023-01-01T17:39:52.966028+0000","last_became_peered":"2023-01-01T17:39:52.966028+0000","last_unstale":"2023-01-01T17:39:56.980912+0000","last_undegraded":"2023-01-01T17:39:56.980912+0000","last_fullsized":"2023-01-01T17:39:56.980912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:04:29.980357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64598,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9052,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362788,"statfs":{"total":96636764160,"available":96627494912,"internally_reserved":0,"allocated":348160,"data_stored":699152,"data_compressed":32299,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8384,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363456,"statfs":{"total":96636764160,"available":96628178944,"internally_reserved":0,"allocated":253952,"data_stored":104726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.258}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.1720000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8960,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362880,"statfs":{"total":96636764160,"available":96627589120,"internally_reserved":0,"allocated":319488,"data_stored":695094,"data_compressed":32299,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8452,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363388,"statfs":{"total":96636764160,"available":96628109312,"internally_reserved":0,"allocated":258048,"data_stored":105308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8384,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363456,"statfs":{"total":96636764160,"available":96628178944,"internally_reserved":0,"allocated":253952,"data_stored":104726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8452,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363388,"statfs":{"total":96636764160,"available":96628109312,"internally_reserved":0,"allocated":258048,"data_stored":104816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8532,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363308,"statfs":{"total":96636764160,"available":96628027392,"internally_reserved":0,"allocated":274432,"data_stored":108624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8456,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363384,"statfs":{"total":96636764160,"available":96628105216,"internally_reserved":0,"allocated":262144,"data_stored":105378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32299,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32299,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-01T17:40:15.372 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-01T17:40:15.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.526+0000 7ffb3d68b700 1 Processor -- start 2023-01-01T17:40:15.527 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.527+0000 7ffb3d68b700 1 -- start start 2023-01-01T17:40:15.530 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.527+0000 7ffb3d68b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ffb3806f3d0 0x7ffb380c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:15.530 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.527+0000 7ffb3d68b700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ffb3806dce0 0x7ffb38153650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:15.530 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.527+0000 7ffb3d68b700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb380c4f00 con 0x7ffb3806ebb0 2023-01-01T17:40:15.530 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.527+0000 7ffb3d68b700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb380c68c0 con 0x7ffb3806dce0 2023-01-01T17:40:15.530 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.527+0000 7ffb3d68b700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb38152f20 con 0x7ffb3806f3d0 2023-01-01T17:40:15.530 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.527+0000 7ffb36ffd700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7ffb3806ebb0 0x7ffb380a8900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40768/0 (socket says 172.21.15.61:40768) 2023-01-01T17:40:15.530 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.527+0000 7ffb377fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ffb3806dce0 0x7ffb38153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:15.530 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.527+0000 7ffb36ffd700 1 -- 172.21.15.61:0/2726339970 learned_addr learned my addr 172.21.15.61:0/2726339970 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:40:15.531 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.528+0000 7ffb367fc700 1 --2- 172.21.15.61:0/2726339970 >> v2:172.21.15.149:3300/0 conn(0x7ffb3806f3d0 0x7ffb380c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:15.531 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.528+0000 7ffb35ffb700 1 -- 172.21.15.61:0/2726339970 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3443594660 0 0) 0x7ffb380c4f00 con 0x7ffb3806ebb0 2023-01-01T17:40:15.531 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.528+0000 7ffb35ffb700 1 -- 172.21.15.61:0/2726339970 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb200035b0 con 0x7ffb3806ebb0 2023-01-01T17:40:15.531 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.528+0000 7ffb377fe700 1 -- 172.21.15.61:0/2726339970 >> v2:172.21.15.149:3300/0 conn(0x7ffb3806f3d0 msgr2=0x7ffb380c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:15.531 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.528+0000 7ffb377fe700 1 --2- 172.21.15.61:0/2726339970 >> v2:172.21.15.149:3300/0 conn(0x7ffb3806f3d0 0x7ffb380c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:15.531 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.528+0000 7ffb377fe700 1 -- 172.21.15.61:0/2726339970 >> v1:172.21.15.61:6789/0 conn(0x7ffb3806ebb0 legacy=0x7ffb380a8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:15.531 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.528+0000 7ffb377fe700 1 -- 172.21.15.61:0/2726339970 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb381531c0 con 0x7ffb3806dce0 2023-01-01T17:40:15.531 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.528+0000 7ffb377fe700 1 --2- 172.21.15.61:0/2726339970 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffb3806dce0 0x7ffb38153650 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ffb3806c9c0 tx=0x7ffb3000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=540b2b5282671a27 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:15.531 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.528+0000 7ffb35ffb700 1 -- 172.21.15.61:0/2726339970 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3000e070 con 0x7ffb3806dce0 2023-01-01T17:40:15.531 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.528+0000 7ffb35ffb700 1 -- 172.21.15.61:0/2726339970 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3000bb20 con 0x7ffb3806dce0 2023-01-01T17:40:15.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.528+0000 7ffb35ffb700 1 -- 172.21.15.61:0/2726339970 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb30012430 con 0x7ffb3806dce0 2023-01-01T17:40:15.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.529+0000 7ffb3d68b700 1 -- 172.21.15.61:0/2726339970 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffb3806dce0 msgr2=0x7ffb38153650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:15.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.529+0000 7ffb3d68b700 1 --2- 172.21.15.61:0/2726339970 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffb3806dce0 0x7ffb38153650 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ffb3806c9c0 tx=0x7ffb3000b330 comp rx=0 tx=0).stop 2023-01-01T17:40:15.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.529+0000 7ffb3d68b700 1 -- 172.21.15.61:0/2726339970 shutdown_connections 2023-01-01T17:40:15.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.529+0000 7ffb3d68b700 1 --2- 172.21.15.61:0/2726339970 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffb3806dce0 0x7ffb38153650 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:15.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.529+0000 7ffb3d68b700 1 --2- 172.21.15.61:0/2726339970 >> v2:172.21.15.149:3300/0 conn(0x7ffb3806f3d0 0x7ffb380c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:15.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.529+0000 7ffb3d68b700 1 -- 172.21.15.61:0/2726339970 >> 172.21.15.61:0/2726339970 conn(0x7ffb38069fa0 msgr2=0x7ffb380c6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:15.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.529+0000 7ffb3d68b700 1 -- 172.21.15.61:0/2726339970 shutdown_connections 2023-01-01T17:40:15.532 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.529+0000 7ffb3d68b700 1 -- 172.21.15.61:0/2726339970 wait complete. 2023-01-01T17:40:15.535 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.530+0000 7ffb3d68b700 1 Processor -- start 2023-01-01T17:40:15.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.531+0000 7ffb3d68b700 1 -- start start 2023-01-01T17:40:15.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.531+0000 7ffb3d68b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb3806dce0 0x7ffb3814b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:15.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.531+0000 7ffb3d68b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffb3806ebb0 0x7ffb38149ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:15.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.531+0000 7ffb3d68b700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffb3806f3d0 0x7ffb3814a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:15.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.531+0000 7ffb3d68b700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb380ab990 con 0x7ffb3806ebb0 2023-01-01T17:40:15.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.531+0000 7ffb3d68b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb380c4000 con 0x7ffb3806dce0 2023-01-01T17:40:15.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.531+0000 7ffb3d68b700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb380aa2c0 con 0x7ffb3806f3d0 2023-01-01T17:40:15.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.531+0000 7ffb367fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffb3806ebb0 0x7ffb38149ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:15.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.532+0000 7ffb367fc700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffb3806ebb0 0x7ffb38149ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46926/0 (socket says 172.21.15.61:46926) 2023-01-01T17:40:15.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.532+0000 7ffb367fc700 1 -- 172.21.15.61:0/717056933 learned_addr learned my addr 172.21.15.61:0/717056933 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:15.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.532+0000 7ffb377fe700 1 --2- 172.21.15.61:0/717056933 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffb3806f3d0 0x7ffb3814a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:15.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.532+0000 7ffb36ffd700 1 --2- 172.21.15.61:0/717056933 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb3806dce0 0x7ffb3814b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:15.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.532+0000 7ffb367fc700 1 -- 172.21.15.61:0/717056933 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffb3806f3d0 msgr2=0x7ffb3814a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:15.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.532+0000 7ffb367fc700 1 --2- 172.21.15.61:0/717056933 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffb3806f3d0 0x7ffb3814a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:15.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.532+0000 7ffb367fc700 1 -- 172.21.15.61:0/717056933 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb3806dce0 msgr2=0x7ffb3814b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:15.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.532+0000 7ffb367fc700 1 --2- 172.21.15.61:0/717056933 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb3806dce0 0x7ffb3814b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:15.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.532+0000 7ffb367fc700 1 -- 172.21.15.61:0/717056933 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb30009a70 con 0x7ffb3806ebb0 2023-01-01T17:40:15.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.532+0000 7ffb377fe700 1 --2- 172.21.15.61:0/717056933 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffb3806f3d0 0x7ffb3814a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-01-01T17:40:15.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.532+0000 7ffb36ffd700 1 --2- 172.21.15.61:0/717056933 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb3806dce0 0x7ffb3814b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-01-01T17:40:15.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.532+0000 7ffb367fc700 1 --2- 172.21.15.61:0/717056933 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffb3806ebb0 0x7ffb38149ef0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c00e8a0 tx=0x7ffb2c00ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:15.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.532+0000 7ffb1f7fe700 1 -- 172.21.15.61:0/717056933 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c009590 con 0x7ffb3806ebb0 2023-01-01T17:40:15.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.532+0000 7ffb1f7fe700 1 -- 172.21.15.61:0/717056933 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2c00eea0 con 0x7ffb3806ebb0 2023-01-01T17:40:15.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.532+0000 7ffb3d68b700 1 -- 172.21.15.61:0/717056933 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb3806ef80 con 0x7ffb3806ebb0 2023-01-01T17:40:15.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.532+0000 7ffb1f7fe700 1 -- 172.21.15.61:0/717056933 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c00ca50 con 0x7ffb3806ebb0 2023-01-01T17:40:15.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.532+0000 7ffb3d68b700 1 -- 172.21.15.61:0/717056933 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb380a9870 con 0x7ffb3806ebb0 2023-01-01T17:40:15.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.533+0000 7ffb3d68b700 1 -- 172.21.15.61:0/717056933 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb380c4c20 con 0x7ffb3806ebb0 2023-01-01T17:40:15.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.534+0000 7ffb1f7fe700 1 -- 172.21.15.61:0/717056933 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7ffb2c019030 con 0x7ffb3806ebb0 2023-01-01T17:40:15.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.534+0000 7ffb1f7fe700 1 --2- 172.21.15.61:0/717056933 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7ffb24063290 0x7ffb24065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:15.538 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.534+0000 7ffb1f7fe700 1 -- 172.21.15.61:0/717056933 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ffb2c07fb80 con 0x7ffb3806ebb0 2023-01-01T17:40:15.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.534+0000 7ffb36ffd700 1 --2- 172.21.15.61:0/717056933 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7ffb24063290 0x7ffb24065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:15.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.534+0000 7ffb36ffd700 1 --2- 172.21.15.61:0/717056933 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7ffb24063290 0x7ffb24065740 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ffb280011e0 tx=0x7ffb28009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:15.539 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.538+0000 7ffb1f7fe700 1 -- 172.21.15.61:0/717056933 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7ffb2c04e940 con 0x7ffb3806ebb0 2023-01-01T17:40:15.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.726+0000 7ffb3d68b700 1 -- 172.21.15.61:0/717056933 --> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffb380668a0 con 0x7ffb24063290 2023-01-01T17:40:15.737 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.736+0000 7ffb1f7fe700 1 -- 172.21.15.61:0/717056933 <== mgr.4101 v2:172.21.15.61:6832/94075 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367546 (secure 0 0 0) 0x7ffb380668a0 con 0x7ffb24063290 2023-01-01T17:40:15.741 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:40:15.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.740+0000 7ffb3d68b700 1 -- 172.21.15.61:0/717056933 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7ffb24063290 msgr2=0x7ffb24065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:15.744 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.740+0000 7ffb3d68b700 1 --2- 172.21.15.61:0/717056933 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7ffb24063290 0x7ffb24065740 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ffb280011e0 tx=0x7ffb28009040 comp rx=0 tx=0).stop 2023-01-01T17:40:15.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.740+0000 7ffb3d68b700 1 -- 172.21.15.61:0/717056933 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffb3806ebb0 msgr2=0x7ffb38149ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:15.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.740+0000 7ffb3d68b700 1 --2- 172.21.15.61:0/717056933 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffb3806ebb0 0x7ffb38149ef0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c00e8a0 tx=0x7ffb2c00ec60 comp rx=0 tx=0).stop 2023-01-01T17:40:15.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.740+0000 7ffb3d68b700 1 -- 172.21.15.61:0/717056933 shutdown_connections 2023-01-01T17:40:15.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.740+0000 7ffb3d68b700 1 --2- 172.21.15.61:0/717056933 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffb3806f3d0 0x7ffb3814a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:15.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.740+0000 7ffb3d68b700 1 --2- 172.21.15.61:0/717056933 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb3806dce0 0x7ffb3814b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:15.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.740+0000 7ffb3d68b700 1 --2- 172.21.15.61:0/717056933 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7ffb24063290 0x7ffb24065740 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:15.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.740+0000 7ffb3d68b700 1 --2- 172.21.15.61:0/717056933 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffb3806ebb0 0x7ffb38149ef0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:15.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.740+0000 7ffb3d68b700 1 -- 172.21.15.61:0/717056933 >> 172.21.15.61:0/717056933 conn(0x7ffb38069fa0 msgr2=0x7ffb380bd090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:15.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.740+0000 7ffb3d68b700 1 -- 172.21.15.61:0/717056933 shutdown_connections 2023-01-01T17:40:15.745 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.740+0000 7ffb3d68b700 1 -- 172.21.15.61:0/717056933 wait complete. 2023-01-01T17:40:15.745 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2023-01-01T17:40:15.753 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-01-01T17:40:14.227739+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":68672,"kb_used_data":2176,"kb_used_omap":0,"kb_used_meta":66432,"kb_avail":754906048,"statfs":{"total":773094113280,"available":773023793152,"internally_reserved":0,"allocated":2228224,"data_stored":2027824,"data_compressed":64598,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":68026368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002937"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966937+0000","last_change":"2023-01-01T17:39:52.963330+0000","last_active":"2023-01-01T17:39:56.966937+0000","last_peered":"2023-01-01T17:39:56.966937+0000","last_clean":"2023-01-01T17:39:56.966937+0000","last_became_active":"2023-01-01T17:39:52.962891+0000","last_became_peered":"2023-01-01T17:39:52.962891+0000","last_unstale":"2023-01-01T17:39:56.966937+0000","last_undegraded":"2023-01-01T17:39:56.966937+0000","last_fullsized":"2023-01-01T17:39:56.966937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:04:10.357667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971778+0000","last_change":"2023-01-01T17:39:52.971796+0000","last_active":"2023-01-01T17:39:56.971778+0000","last_peered":"2023-01-01T17:39:56.971778+0000","last_clean":"2023-01-01T17:39:56.971778+0000","last_became_active":"2023-01-01T17:39:52.971531+0000","last_became_peered":"2023-01-01T17:39:52.971531+0000","last_unstale":"2023-01-01T17:39:56.971778+0000","last_undegraded":"2023-01-01T17:39:56.971778+0000","last_fullsized":"2023-01-01T17:39:56.971778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:27:49.306438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.973554+0000","last_change":"2023-01-01T17:39:52.964674+0000","last_active":"2023-01-01T17:39:56.973554+0000","last_peered":"2023-01-01T17:39:56.973554+0000","last_clean":"2023-01-01T17:39:56.973554+0000","last_became_active":"2023-01-01T17:39:52.964407+0000","last_became_peered":"2023-01-01T17:39:52.964407+0000","last_unstale":"2023-01-01T17:39:56.973554+0000","last_undegraded":"2023-01-01T17:39:56.973554+0000","last_fullsized":"2023-01-01T17:39:56.973554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:04:29.930818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.980904+0000","last_change":"2023-01-01T17:39:52.961108+0000","last_active":"2023-01-01T17:39:56.980904+0000","last_peered":"2023-01-01T17:39:56.980904+0000","last_clean":"2023-01-01T17:39:56.980904+0000","last_became_active":"2023-01-01T17:39:52.960846+0000","last_became_peered":"2023-01-01T17:39:52.960846+0000","last_unstale":"2023-01-01T17:39:56.980904+0000","last_undegraded":"2023-01-01T17:39:56.980904+0000","last_fullsized":"2023-01-01T17:39:56.980904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:04:29.980357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.969138+0000","last_change":"2023-01-01T17:39:52.968144+0000","last_active":"2023-01-01T17:39:56.969138+0000","last_peered":"2023-01-01T17:39:56.969138+0000","last_clean":"2023-01-01T17:39:56.969138+0000","last_became_active":"2023-01-01T17:39:52.965674+0000","last_became_peered":"2023-01-01T17:39:52.965674+0000","last_unstale":"2023-01-01T17:39:56.969138+0000","last_undegraded":"2023-01-01T17:39:56.969138+0000","last_fullsized":"2023-01-01T17:39:56.969138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:38:10.525560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.974768+0000","last_change":"2023-01-01T17:39:52.964599+0000","last_active":"2023-01-01T17:39:56.974768+0000","last_peered":"2023-01-01T17:39:56.974768+0000","last_clean":"2023-01-01T17:39:56.974768+0000","last_became_active":"2023-01-01T17:39:52.964336+0000","last_became_peered":"2023-01-01T17:39:52.964336+0000","last_unstale":"2023-01-01T17:39:56.974768+0000","last_undegraded":"2023-01-01T17:39:56.974768+0000","last_fullsized":"2023-01-01T17:39:56.974768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:02:42.190753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966415+0000","last_change":"2023-01-01T17:39:52.960039+0000","last_active":"2023-01-01T17:39:56.966415+0000","last_peered":"2023-01-01T17:39:56.966415+0000","last_clean":"2023-01-01T17:39:56.966415+0000","last_became_active":"2023-01-01T17:39:52.959724+0000","last_became_peered":"2023-01-01T17:39:52.959724+0000","last_unstale":"2023-01-01T17:39:56.966415+0000","last_undegraded":"2023-01-01T17:39:56.966415+0000","last_fullsized":"2023-01-01T17:39:56.966415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T22:42:37.419622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.970407+0000","last_change":"2023-01-01T17:39:52.963027+0000","last_active":"2023-01-01T17:39:56.970407+0000","last_peered":"2023-01-01T17:39:56.970407+0000","last_clean":"2023-01-01T17:39:56.970407+0000","last_became_active":"2023-01-01T17:39:52.962713+0000","last_became_peered":"2023-01-01T17:39:52.962713+0000","last_unstale":"2023-01-01T17:39:56.970407+0000","last_undegraded":"2023-01-01T17:39:56.970407+0000","last_fullsized":"2023-01-01T17:39:56.970407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T22:42:37.419622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966304+0000","last_change":"2023-01-01T17:39:52.967957+0000","last_active":"2023-01-01T17:39:56.966304+0000","last_peered":"2023-01-01T17:39:56.966304+0000","last_clean":"2023-01-01T17:39:56.966304+0000","last_became_active":"2023-01-01T17:39:52.967249+0000","last_became_peered":"2023-01-01T17:39:52.967249+0000","last_unstale":"2023-01-01T17:39:56.966304+0000","last_undegraded":"2023-01-01T17:39:56.966304+0000","last_fullsized":"2023-01-01T17:39:56.966304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:39:12.933552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971966+0000","last_change":"2023-01-01T17:39:52.966701+0000","last_active":"2023-01-01T17:39:56.971966+0000","last_peered":"2023-01-01T17:39:56.971966+0000","last_clean":"2023-01-01T17:39:56.971966+0000","last_became_active":"2023-01-01T17:39:52.966423+0000","last_became_peered":"2023-01-01T17:39:52.966423+0000","last_unstale":"2023-01-01T17:39:56.971966+0000","last_undegraded":"2023-01-01T17:39:56.971966+0000","last_fullsized":"2023-01-01T17:39:56.971966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:12:40.598666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.972841+0000","last_change":"2023-01-01T17:39:52.961555+0000","last_active":"2023-01-01T17:39:56.972841+0000","last_peered":"2023-01-01T17:39:56.972841+0000","last_clean":"2023-01-01T17:39:56.972841+0000","last_became_active":"2023-01-01T17:39:52.961192+0000","last_became_peered":"2023-01-01T17:39:52.961192+0000","last_unstale":"2023-01-01T17:39:56.972841+0000","last_undegraded":"2023-01-01T17:39:56.972841+0000","last_fullsized":"2023-01-01T17:39:56.972841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:37:22.833792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966452+0000","last_change":"2023-01-01T17:39:52.959421+0000","last_active":"2023-01-01T17:39:56.966452+0000","last_peered":"2023-01-01T17:39:56.966452+0000","last_clean":"2023-01-01T17:39:56.966452+0000","last_became_active":"2023-01-01T17:39:52.959094+0000","last_became_peered":"2023-01-01T17:39:52.959094+0000","last_unstale":"2023-01-01T17:39:56.966452+0000","last_undegraded":"2023-01-01T17:39:56.966452+0000","last_fullsized":"2023-01-01T17:39:56.966452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:06:59.618607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.967485+0000","last_change":"2023-01-01T17:39:52.957064+0000","last_active":"2023-01-01T17:39:56.967485+0000","last_peered":"2023-01-01T17:39:56.967485+0000","last_clean":"2023-01-01T17:39:56.967485+0000","last_became_active":"2023-01-01T17:39:52.956770+0000","last_became_peered":"2023-01-01T17:39:52.956770+0000","last_unstale":"2023-01-01T17:39:56.967485+0000","last_undegraded":"2023-01-01T17:39:56.967485+0000","last_fullsized":"2023-01-01T17:39:56.967485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:05:32.452823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.970532+0000","last_change":"2023-01-01T17:39:52.964133+0000","last_active":"2023-01-01T17:39:56.970532+0000","last_peered":"2023-01-01T17:39:56.970532+0000","last_clean":"2023-01-01T17:39:56.970532+0000","last_became_active":"2023-01-01T17:39:52.963864+0000","last_became_peered":"2023-01-01T17:39:52.963864+0000","last_unstale":"2023-01-01T17:39:56.970532+0000","last_undegraded":"2023-01-01T17:39:56.970532+0000","last_fullsized":"2023-01-01T17:39:56.970532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:21:06.881543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966333+0000","last_change":"2023-01-01T17:39:52.960044+0000","last_active":"2023-01-01T17:39:56.966333+0000","last_peered":"2023-01-01T17:39:56.966333+0000","last_clean":"2023-01-01T17:39:56.966333+0000","last_became_active":"2023-01-01T17:39:52.959767+0000","last_became_peered":"2023-01-01T17:39:52.959767+0000","last_unstale":"2023-01-01T17:39:56.966333+0000","last_undegraded":"2023-01-01T17:39:56.966333+0000","last_fullsized":"2023-01-01T17:39:56.966333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:17:10.326486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.978656+0000","last_change":"2023-01-01T17:39:52.964688+0000","last_active":"2023-01-01T17:39:56.978656+0000","last_peered":"2023-01-01T17:39:56.978656+0000","last_clean":"2023-01-01T17:39:56.978656+0000","last_became_active":"2023-01-01T17:39:52.964376+0000","last_became_peered":"2023-01-01T17:39:52.964376+0000","last_unstale":"2023-01-01T17:39:56.978656+0000","last_undegraded":"2023-01-01T17:39:56.978656+0000","last_fullsized":"2023-01-01T17:39:56.978656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T02:02:52.710038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966403+0000","last_change":"2023-01-01T17:39:52.967459+0000","last_active":"2023-01-01T17:39:56.966403+0000","last_peered":"2023-01-01T17:39:56.966403+0000","last_clean":"2023-01-01T17:39:56.966403+0000","last_became_active":"2023-01-01T17:39:52.965683+0000","last_became_peered":"2023-01-01T17:39:52.965683+0000","last_unstale":"2023-01-01T17:39:56.966403+0000","last_undegraded":"2023-01-01T17:39:56.966403+0000","last_fullsized":"2023-01-01T17:39:56.966403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:17:10.326486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.972847+0000","last_change":"2023-01-01T17:39:52.961461+0000","last_active":"2023-01-01T17:39:56.972847+0000","last_peered":"2023-01-01T17:39:56.972847+0000","last_clean":"2023-01-01T17:39:56.972847+0000","last_became_active":"2023-01-01T17:39:52.961145+0000","last_became_peered":"2023-01-01T17:39:52.961145+0000","last_unstale":"2023-01-01T17:39:56.972847+0000","last_undegraded":"2023-01-01T17:39:56.972847+0000","last_fullsized":"2023-01-01T17:39:56.972847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:20:30.823975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.967766+0000","last_change":"2023-01-01T17:39:52.958062+0000","last_active":"2023-01-01T17:39:56.967766+0000","last_peered":"2023-01-01T17:39:56.967766+0000","last_clean":"2023-01-01T17:39:56.967766+0000","last_became_active":"2023-01-01T17:39:52.957780+0000","last_became_peered":"2023-01-01T17:39:52.957780+0000","last_unstale":"2023-01-01T17:39:56.967766+0000","last_undegraded":"2023-01-01T17:39:56.967766+0000","last_fullsized":"2023-01-01T17:39:56.967766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:47:32.933861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971406+0000","last_change":"2023-01-01T17:39:52.965920+0000","last_active":"2023-01-01T17:39:56.971406+0000","last_peered":"2023-01-01T17:39:56.971406+0000","last_clean":"2023-01-01T17:39:56.971406+0000","last_became_active":"2023-01-01T17:39:52.965681+0000","last_became_peered":"2023-01-01T17:39:52.965681+0000","last_unstale":"2023-01-01T17:39:56.971406+0000","last_undegraded":"2023-01-01T17:39:56.971406+0000","last_fullsized":"2023-01-01T17:39:56.971406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:28:47.766864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.967121+0000","last_change":"2023-01-01T17:39:52.955931+0000","last_active":"2023-01-01T17:39:56.967121+0000","last_peered":"2023-01-01T17:39:56.967121+0000","last_clean":"2023-01-01T17:39:56.967121+0000","last_became_active":"2023-01-01T17:39:52.955405+0000","last_became_peered":"2023-01-01T17:39:52.955405+0000","last_unstale":"2023-01-01T17:39:56.967121+0000","last_undegraded":"2023-01-01T17:39:56.967121+0000","last_fullsized":"2023-01-01T17:39:56.967121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:39:12.933552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966623+0000","last_change":"2023-01-01T17:39:52.972351+0000","last_active":"2023-01-01T17:39:56.966623+0000","last_peered":"2023-01-01T17:39:56.966623+0000","last_clean":"2023-01-01T17:39:56.966623+0000","last_became_active":"2023-01-01T17:39:52.972060+0000","last_became_peered":"2023-01-01T17:39:52.972060+0000","last_unstale":"2023-01-01T17:39:56.966623+0000","last_undegraded":"2023-01-01T17:39:56.966623+0000","last_fullsized":"2023-01-01T17:39:56.966623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:13:17.225019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971864+0000","last_change":"2023-01-01T17:39:52.959545+0000","last_active":"2023-01-01T17:39:56.971864+0000","last_peered":"2023-01-01T17:39:56.971864+0000","last_clean":"2023-01-01T17:39:56.971864+0000","last_became_active":"2023-01-01T17:39:52.959020+0000","last_became_peered":"2023-01-01T17:39:52.959020+0000","last_unstale":"2023-01-01T17:39:56.971864+0000","last_undegraded":"2023-01-01T17:39:56.971864+0000","last_fullsized":"2023-01-01T17:39:56.971864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:20:51.060158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966447+0000","last_change":"2023-01-01T17:39:52.959152+0000","last_active":"2023-01-01T17:39:56.966447+0000","last_peered":"2023-01-01T17:39:56.966447+0000","last_clean":"2023-01-01T17:39:56.966447+0000","last_became_active":"2023-01-01T17:39:52.958925+0000","last_became_peered":"2023-01-01T17:39:52.958925+0000","last_unstale":"2023-01-01T17:39:56.966447+0000","last_undegraded":"2023-01-01T17:39:56.966447+0000","last_fullsized":"2023-01-01T17:39:56.966447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:27:49.306438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.981469+0000","last_change":"2023-01-01T17:39:52.970401+0000","last_active":"2023-01-01T17:39:56.981469+0000","last_peered":"2023-01-01T17:39:56.981469+0000","last_clean":"2023-01-01T17:39:56.981469+0000","last_became_active":"2023-01-01T17:39:52.970123+0000","last_became_peered":"2023-01-01T17:39:52.970123+0000","last_unstale":"2023-01-01T17:39:56.981469+0000","last_undegraded":"2023-01-01T17:39:56.981469+0000","last_fullsized":"2023-01-01T17:39:56.981469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T22:42:37.419622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.981509+0000","last_change":"2023-01-01T17:39:52.966659+0000","last_active":"2023-01-01T17:39:56.981509+0000","last_peered":"2023-01-01T17:39:56.981509+0000","last_clean":"2023-01-01T17:39:56.981509+0000","last_became_active":"2023-01-01T17:39:52.966510+0000","last_became_peered":"2023-01-01T17:39:52.966510+0000","last_unstale":"2023-01-01T17:39:56.981509+0000","last_undegraded":"2023-01-01T17:39:56.981509+0000","last_fullsized":"2023-01-01T17:39:56.981509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:21:06.881543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971060+0000","last_change":"2023-01-01T17:39:52.965968+0000","last_active":"2023-01-01T17:39:56.971060+0000","last_peered":"2023-01-01T17:39:56.971060+0000","last_clean":"2023-01-01T17:39:56.971060+0000","last_became_active":"2023-01-01T17:39:52.965515+0000","last_became_peered":"2023-01-01T17:39:52.965515+0000","last_unstale":"2023-01-01T17:39:56.971060+0000","last_undegraded":"2023-01-01T17:39:56.971060+0000","last_fullsized":"2023-01-01T17:39:56.971060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:39:12.933552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.832942+0000","last_change":"2023-01-01T17:39:56.985909+0000","last_active":"2023-01-01T17:39:58.832942+0000","last_peered":"2023-01-01T17:39:58.832942+0000","last_clean":"2023-01-01T17:39:58.832942+0000","last_became_active":"2023-01-01T17:39:56.985529+0000","last_became_peered":"2023-01-01T17:39:56.985529+0000","last_unstale":"2023-01-01T17:39:58.832942+0000","last_undegraded":"2023-01-01T17:39:58.832942+0000","last_fullsized":"2023-01-01T17:39:58.832942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:52:49.314145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.973444+0000","last_change":"2023-01-01T17:39:52.544503+0000","last_active":"2023-01-01T17:39:56.973444+0000","last_peered":"2023-01-01T17:39:56.973444+0000","last_clean":"2023-01-01T17:39:56.973444+0000","last_became_active":"2023-01-01T17:39:52.544174+0000","last_became_peered":"2023-01-01T17:39:52.544174+0000","last_unstale":"2023-01-01T17:39:56.973444+0000","last_undegraded":"2023-01-01T17:39:56.973444+0000","last_fullsized":"2023-01-01T17:39:56.973444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:04:09.352850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.975913+0000","last_change":"2023-01-01T17:39:52.961218+0000","last_active":"2023-01-01T17:39:56.975913+0000","last_peered":"2023-01-01T17:39:56.975913+0000","last_clean":"2023-01-01T17:39:56.975913+0000","last_became_active":"2023-01-01T17:39:52.960909+0000","last_became_peered":"2023-01-01T17:39:52.960909+0000","last_unstale":"2023-01-01T17:39:56.975913+0000","last_undegraded":"2023-01-01T17:39:56.975913+0000","last_fullsized":"2023-01-01T17:39:56.975913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:27:49.306438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.397722+0000","last_change":"2023-01-01T17:39:56.983018+0000","last_active":"2023-01-01T17:39:57.397722+0000","last_peered":"2023-01-01T17:39:57.397722+0000","last_clean":"2023-01-01T17:39:57.397722+0000","last_became_active":"2023-01-01T17:39:56.981943+0000","last_became_peered":"2023-01-01T17:39:56.981943+0000","last_unstale":"2023-01-01T17:39:57.397722+0000","last_undegraded":"2023-01-01T17:39:57.397722+0000","last_fullsized":"2023-01-01T17:39:57.397722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:53:49.928875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.980811+0000","last_change":"2023-01-01T17:39:52.548955+0000","last_active":"2023-01-01T17:39:56.980811+0000","last_peered":"2023-01-01T17:39:56.980811+0000","last_clean":"2023-01-01T17:39:56.980811+0000","last_became_active":"2023-01-01T17:39:52.548746+0000","last_became_peered":"2023-01-01T17:39:52.548746+0000","last_unstale":"2023-01-01T17:39:56.980811+0000","last_undegraded":"2023-01-01T17:39:56.980811+0000","last_fullsized":"2023-01-01T17:39:56.980811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:48:45.787227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.968330+0000","last_change":"2023-01-01T17:39:52.967463+0000","last_active":"2023-01-01T17:39:56.968330+0000","last_peered":"2023-01-01T17:39:56.968330+0000","last_clean":"2023-01-01T17:39:56.968330+0000","last_became_active":"2023-01-01T17:39:52.965478+0000","last_became_peered":"2023-01-01T17:39:52.965478+0000","last_unstale":"2023-01-01T17:39:56.968330+0000","last_undegraded":"2023-01-01T17:39:56.968330+0000","last_fullsized":"2023-01-01T17:39:56.968330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T05:06:34.299709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.437445+0000","last_change":"2023-01-01T17:39:56.986080+0000","last_active":"2023-01-01T17:39:57.437445+0000","last_peered":"2023-01-01T17:39:57.437445+0000","last_clean":"2023-01-01T17:39:57.437445+0000","last_became_active":"2023-01-01T17:39:56.985584+0000","last_became_peered":"2023-01-01T17:39:56.985584+0000","last_unstale":"2023-01-01T17:39:57.437445+0000","last_undegraded":"2023-01-01T17:39:57.437445+0000","last_fullsized":"2023-01-01T17:39:57.437445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:14:54.324576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971939+0000","last_change":"2023-01-01T17:39:52.542192+0000","last_active":"2023-01-01T17:39:56.971939+0000","last_peered":"2023-01-01T17:39:56.971939+0000","last_clean":"2023-01-01T17:39:56.971939+0000","last_became_active":"2023-01-01T17:39:52.541722+0000","last_became_peered":"2023-01-01T17:39:52.541722+0000","last_unstale":"2023-01-01T17:39:56.971939+0000","last_undegraded":"2023-01-01T17:39:56.971939+0000","last_fullsized":"2023-01-01T17:39:56.971939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:05:31.448005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.981286+0000","last_change":"2023-01-01T17:39:52.963441+0000","last_active":"2023-01-01T17:39:56.981286+0000","last_peered":"2023-01-01T17:39:56.981286+0000","last_clean":"2023-01-01T17:39:56.981286+0000","last_became_active":"2023-01-01T17:39:52.963185+0000","last_became_peered":"2023-01-01T17:39:52.963185+0000","last_unstale":"2023-01-01T17:39:56.981286+0000","last_undegraded":"2023-01-01T17:39:56.981286+0000","last_fullsized":"2023-01-01T17:39:56.981286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:51:02.120858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.397417+0000","last_change":"2023-01-01T17:39:56.986618+0000","last_active":"2023-01-01T17:39:57.397417+0000","last_peered":"2023-01-01T17:39:57.397417+0000","last_clean":"2023-01-01T17:39:57.397417+0000","last_became_active":"2023-01-01T17:39:56.986194+0000","last_became_peered":"2023-01-01T17:39:56.986194+0000","last_unstale":"2023-01-01T17:39:57.397417+0000","last_undegraded":"2023-01-01T17:39:57.397417+0000","last_fullsized":"2023-01-01T17:39:57.397417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:20:54.495809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966504+0000","last_change":"2023-01-01T17:39:52.549532+0000","last_active":"2023-01-01T17:39:56.966504+0000","last_peered":"2023-01-01T17:39:56.966504+0000","last_clean":"2023-01-01T17:39:56.966504+0000","last_became_active":"2023-01-01T17:39:52.546547+0000","last_became_peered":"2023-01-01T17:39:52.546547+0000","last_unstale":"2023-01-01T17:39:56.966504+0000","last_undegraded":"2023-01-01T17:39:56.966504+0000","last_fullsized":"2023-01-01T17:39:56.966504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:04:09.352850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971830+0000","last_change":"2023-01-01T17:39:52.958851+0000","last_active":"2023-01-01T17:39:56.971830+0000","last_peered":"2023-01-01T17:39:56.971830+0000","last_clean":"2023-01-01T17:39:56.971830+0000","last_became_active":"2023-01-01T17:39:52.958452+0000","last_became_peered":"2023-01-01T17:39:52.958452+0000","last_unstale":"2023-01-01T17:39:56.971830+0000","last_undegraded":"2023-01-01T17:39:56.971830+0000","last_fullsized":"2023-01-01T17:39:56.971830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:53:46.493224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.895404+0000","last_change":"2023-01-01T17:39:56.984155+0000","last_active":"2023-01-01T17:39:58.895404+0000","last_peered":"2023-01-01T17:39:58.895404+0000","last_clean":"2023-01-01T17:39:58.895404+0000","last_became_active":"2023-01-01T17:39:56.983766+0000","last_became_peered":"2023-01-01T17:39:56.983766+0000","last_unstale":"2023-01-01T17:39:58.895404+0000","last_undegraded":"2023-01-01T17:39:58.895404+0000","last_fullsized":"2023-01-01T17:39:58.895404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:27:23.085160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971866+0000","last_change":"2023-01-01T17:39:52.543588+0000","last_active":"2023-01-01T17:39:56.971866+0000","last_peered":"2023-01-01T17:39:56.971866+0000","last_clean":"2023-01-01T17:39:56.971866+0000","last_became_active":"2023-01-01T17:39:52.543119+0000","last_became_peered":"2023-01-01T17:39:52.543119+0000","last_unstale":"2023-01-01T17:39:56.971866+0000","last_undegraded":"2023-01-01T17:39:56.971866+0000","last_fullsized":"2023-01-01T17:39:56.971866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:04:09.352850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971673+0000","last_change":"2023-01-01T17:39:52.949406+0000","last_active":"2023-01-01T17:39:56.971673+0000","last_peered":"2023-01-01T17:39:56.971673+0000","last_clean":"2023-01-01T17:39:56.971673+0000","last_became_active":"2023-01-01T17:39:52.949198+0000","last_became_peered":"2023-01-01T17:39:52.949198+0000","last_unstale":"2023-01-01T17:39:56.971673+0000","last_undegraded":"2023-01-01T17:39:56.971673+0000","last_fullsized":"2023-01-01T17:39:56.971673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:39:12.933552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.396744+0000","last_change":"2023-01-01T17:39:56.988325+0000","last_active":"2023-01-01T17:39:57.396744+0000","last_peered":"2023-01-01T17:39:57.396744+0000","last_clean":"2023-01-01T17:39:57.396744+0000","last_became_active":"2023-01-01T17:39:56.987892+0000","last_became_peered":"2023-01-01T17:39:56.987892+0000","last_unstale":"2023-01-01T17:39:57.396744+0000","last_undegraded":"2023-01-01T17:39:57.396744+0000","last_fullsized":"2023-01-01T17:39:57.396744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:59:18.287257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966680+0000","last_change":"2023-01-01T17:39:52.551693+0000","last_active":"2023-01-01T17:39:56.966680+0000","last_peered":"2023-01-01T17:39:56.966680+0000","last_clean":"2023-01-01T17:39:56.966680+0000","last_became_active":"2023-01-01T17:39:52.551402+0000","last_became_peered":"2023-01-01T17:39:52.551402+0000","last_unstale":"2023-01-01T17:39:56.966680+0000","last_undegraded":"2023-01-01T17:39:56.966680+0000","last_fullsized":"2023-01-01T17:39:56.966680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:56:28.713641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.981128+0000","last_change":"2023-01-01T17:39:52.972567+0000","last_active":"2023-01-01T17:39:56.981128+0000","last_peered":"2023-01-01T17:39:56.981128+0000","last_clean":"2023-01-01T17:39:56.981128+0000","last_became_active":"2023-01-01T17:39:52.971771+0000","last_became_peered":"2023-01-01T17:39:52.971771+0000","last_unstale":"2023-01-01T17:39:56.981128+0000","last_undegraded":"2023-01-01T17:39:56.981128+0000","last_fullsized":"2023-01-01T17:39:56.981128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T22:26:50.173884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.439549+0000","last_change":"2023-01-01T17:39:56.984259+0000","last_active":"2023-01-01T17:39:57.439549+0000","last_peered":"2023-01-01T17:39:57.439549+0000","last_clean":"2023-01-01T17:39:57.439549+0000","last_became_active":"2023-01-01T17:39:56.983826+0000","last_became_peered":"2023-01-01T17:39:56.983826+0000","last_unstale":"2023-01-01T17:39:57.439549+0000","last_undegraded":"2023-01-01T17:39:57.439549+0000","last_fullsized":"2023-01-01T17:39:57.439549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T05:23:20.710125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"24'9","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:40:02.106107+0000","last_change":"2023-01-01T17:39:52.542307+0000","last_active":"2023-01-01T17:40:02.106107+0000","last_peered":"2023-01-01T17:40:02.106107+0000","last_clean":"2023-01-01T17:40:02.106107+0000","last_became_active":"2023-01-01T17:39:52.542004+0000","last_became_peered":"2023-01-01T17:39:52.542004+0000","last_unstale":"2023-01-01T17:40:02.106107+0000","last_undegraded":"2023-01-01T17:40:02.106107+0000","last_fullsized":"2023-01-01T17:40:02.106107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:34:48.096366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.973005+0000","last_change":"2023-01-01T17:39:52.965551+0000","last_active":"2023-01-01T17:39:56.973005+0000","last_peered":"2023-01-01T17:39:56.973005+0000","last_clean":"2023-01-01T17:39:56.973005+0000","last_became_active":"2023-01-01T17:39:52.965295+0000","last_became_peered":"2023-01-01T17:39:52.965295+0000","last_unstale":"2023-01-01T17:39:56.973005+0000","last_undegraded":"2023-01-01T17:39:56.973005+0000","last_fullsized":"2023-01-01T17:39:56.973005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:45:24.963723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.474391+0000","last_change":"2023-01-01T17:39:56.988193+0000","last_active":"2023-01-01T17:39:58.474391+0000","last_peered":"2023-01-01T17:39:58.474391+0000","last_clean":"2023-01-01T17:39:58.474391+0000","last_became_active":"2023-01-01T17:39:56.987742+0000","last_became_peered":"2023-01-01T17:39:56.987742+0000","last_unstale":"2023-01-01T17:39:58.474391+0000","last_undegraded":"2023-01-01T17:39:58.474391+0000","last_fullsized":"2023-01-01T17:39:58.474391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:02:01.149781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.967223+0000","last_change":"2023-01-01T17:39:52.544115+0000","last_active":"2023-01-01T17:39:56.967223+0000","last_peered":"2023-01-01T17:39:56.967223+0000","last_clean":"2023-01-01T17:39:56.967223+0000","last_became_active":"2023-01-01T17:39:52.543262+0000","last_became_peered":"2023-01-01T17:39:52.543262+0000","last_unstale":"2023-01-01T17:39:56.967223+0000","last_undegraded":"2023-01-01T17:39:56.967223+0000","last_fullsized":"2023-01-01T17:39:56.967223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:04:28.975539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.976885+0000","last_change":"2023-01-01T17:39:52.961302+0000","last_active":"2023-01-01T17:39:56.976885+0000","last_peered":"2023-01-01T17:39:56.976885+0000","last_clean":"2023-01-01T17:39:56.976885+0000","last_became_active":"2023-01-01T17:39:52.960989+0000","last_became_peered":"2023-01-01T17:39:52.960989+0000","last_unstale":"2023-01-01T17:39:56.976885+0000","last_undegraded":"2023-01-01T17:39:56.976885+0000","last_fullsized":"2023-01-01T17:39:56.976885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:12:40.598666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.396961+0000","last_change":"2023-01-01T17:39:56.991710+0000","last_active":"2023-01-01T17:39:57.396961+0000","last_peered":"2023-01-01T17:39:57.396961+0000","last_clean":"2023-01-01T17:39:57.396961+0000","last_became_active":"2023-01-01T17:39:56.990850+0000","last_became_peered":"2023-01-01T17:39:56.990850+0000","last_unstale":"2023-01-01T17:39:57.396961+0000","last_undegraded":"2023-01-01T17:39:57.396961+0000","last_fullsized":"2023-01-01T17:39:57.396961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:02:01.149781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966815+0000","last_change":"2023-01-01T17:39:52.545791+0000","last_active":"2023-01-01T17:39:56.966815+0000","last_peered":"2023-01-01T17:39:56.966815+0000","last_clean":"2023-01-01T17:39:56.966815+0000","last_became_active":"2023-01-01T17:39:52.545488+0000","last_became_peered":"2023-01-01T17:39:52.545488+0000","last_unstale":"2023-01-01T17:39:56.966815+0000","last_undegraded":"2023-01-01T17:39:56.966815+0000","last_fullsized":"2023-01-01T17:39:56.966815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:56:28.713641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971022+0000","last_change":"2023-01-01T17:39:52.965778+0000","last_active":"2023-01-01T17:39:56.971022+0000","last_peered":"2023-01-01T17:39:56.971022+0000","last_clean":"2023-01-01T17:39:56.971022+0000","last_became_active":"2023-01-01T17:39:52.965147+0000","last_became_peered":"2023-01-01T17:39:52.965147+0000","last_unstale":"2023-01-01T17:39:56.971022+0000","last_undegraded":"2023-01-01T17:39:56.971022+0000","last_fullsized":"2023-01-01T17:39:56.971022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:17:10.326486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.396845+0000","last_change":"2023-01-01T17:39:56.986717+0000","last_active":"2023-01-01T17:39:57.396845+0000","last_peered":"2023-01-01T17:39:57.396845+0000","last_clean":"2023-01-01T17:39:57.396845+0000","last_became_active":"2023-01-01T17:39:56.986276+0000","last_became_peered":"2023-01-01T17:39:56.986276+0000","last_unstale":"2023-01-01T17:39:57.396845+0000","last_undegraded":"2023-01-01T17:39:57.396845+0000","last_fullsized":"2023-01-01T17:39:57.396845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:04:46.047782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966234+0000","last_change":"2023-01-01T17:39:52.544050+0000","last_active":"2023-01-01T17:39:56.966234+0000","last_peered":"2023-01-01T17:39:56.966234+0000","last_clean":"2023-01-01T17:39:56.966234+0000","last_became_active":"2023-01-01T17:39:52.543519+0000","last_became_peered":"2023-01-01T17:39:52.543519+0000","last_unstale":"2023-01-01T17:39:56.966234+0000","last_undegraded":"2023-01-01T17:39:56.966234+0000","last_fullsized":"2023-01-01T17:39:56.966234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T22:26:49.169066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.968604+0000","last_change":"2023-01-01T17:39:52.967678+0000","last_active":"2023-01-01T17:39:56.968604+0000","last_peered":"2023-01-01T17:39:56.968604+0000","last_clean":"2023-01-01T17:39:56.968604+0000","last_became_active":"2023-01-01T17:39:52.965616+0000","last_became_peered":"2023-01-01T17:39:52.965616+0000","last_unstale":"2023-01-01T17:39:56.968604+0000","last_undegraded":"2023-01-01T17:39:56.968604+0000","last_fullsized":"2023-01-01T17:39:56.968604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T22:42:37.419622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.474167+0000","last_change":"2023-01-01T17:39:56.987972+0000","last_active":"2023-01-01T17:39:58.474167+0000","last_peered":"2023-01-01T17:39:58.474167+0000","last_clean":"2023-01-01T17:39:58.474167+0000","last_became_active":"2023-01-01T17:39:56.987575+0000","last_became_peered":"2023-01-01T17:39:56.987575+0000","last_unstale":"2023-01-01T17:39:58.474167+0000","last_undegraded":"2023-01-01T17:39:58.474167+0000","last_fullsized":"2023-01-01T17:39:58.474167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T22:56:37.998610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.979048+0000","last_change":"2023-01-01T17:39:52.553331+0000","last_active":"2023-01-01T17:39:56.979048+0000","last_peered":"2023-01-01T17:39:56.979048+0000","last_clean":"2023-01-01T17:39:56.979048+0000","last_became_active":"2023-01-01T17:39:52.553030+0000","last_became_peered":"2023-01-01T17:39:52.553030+0000","last_unstale":"2023-01-01T17:39:56.979048+0000","last_undegraded":"2023-01-01T17:39:56.979048+0000","last_fullsized":"2023-01-01T17:39:56.979048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:21:53.166663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.975027+0000","last_change":"2023-01-01T17:39:52.949026+0000","last_active":"2023-01-01T17:39:56.975027+0000","last_peered":"2023-01-01T17:39:56.975027+0000","last_clean":"2023-01-01T17:39:56.975027+0000","last_became_active":"2023-01-01T17:39:52.948779+0000","last_became_peered":"2023-01-01T17:39:52.948779+0000","last_unstale":"2023-01-01T17:39:56.975027+0000","last_undegraded":"2023-01-01T17:39:56.975027+0000","last_fullsized":"2023-01-01T17:39:56.975027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T05:06:34.299709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.895796+0000","last_change":"2023-01-01T17:39:56.983900+0000","last_active":"2023-01-01T17:39:58.895796+0000","last_peered":"2023-01-01T17:39:58.895796+0000","last_clean":"2023-01-01T17:39:58.895796+0000","last_became_active":"2023-01-01T17:39:56.983523+0000","last_became_peered":"2023-01-01T17:39:56.983523+0000","last_unstale":"2023-01-01T17:39:58.895796+0000","last_undegraded":"2023-01-01T17:39:58.895796+0000","last_fullsized":"2023-01-01T17:39:58.895796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:45:28.399373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.968788+0000","last_change":"2023-01-01T17:39:52.543689+0000","last_active":"2023-01-01T17:39:56.968788+0000","last_peered":"2023-01-01T17:39:56.968788+0000","last_clean":"2023-01-01T17:39:56.968788+0000","last_became_active":"2023-01-01T17:39:52.543296+0000","last_became_peered":"2023-01-01T17:39:52.543296+0000","last_unstale":"2023-01-01T17:39:56.968788+0000","last_undegraded":"2023-01-01T17:39:56.968788+0000","last_fullsized":"2023-01-01T17:39:56.968788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T02:44:27.478991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.970314+0000","last_change":"2023-01-01T17:39:52.965596+0000","last_active":"2023-01-01T17:39:56.970314+0000","last_peered":"2023-01-01T17:39:56.970314+0000","last_clean":"2023-01-01T17:39:56.970314+0000","last_became_active":"2023-01-01T17:39:52.965299+0000","last_became_peered":"2023-01-01T17:39:52.965299+0000","last_unstale":"2023-01-01T17:39:56.970314+0000","last_undegraded":"2023-01-01T17:39:56.970314+0000","last_fullsized":"2023-01-01T17:39:56.970314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:29:27.193367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.393206+0000","last_change":"2023-01-01T17:39:56.985023+0000","last_active":"2023-01-01T17:39:57.393206+0000","last_peered":"2023-01-01T17:39:57.393206+0000","last_clean":"2023-01-01T17:39:57.393206+0000","last_became_active":"2023-01-01T17:39:56.984658+0000","last_became_peered":"2023-01-01T17:39:56.984658+0000","last_unstale":"2023-01-01T17:39:57.393206+0000","last_undegraded":"2023-01-01T17:39:57.393206+0000","last_fullsized":"2023-01-01T17:39:57.393206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:20:54.495809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.968602+0000","last_change":"2023-01-01T17:39:52.544983+0000","last_active":"2023-01-01T17:39:56.968602+0000","last_peered":"2023-01-01T17:39:56.968602+0000","last_clean":"2023-01-01T17:39:56.968602+0000","last_became_active":"2023-01-01T17:39:52.543540+0000","last_became_peered":"2023-01-01T17:39:52.543540+0000","last_unstale":"2023-01-01T17:39:56.968602+0000","last_undegraded":"2023-01-01T17:39:56.968602+0000","last_fullsized":"2023-01-01T17:39:56.968602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:51:01.116040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.975618+0000","last_change":"2023-01-01T17:39:52.961386+0000","last_active":"2023-01-01T17:39:56.975618+0000","last_peered":"2023-01-01T17:39:56.975618+0000","last_clean":"2023-01-01T17:39:56.975618+0000","last_became_active":"2023-01-01T17:39:52.961095+0000","last_became_peered":"2023-01-01T17:39:52.961095+0000","last_unstale":"2023-01-01T17:39:56.975618+0000","last_undegraded":"2023-01-01T17:39:56.975618+0000","last_fullsized":"2023-01-01T17:39:56.975618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:02:40.763669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.393555+0000","last_change":"2023-01-01T17:39:56.986859+0000","last_active":"2023-01-01T17:39:57.393555+0000","last_peered":"2023-01-01T17:39:57.393555+0000","last_clean":"2023-01-01T17:39:57.393555+0000","last_became_active":"2023-01-01T17:39:56.986501+0000","last_became_peered":"2023-01-01T17:39:56.986501+0000","last_unstale":"2023-01-01T17:39:57.393555+0000","last_undegraded":"2023-01-01T17:39:57.393555+0000","last_fullsized":"2023-01-01T17:39:57.393555+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:37:26.269443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966564+0000","last_change":"2023-01-01T17:39:52.547827+0000","last_active":"2023-01-01T17:39:56.966564+0000","last_peered":"2023-01-01T17:39:56.966564+0000","last_clean":"2023-01-01T17:39:56.966564+0000","last_became_active":"2023-01-01T17:39:52.547578+0000","last_became_peered":"2023-01-01T17:39:52.547578+0000","last_unstale":"2023-01-01T17:39:56.966564+0000","last_undegraded":"2023-01-01T17:39:56.966564+0000","last_fullsized":"2023-01-01T17:39:56.966564+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:32:00.585258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.979287+0000","last_change":"2023-01-01T17:39:52.972609+0000","last_active":"2023-01-01T17:39:56.979287+0000","last_peered":"2023-01-01T17:39:56.979287+0000","last_clean":"2023-01-01T17:39:56.979287+0000","last_became_active":"2023-01-01T17:39:52.972412+0000","last_became_peered":"2023-01-01T17:39:52.972412+0000","last_unstale":"2023-01-01T17:39:56.979287+0000","last_undegraded":"2023-01-01T17:39:56.979287+0000","last_fullsized":"2023-01-01T17:39:56.979287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T02:44:28.483809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.393419+0000","last_change":"2023-01-01T17:39:56.982521+0000","last_active":"2023-01-01T17:39:57.393419+0000","last_peered":"2023-01-01T17:39:57.393419+0000","last_clean":"2023-01-01T17:39:57.393419+0000","last_became_active":"2023-01-01T17:39:56.982193+0000","last_became_peered":"2023-01-01T17:39:56.982193+0000","last_unstale":"2023-01-01T17:39:57.393419+0000","last_undegraded":"2023-01-01T17:39:57.393419+0000","last_fullsized":"2023-01-01T17:39:57.393419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:53:49.928875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.970959+0000","last_change":"2023-01-01T17:39:52.551778+0000","last_active":"2023-01-01T17:39:56.970959+0000","last_peered":"2023-01-01T17:39:56.970959+0000","last_clean":"2023-01-01T17:39:56.970959+0000","last_became_active":"2023-01-01T17:39:52.551372+0000","last_became_peered":"2023-01-01T17:39:52.551372+0000","last_unstale":"2023-01-01T17:39:56.970959+0000","last_undegraded":"2023-01-01T17:39:56.970959+0000","last_fullsized":"2023-01-01T17:39:56.970959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:06:58.613789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.968874+0000","last_change":"2023-01-01T17:39:52.958663+0000","last_active":"2023-01-01T17:39:56.968874+0000","last_peered":"2023-01-01T17:39:56.968874+0000","last_clean":"2023-01-01T17:39:56.968874+0000","last_became_active":"2023-01-01T17:39:52.958380+0000","last_became_peered":"2023-01-01T17:39:52.958380+0000","last_unstale":"2023-01-01T17:39:56.968874+0000","last_undegraded":"2023-01-01T17:39:56.968874+0000","last_fullsized":"2023-01-01T17:39:56.968874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:12:40.598666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.393440+0000","last_change":"2023-01-01T17:39:56.984062+0000","last_active":"2023-01-01T17:39:57.393440+0000","last_peered":"2023-01-01T17:39:57.393440+0000","last_clean":"2023-01-01T17:39:57.393440+0000","last_became_active":"2023-01-01T17:39:56.983629+0000","last_became_peered":"2023-01-01T17:39:56.983629+0000","last_unstale":"2023-01-01T17:39:57.393440+0000","last_undegraded":"2023-01-01T17:39:57.393440+0000","last_fullsized":"2023-01-01T17:39:57.393440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:13:20.660670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.974416+0000","last_change":"2023-01-01T17:39:52.543859+0000","last_active":"2023-01-01T17:39:56.974416+0000","last_peered":"2023-01-01T17:39:56.974416+0000","last_clean":"2023-01-01T17:39:56.974416+0000","last_became_active":"2023-01-01T17:39:52.543608+0000","last_became_peered":"2023-01-01T17:39:52.543608+0000","last_unstale":"2023-01-01T17:39:56.974416+0000","last_undegraded":"2023-01-01T17:39:56.974416+0000","last_fullsized":"2023-01-01T17:39:56.974416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:32:00.585258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971221+0000","last_change":"2023-01-01T17:39:52.955020+0000","last_active":"2023-01-01T17:39:56.971221+0000","last_peered":"2023-01-01T17:39:56.971221+0000","last_clean":"2023-01-01T17:39:56.971221+0000","last_became_active":"2023-01-01T17:39:52.954761+0000","last_became_peered":"2023-01-01T17:39:52.954761+0000","last_unstale":"2023-01-01T17:39:56.971221+0000","last_undegraded":"2023-01-01T17:39:56.971221+0000","last_fullsized":"2023-01-01T17:39:56.971221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:38:10.525560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.439777+0000","last_change":"2023-01-01T17:39:56.987402+0000","last_active":"2023-01-01T17:39:57.439777+0000","last_peered":"2023-01-01T17:39:57.439777+0000","last_clean":"2023-01-01T17:39:57.439777+0000","last_became_active":"2023-01-01T17:39:56.986985+0000","last_became_peered":"2023-01-01T17:39:56.986985+0000","last_unstale":"2023-01-01T17:39:57.439777+0000","last_undegraded":"2023-01-01T17:39:57.439777+0000","last_fullsized":"2023-01-01T17:39:57.439777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T02:27:56.672313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.980601+0000","last_change":"2023-01-01T17:39:52.545685+0000","last_active":"2023-01-01T17:39:56.980601+0000","last_peered":"2023-01-01T17:39:56.980601+0000","last_clean":"2023-01-01T17:39:56.980601+0000","last_became_active":"2023-01-01T17:39:52.545424+0000","last_became_peered":"2023-01-01T17:39:52.545424+0000","last_unstale":"2023-01-01T17:39:56.980601+0000","last_undegraded":"2023-01-01T17:39:56.980601+0000","last_fullsized":"2023-01-01T17:39:56.980601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:48:45.787227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.972715+0000","last_change":"2023-01-01T17:39:52.961138+0000","last_active":"2023-01-01T17:39:56.972715+0000","last_peered":"2023-01-01T17:39:56.972715+0000","last_clean":"2023-01-01T17:39:56.972715+0000","last_became_active":"2023-01-01T17:39:52.960867+0000","last_became_peered":"2023-01-01T17:39:52.960867+0000","last_unstale":"2023-01-01T17:39:56.972715+0000","last_undegraded":"2023-01-01T17:39:56.972715+0000","last_fullsized":"2023-01-01T17:39:56.972715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:53:46.493224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.474381+0000","last_change":"2023-01-01T17:39:56.984187+0000","last_active":"2023-01-01T17:39:58.474381+0000","last_peered":"2023-01-01T17:39:58.474381+0000","last_clean":"2023-01-01T17:39:58.474381+0000","last_became_active":"2023-01-01T17:39:56.983771+0000","last_became_peered":"2023-01-01T17:39:56.983771+0000","last_unstale":"2023-01-01T17:39:58.474381+0000","last_undegraded":"2023-01-01T17:39:58.474381+0000","last_fullsized":"2023-01-01T17:39:58.474381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:02:45.626404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.975453+0000","last_change":"2023-01-01T17:39:52.541917+0000","last_active":"2023-01-01T17:39:56.975453+0000","last_peered":"2023-01-01T17:39:56.975453+0000","last_clean":"2023-01-01T17:39:56.975453+0000","last_became_active":"2023-01-01T17:39:52.541656+0000","last_became_peered":"2023-01-01T17:39:52.541656+0000","last_unstale":"2023-01-01T17:39:56.975453+0000","last_undegraded":"2023-01-01T17:39:56.975453+0000","last_fullsized":"2023-01-01T17:39:56.975453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:47:31.929043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.972945+0000","last_change":"2023-01-01T17:39:52.960351+0000","last_active":"2023-01-01T17:39:56.972945+0000","last_peered":"2023-01-01T17:39:56.972945+0000","last_clean":"2023-01-01T17:39:56.972945+0000","last_became_active":"2023-01-01T17:39:52.960106+0000","last_became_peered":"2023-01-01T17:39:52.960106+0000","last_unstale":"2023-01-01T17:39:56.972945+0000","last_undegraded":"2023-01-01T17:39:56.972945+0000","last_fullsized":"2023-01-01T17:39:56.972945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:10:33.122278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.832775+0000","last_change":"2023-01-01T17:39:56.986969+0000","last_active":"2023-01-01T17:39:58.832775+0000","last_peered":"2023-01-01T17:39:58.832775+0000","last_clean":"2023-01-01T17:39:58.832775+0000","last_became_active":"2023-01-01T17:39:56.986612+0000","last_became_peered":"2023-01-01T17:39:56.986612+0000","last_unstale":"2023-01-01T17:39:58.832775+0000","last_undegraded":"2023-01-01T17:39:58.832775+0000","last_fullsized":"2023-01-01T17:39:58.832775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:59:32.743399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971705+0000","last_change":"2023-01-01T17:39:52.544178+0000","last_active":"2023-01-01T17:39:56.971705+0000","last_peered":"2023-01-01T17:39:56.971705+0000","last_clean":"2023-01-01T17:39:56.971705+0000","last_became_active":"2023-01-01T17:39:52.543259+0000","last_became_peered":"2023-01-01T17:39:52.543259+0000","last_unstale":"2023-01-01T17:39:56.971705+0000","last_undegraded":"2023-01-01T17:39:56.971705+0000","last_fullsized":"2023-01-01T17:39:56.971705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:04:09.352850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.981647+0000","last_change":"2023-01-01T17:39:52.966905+0000","last_active":"2023-01-01T17:39:56.981647+0000","last_peered":"2023-01-01T17:39:56.981647+0000","last_clean":"2023-01-01T17:39:56.981647+0000","last_became_active":"2023-01-01T17:39:52.966652+0000","last_became_peered":"2023-01-01T17:39:52.966652+0000","last_unstale":"2023-01-01T17:39:56.981647+0000","last_undegraded":"2023-01-01T17:39:56.981647+0000","last_fullsized":"2023-01-01T17:39:56.981647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:33:57.337802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.832482+0000","last_change":"2023-01-01T17:39:56.992320+0000","last_active":"2023-01-01T17:39:58.832482+0000","last_peered":"2023-01-01T17:39:58.832482+0000","last_clean":"2023-01-01T17:39:58.832482+0000","last_became_active":"2023-01-01T17:39:56.991958+0000","last_became_peered":"2023-01-01T17:39:56.991958+0000","last_unstale":"2023-01-01T17:39:58.832482+0000","last_undegraded":"2023-01-01T17:39:58.832482+0000","last_fullsized":"2023-01-01T17:39:58.832482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:44:25.204625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.974879+0000","last_change":"2023-01-01T17:39:52.542402+0000","last_active":"2023-01-01T17:39:56.974879+0000","last_peered":"2023-01-01T17:39:56.974879+0000","last_clean":"2023-01-01T17:39:56.974879+0000","last_became_active":"2023-01-01T17:39:52.541828+0000","last_became_peered":"2023-01-01T17:39:52.541828+0000","last_unstale":"2023-01-01T17:39:56.974879+0000","last_undegraded":"2023-01-01T17:39:56.974879+0000","last_fullsized":"2023-01-01T17:39:56.974879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:47:31.929043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.972864+0000","last_change":"2023-01-01T17:39:47.373285+0000","last_active":"2023-01-01T17:39:56.972864+0000","last_peered":"2023-01-01T17:39:56.972864+0000","last_clean":"2023-01-01T17:39:56.972864+0000","last_became_active":"2023-01-01T17:39:47.372956+0000","last_became_peered":"2023-01-01T17:39:47.372956+0000","last_unstale":"2023-01-01T17:39:56.972864+0000","last_undegraded":"2023-01-01T17:39:56.972864+0000","last_fullsized":"2023-01-01T17:39:56.972864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_clean_scrub_stamp":"2023-01-01T17:39:46.276990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:49:32.017195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971616+0000","last_change":"2023-01-01T17:39:52.949304+0000","last_active":"2023-01-01T17:39:56.971616+0000","last_peered":"2023-01-01T17:39:56.971616+0000","last_clean":"2023-01-01T17:39:56.971616+0000","last_became_active":"2023-01-01T17:39:52.949049+0000","last_became_peered":"2023-01-01T17:39:52.949049+0000","last_unstale":"2023-01-01T17:39:56.971616+0000","last_undegraded":"2023-01-01T17:39:56.971616+0000","last_fullsized":"2023-01-01T17:39:56.971616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:38:17.390301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.396068+0000","last_change":"2023-01-01T17:39:56.986230+0000","last_active":"2023-01-01T17:39:57.396068+0000","last_peered":"2023-01-01T17:39:57.396068+0000","last_clean":"2023-01-01T17:39:57.396068+0000","last_became_active":"2023-01-01T17:39:56.985563+0000","last_became_peered":"2023-01-01T17:39:56.985563+0000","last_unstale":"2023-01-01T17:39:57.396068+0000","last_undegraded":"2023-01-01T17:39:57.396068+0000","last_fullsized":"2023-01-01T17:39:57.396068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T05:39:37.898528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.975799+0000","last_change":"2023-01-01T17:39:47.302896+0000","last_active":"2023-01-01T17:39:56.975799+0000","last_peered":"2023-01-01T17:39:56.975799+0000","last_clean":"2023-01-01T17:39:56.975799+0000","last_became_active":"2023-01-01T17:39:47.302559+0000","last_became_peered":"2023-01-01T17:39:47.302559+0000","last_unstale":"2023-01-01T17:39:56.975799+0000","last_undegraded":"2023-01-01T17:39:56.975799+0000","last_fullsized":"2023-01-01T17:39:56.975799+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_clean_scrub_stamp":"2023-01-01T17:39:46.276990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:49:32.017195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.437307+0000","last_change":"2023-01-01T17:39:52.546050+0000","last_active":"2023-01-01T17:39:57.437307+0000","last_peered":"2023-01-01T17:39:57.437307+0000","last_clean":"2023-01-01T17:39:57.437307+0000","last_became_active":"2023-01-01T17:39:52.545801+0000","last_became_peered":"2023-01-01T17:39:52.545801+0000","last_unstale":"2023-01-01T17:39:57.437307+0000","last_undegraded":"2023-01-01T17:39:57.437307+0000","last_fullsized":"2023-01-01T17:39:57.437307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:34:48.096366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.975540+0000","last_change":"2023-01-01T17:39:52.963646+0000","last_active":"2023-01-01T17:39:56.975540+0000","last_peered":"2023-01-01T17:39:56.975540+0000","last_clean":"2023-01-01T17:39:56.975540+0000","last_became_active":"2023-01-01T17:39:52.963372+0000","last_became_peered":"2023-01-01T17:39:52.963372+0000","last_unstale":"2023-01-01T17:39:56.975540+0000","last_undegraded":"2023-01-01T17:39:56.975540+0000","last_fullsized":"2023-01-01T17:39:56.975540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:20:51.060158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.474248+0000","last_change":"2023-01-01T17:39:56.985447+0000","last_active":"2023-01-01T17:39:58.474248+0000","last_peered":"2023-01-01T17:39:58.474248+0000","last_clean":"2023-01-01T17:39:58.474248+0000","last_became_active":"2023-01-01T17:39:56.985061+0000","last_became_peered":"2023-01-01T17:39:56.985061+0000","last_unstale":"2023-01-01T17:39:58.474248+0000","last_undegraded":"2023-01-01T17:39:58.474248+0000","last_fullsized":"2023-01-01T17:39:58.474248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:40:46.122449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.981389+0000","last_change":"2023-01-01T17:39:47.304031+0000","last_active":"2023-01-01T17:39:56.981389+0000","last_peered":"2023-01-01T17:39:56.981389+0000","last_clean":"2023-01-01T17:39:56.981389+0000","last_became_active":"2023-01-01T17:39:47.303722+0000","last_became_peered":"2023-01-01T17:39:47.303722+0000","last_unstale":"2023-01-01T17:39:56.981389+0000","last_undegraded":"2023-01-01T17:39:56.981389+0000","last_fullsized":"2023-01-01T17:39:56.981389+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_clean_scrub_stamp":"2023-01-01T17:39:46.276990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:35:16.549190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966543+0000","last_change":"2023-01-01T17:39:47.305762+0000","last_active":"2023-01-01T17:39:56.966543+0000","last_peered":"2023-01-01T17:39:56.966543+0000","last_clean":"2023-01-01T17:39:56.966543+0000","last_became_active":"2023-01-01T17:39:47.304987+0000","last_became_peered":"2023-01-01T17:39:47.304987+0000","last_unstale":"2023-01-01T17:39:56.966543+0000","last_undegraded":"2023-01-01T17:39:56.966543+0000","last_fullsized":"2023-01-01T17:39:56.966543+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_clean_scrub_stamp":"2023-01-01T17:39:46.276990+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:21:04.167413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966426+0000","last_change":"2023-01-01T17:39:52.545184+0000","last_active":"2023-01-01T17:39:56.966426+0000","last_peered":"2023-01-01T17:39:56.966426+0000","last_clean":"2023-01-01T17:39:56.966426+0000","last_became_active":"2023-01-01T17:39:52.544797+0000","last_became_peered":"2023-01-01T17:39:52.544797+0000","last_unstale":"2023-01-01T17:39:56.966426+0000","last_undegraded":"2023-01-01T17:39:56.966426+0000","last_fullsized":"2023-01-01T17:39:56.966426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:32:00.585258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.968517+0000","last_change":"2023-01-01T17:39:52.972606+0000","last_active":"2023-01-01T17:39:56.968517+0000","last_peered":"2023-01-01T17:39:56.968517+0000","last_clean":"2023-01-01T17:39:56.968517+0000","last_became_active":"2023-01-01T17:39:52.972366+0000","last_became_peered":"2023-01-01T17:39:52.972366+0000","last_unstale":"2023-01-01T17:39:56.968517+0000","last_undegraded":"2023-01-01T17:39:56.968517+0000","last_fullsized":"2023-01-01T17:39:56.968517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:20:30.823975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.393598+0000","last_change":"2023-01-01T17:39:56.984925+0000","last_active":"2023-01-01T17:39:57.393598+0000","last_peered":"2023-01-01T17:39:57.393598+0000","last_clean":"2023-01-01T17:39:57.393598+0000","last_became_active":"2023-01-01T17:39:56.984572+0000","last_became_peered":"2023-01-01T17:39:56.984572+0000","last_unstale":"2023-01-01T17:39:57.393598+0000","last_undegraded":"2023-01-01T17:39:57.393598+0000","last_fullsized":"2023-01-01T17:39:57.393598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T05:06:37.735359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966941+0000","last_change":"2023-01-01T17:39:47.365630+0000","last_active":"2023-01-01T17:39:56.966941+0000","last_peered":"2023-01-01T17:39:56.966941+0000","last_clean":"2023-01-01T17:39:56.966941+0000","last_became_active":"2023-01-01T17:39:47.365306+0000","last_became_peered":"2023-01-01T17:39:47.365306+0000","last_unstale":"2023-01-01T17:39:56.966941+0000","last_undegraded":"2023-01-01T17:39:56.966941+0000","last_fullsized":"2023-01-01T17:39:56.966941+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_clean_scrub_stamp":"2023-01-01T17:39:46.276990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T02:18:31.270261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.980681+0000","last_change":"2023-01-01T17:39:52.548241+0000","last_active":"2023-01-01T17:39:56.980681+0000","last_peered":"2023-01-01T17:39:56.980681+0000","last_clean":"2023-01-01T17:39:56.980681+0000","last_became_active":"2023-01-01T17:39:52.547960+0000","last_became_peered":"2023-01-01T17:39:52.547960+0000","last_unstale":"2023-01-01T17:39:56.980681+0000","last_undegraded":"2023-01-01T17:39:56.980681+0000","last_fullsized":"2023-01-01T17:39:56.980681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:21:53.166663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.981566+0000","last_change":"2023-01-01T17:39:52.970894+0000","last_active":"2023-01-01T17:39:56.981566+0000","last_peered":"2023-01-01T17:39:56.981566+0000","last_clean":"2023-01-01T17:39:56.981566+0000","last_became_active":"2023-01-01T17:39:52.970617+0000","last_became_peered":"2023-01-01T17:39:52.970617+0000","last_unstale":"2023-01-01T17:39:56.981566+0000","last_undegraded":"2023-01-01T17:39:56.981566+0000","last_fullsized":"2023-01-01T17:39:56.981566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:29:27.193367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.895750+0000","last_change":"2023-01-01T17:39:56.979186+0000","last_active":"2023-01-01T17:39:58.895750+0000","last_peered":"2023-01-01T17:39:58.895750+0000","last_clean":"2023-01-01T17:39:58.895750+0000","last_became_active":"2023-01-01T17:39:56.978779+0000","last_became_peered":"2023-01-01T17:39:56.978779+0000","last_unstale":"2023-01-01T17:39:58.895750+0000","last_undegraded":"2023-01-01T17:39:58.895750+0000","last_fullsized":"2023-01-01T17:39:58.895750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:28:51.202515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966352+0000","last_change":"2023-01-01T17:39:47.365687+0000","last_active":"2023-01-01T17:39:56.966352+0000","last_peered":"2023-01-01T17:39:56.966352+0000","last_clean":"2023-01-01T17:39:56.966352+0000","last_became_active":"2023-01-01T17:39:47.365433+0000","last_became_peered":"2023-01-01T17:39:47.365433+0000","last_unstale":"2023-01-01T17:39:56.966352+0000","last_undegraded":"2023-01-01T17:39:56.966352+0000","last_fullsized":"2023-01-01T17:39:56.966352+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_clean_scrub_stamp":"2023-01-01T17:39:46.276990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:05:23.068625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971494+0000","last_change":"2023-01-01T17:39:52.542938+0000","last_active":"2023-01-01T17:39:56.971494+0000","last_peered":"2023-01-01T17:39:56.971494+0000","last_clean":"2023-01-01T17:39:56.971494+0000","last_became_active":"2023-01-01T17:39:52.542480+0000","last_became_peered":"2023-01-01T17:39:52.542480+0000","last_unstale":"2023-01-01T17:39:56.971494+0000","last_undegraded":"2023-01-01T17:39:56.971494+0000","last_fullsized":"2023-01-01T17:39:56.971494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:34:48.096366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.980422+0000","last_change":"2023-01-01T17:39:52.957732+0000","last_active":"2023-01-01T17:39:56.980422+0000","last_peered":"2023-01-01T17:39:56.980422+0000","last_clean":"2023-01-01T17:39:56.980422+0000","last_became_active":"2023-01-01T17:39:52.957531+0000","last_became_peered":"2023-01-01T17:39:52.957531+0000","last_unstale":"2023-01-01T17:39:56.980422+0000","last_undegraded":"2023-01-01T17:39:56.980422+0000","last_fullsized":"2023-01-01T17:39:56.980422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T03:53:15.558910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.437415+0000","last_change":"2023-01-01T17:39:56.985580+0000","last_active":"2023-01-01T17:39:57.437415+0000","last_peered":"2023-01-01T17:39:57.437415+0000","last_clean":"2023-01-01T17:39:57.437415+0000","last_became_active":"2023-01-01T17:39:56.985166+0000","last_became_peered":"2023-01-01T17:39:56.985166+0000","last_unstale":"2023-01-01T17:39:57.437415+0000","last_undegraded":"2023-01-01T17:39:57.437415+0000","last_fullsized":"2023-01-01T17:39:57.437415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:27:23.085160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.970225+0000","last_change":"2023-01-01T17:39:47.367908+0000","last_active":"2023-01-01T17:39:56.970225+0000","last_peered":"2023-01-01T17:39:56.970225+0000","last_clean":"2023-01-01T17:39:56.970225+0000","last_became_active":"2023-01-01T17:39:47.367631+0000","last_became_peered":"2023-01-01T17:39:47.367631+0000","last_unstale":"2023-01-01T17:39:56.970225+0000","last_undegraded":"2023-01-01T17:39:56.970225+0000","last_fullsized":"2023-01-01T17:39:56.970225+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_clean_scrub_stamp":"2023-01-01T17:39:46.276990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:35:16.549190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.973094+0000","last_change":"2023-01-01T17:39:52.546724+0000","last_active":"2023-01-01T17:39:56.973094+0000","last_peered":"2023-01-01T17:39:56.973094+0000","last_clean":"2023-01-01T17:39:56.973094+0000","last_became_active":"2023-01-01T17:39:52.546514+0000","last_became_peered":"2023-01-01T17:39:52.546514+0000","last_unstale":"2023-01-01T17:39:56.973094+0000","last_undegraded":"2023-01-01T17:39:56.973094+0000","last_fullsized":"2023-01-01T17:39:56.973094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:05:31.448005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.980812+0000","last_change":"2023-01-01T17:39:52.965004+0000","last_active":"2023-01-01T17:39:56.980812+0000","last_peered":"2023-01-01T17:39:56.980812+0000","last_clean":"2023-01-01T17:39:56.980812+0000","last_became_active":"2023-01-01T17:39:52.964483+0000","last_became_peered":"2023-01-01T17:39:52.964483+0000","last_unstale":"2023-01-01T17:39:56.980812+0000","last_undegraded":"2023-01-01T17:39:56.980812+0000","last_fullsized":"2023-01-01T17:39:56.980812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:26:59.346786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.397683+0000","last_change":"2023-01-01T17:39:56.994936+0000","last_active":"2023-01-01T17:39:57.397683+0000","last_peered":"2023-01-01T17:39:57.397683+0000","last_clean":"2023-01-01T17:39:57.397683+0000","last_became_active":"2023-01-01T17:39:56.994480+0000","last_became_peered":"2023-01-01T17:39:56.994480+0000","last_unstale":"2023-01-01T17:39:57.397683+0000","last_undegraded":"2023-01-01T17:39:57.397683+0000","last_fullsized":"2023-01-01T17:39:57.397683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:37:26.269443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.980561+0000","last_change":"2023-01-01T17:39:47.365528+0000","last_active":"2023-01-01T17:39:56.980561+0000","last_peered":"2023-01-01T17:39:56.980561+0000","last_clean":"2023-01-01T17:39:56.980561+0000","last_became_active":"2023-01-01T17:39:47.365239+0000","last_became_peered":"2023-01-01T17:39:47.365239+0000","last_unstale":"2023-01-01T17:39:56.980561+0000","last_undegraded":"2023-01-01T17:39:56.980561+0000","last_fullsized":"2023-01-01T17:39:56.980561+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_clean_scrub_stamp":"2023-01-01T17:39:46.276990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:21:04.167413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.981073+0000","last_change":"2023-01-01T17:39:52.542456+0000","last_active":"2023-01-01T17:39:56.981073+0000","last_peered":"2023-01-01T17:39:56.981073+0000","last_clean":"2023-01-01T17:39:56.981073+0000","last_became_active":"2023-01-01T17:39:52.542154+0000","last_became_peered":"2023-01-01T17:39:52.542154+0000","last_unstale":"2023-01-01T17:39:56.981073+0000","last_undegraded":"2023-01-01T17:39:56.981073+0000","last_fullsized":"2023-01-01T17:39:56.981073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:06:58.613789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.969042+0000","last_change":"2023-01-01T17:39:52.968138+0000","last_active":"2023-01-01T17:39:56.969042+0000","last_peered":"2023-01-01T17:39:56.969042+0000","last_clean":"2023-01-01T17:39:56.969042+0000","last_became_active":"2023-01-01T17:39:52.967887+0000","last_became_peered":"2023-01-01T17:39:52.967887+0000","last_unstale":"2023-01-01T17:39:56.969042+0000","last_undegraded":"2023-01-01T17:39:56.969042+0000","last_fullsized":"2023-01-01T17:39:56.969042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:38:17.390301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.436948+0000","last_change":"2023-01-01T17:39:56.992991+0000","last_active":"2023-01-01T17:39:57.436948+0000","last_peered":"2023-01-01T17:39:57.436948+0000","last_clean":"2023-01-01T17:39:57.436948+0000","last_became_active":"2023-01-01T17:39:56.986739+0000","last_became_peered":"2023-01-01T17:39:56.986739+0000","last_unstale":"2023-01-01T17:39:57.436948+0000","last_undegraded":"2023-01-01T17:39:57.436948+0000","last_fullsized":"2023-01-01T17:39:57.436948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:45:28.399373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.981191+0000","last_change":"2023-01-01T17:39:47.305897+0000","last_active":"2023-01-01T17:39:56.981191+0000","last_peered":"2023-01-01T17:39:56.981191+0000","last_clean":"2023-01-01T17:39:56.981191+0000","last_became_active":"2023-01-01T17:39:47.305590+0000","last_became_peered":"2023-01-01T17:39:47.305590+0000","last_unstale":"2023-01-01T17:39:56.981191+0000","last_undegraded":"2023-01-01T17:39:56.981191+0000","last_fullsized":"2023-01-01T17:39:56.981191+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:46.276990+0000","last_clean_scrub_stamp":"2023-01-01T17:39:46.276990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:35:16.549190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.970834+0000","last_change":"2023-01-01T17:39:52.551958+0000","last_active":"2023-01-01T17:39:56.970834+0000","last_peered":"2023-01-01T17:39:56.970834+0000","last_clean":"2023-01-01T17:39:56.970834+0000","last_became_active":"2023-01-01T17:39:52.551432+0000","last_became_peered":"2023-01-01T17:39:52.551432+0000","last_unstale":"2023-01-01T17:39:56.970834+0000","last_undegraded":"2023-01-01T17:39:56.970834+0000","last_fullsized":"2023-01-01T17:39:56.970834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:34:48.096366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.980860+0000","last_change":"2023-01-01T17:39:52.970343+0000","last_active":"2023-01-01T17:39:56.980860+0000","last_peered":"2023-01-01T17:39:56.980860+0000","last_clean":"2023-01-01T17:39:56.980860+0000","last_became_active":"2023-01-01T17:39:52.970055+0000","last_became_peered":"2023-01-01T17:39:52.970055+0000","last_unstale":"2023-01-01T17:39:56.980860+0000","last_undegraded":"2023-01-01T17:39:56.980860+0000","last_fullsized":"2023-01-01T17:39:56.980860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:17:10.326486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.439827+0000","last_change":"2023-01-01T17:39:56.994930+0000","last_active":"2023-01-01T17:39:57.439827+0000","last_peered":"2023-01-01T17:39:57.439827+0000","last_clean":"2023-01-01T17:39:57.439827+0000","last_became_active":"2023-01-01T17:39:56.994469+0000","last_became_peered":"2023-01-01T17:39:56.994469+0000","last_unstale":"2023-01-01T17:39:57.439827+0000","last_undegraded":"2023-01-01T17:39:57.439827+0000","last_fullsized":"2023-01-01T17:39:57.439827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:27:23.085160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.969397+0000","last_change":"2023-01-01T17:39:52.553058+0000","last_active":"2023-01-01T17:39:56.969397+0000","last_peered":"2023-01-01T17:39:56.969397+0000","last_clean":"2023-01-01T17:39:56.969397+0000","last_became_active":"2023-01-01T17:39:52.552766+0000","last_became_peered":"2023-01-01T17:39:52.552766+0000","last_unstale":"2023-01-01T17:39:56.969397+0000","last_undegraded":"2023-01-01T17:39:56.969397+0000","last_fullsized":"2023-01-01T17:39:56.969397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T04:47:31.929043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.967297+0000","last_change":"2023-01-01T17:39:52.961138+0000","last_active":"2023-01-01T17:39:56.967297+0000","last_peered":"2023-01-01T17:39:56.967297+0000","last_clean":"2023-01-01T17:39:56.967297+0000","last_became_active":"2023-01-01T17:39:52.960885+0000","last_became_peered":"2023-01-01T17:39:52.960885+0000","last_unstale":"2023-01-01T17:39:56.967297+0000","last_undegraded":"2023-01-01T17:39:56.967297+0000","last_fullsized":"2023-01-01T17:39:56.967297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:34:49.101183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.895602+0000","last_change":"2023-01-01T17:39:56.985985+0000","last_active":"2023-01-01T17:39:58.895602+0000","last_peered":"2023-01-01T17:39:58.895602+0000","last_clean":"2023-01-01T17:39:58.895602+0000","last_became_active":"2023-01-01T17:39:56.985568+0000","last_became_peered":"2023-01-01T17:39:56.985568+0000","last_unstale":"2023-01-01T17:39:58.895602+0000","last_undegraded":"2023-01-01T17:39:58.895602+0000","last_fullsized":"2023-01-01T17:39:58.895602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:02:45.626404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.970839+0000","last_change":"2023-01-01T17:39:52.543976+0000","last_active":"2023-01-01T17:39:56.970839+0000","last_peered":"2023-01-01T17:39:56.970839+0000","last_clean":"2023-01-01T17:39:56.970839+0000","last_became_active":"2023-01-01T17:39:52.543744+0000","last_became_peered":"2023-01-01T17:39:52.543744+0000","last_unstale":"2023-01-01T17:39:56.970839+0000","last_undegraded":"2023-01-01T17:39:56.970839+0000","last_fullsized":"2023-01-01T17:39:56.970839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T00:32:00.585258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.972793+0000","last_change":"2023-01-01T17:39:52.957073+0000","last_active":"2023-01-01T17:39:56.972793+0000","last_peered":"2023-01-01T17:39:56.972793+0000","last_clean":"2023-01-01T17:39:56.972793+0000","last_became_active":"2023-01-01T17:39:52.956802+0000","last_became_peered":"2023-01-01T17:39:52.956802+0000","last_unstale":"2023-01-01T17:39:56.972793+0000","last_undegraded":"2023-01-01T17:39:56.972793+0000","last_fullsized":"2023-01-01T17:39:56.972793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T18:38:17.390301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.474123+0000","last_change":"2023-01-01T17:39:56.985478+0000","last_active":"2023-01-01T17:39:58.474123+0000","last_peered":"2023-01-01T17:39:58.474123+0000","last_clean":"2023-01-01T17:39:58.474123+0000","last_became_active":"2023-01-01T17:39:56.985070+0000","last_became_peered":"2023-01-01T17:39:56.985070+0000","last_unstale":"2023-01-01T17:39:58.474123+0000","last_undegraded":"2023-01-01T17:39:58.474123+0000","last_fullsized":"2023-01-01T17:39:58.474123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:50:42.814791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.970934+0000","last_change":"2023-01-01T17:39:52.546754+0000","last_active":"2023-01-01T17:39:56.970934+0000","last_peered":"2023-01-01T17:39:56.970934+0000","last_clean":"2023-01-01T17:39:56.970934+0000","last_became_active":"2023-01-01T17:39:52.546448+0000","last_became_peered":"2023-01-01T17:39:52.546448+0000","last_unstale":"2023-01-01T17:39:56.970934+0000","last_undegraded":"2023-01-01T17:39:56.970934+0000","last_fullsized":"2023-01-01T17:39:56.970934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:05:31.448005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.973286+0000","last_change":"2023-01-01T17:39:52.961694+0000","last_active":"2023-01-01T17:39:56.973286+0000","last_peered":"2023-01-01T17:39:56.973286+0000","last_clean":"2023-01-01T17:39:56.973286+0000","last_became_active":"2023-01-01T17:39:52.961316+0000","last_became_peered":"2023-01-01T17:39:52.961316+0000","last_unstale":"2023-01-01T17:39:56.973286+0000","last_undegraded":"2023-01-01T17:39:56.973286+0000","last_fullsized":"2023-01-01T17:39:56.973286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T05:06:34.299709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:58.832171+0000","last_change":"2023-01-01T17:39:56.998170+0000","last_active":"2023-01-01T17:39:58.832171+0000","last_peered":"2023-01-01T17:39:58.832171+0000","last_clean":"2023-01-01T17:39:58.832171+0000","last_became_active":"2023-01-01T17:39:56.997838+0000","last_became_peered":"2023-01-01T17:39:56.997838+0000","last_unstale":"2023-01-01T17:39:58.832171+0000","last_undegraded":"2023-01-01T17:39:58.832171+0000","last_fullsized":"2023-01-01T17:39:58.832171+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T20:19:24.610726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.975082+0000","last_change":"2023-01-01T17:39:52.545957+0000","last_active":"2023-01-01T17:39:56.975082+0000","last_peered":"2023-01-01T17:39:56.975082+0000","last_clean":"2023-01-01T17:39:56.975082+0000","last_became_active":"2023-01-01T17:39:52.545673+0000","last_became_peered":"2023-01-01T17:39:52.545673+0000","last_unstale":"2023-01-01T17:39:56.975082+0000","last_undegraded":"2023-01-01T17:39:56.975082+0000","last_fullsized":"2023-01-01T17:39:56.975082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:56:28.713641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971764+0000","last_change":"2023-01-01T17:39:52.959871+0000","last_active":"2023-01-01T17:39:56.971764+0000","last_peered":"2023-01-01T17:39:56.971764+0000","last_clean":"2023-01-01T17:39:56.971764+0000","last_became_active":"2023-01-01T17:39:52.959385+0000","last_became_peered":"2023-01-01T17:39:52.959385+0000","last_unstale":"2023-01-01T17:39:56.971764+0000","last_undegraded":"2023-01-01T17:39:56.971764+0000","last_fullsized":"2023-01-01T17:39:56.971764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:13:17.225019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-01-01T17:39:57.439450+0000","last_change":"2023-01-01T17:39:56.986617+0000","last_active":"2023-01-01T17:39:57.439450+0000","last_peered":"2023-01-01T17:39:57.439450+0000","last_clean":"2023-01-01T17:39:57.439450+0000","last_became_active":"2023-01-01T17:39:56.986236+0000","last_became_peered":"2023-01-01T17:39:56.986236+0000","last_unstale":"2023-01-01T17:39:57.439450+0000","last_undegraded":"2023-01-01T17:39:57.439450+0000","last_fullsized":"2023-01-01T17:39:57.439450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:55.957252+0000","last_clean_scrub_stamp":"2023-01-01T17:39:55.957252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:45:28.399373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.966603+0000","last_change":"2023-01-01T17:39:52.552957+0000","last_active":"2023-01-01T17:39:56.966603+0000","last_peered":"2023-01-01T17:39:56.966603+0000","last_clean":"2023-01-01T17:39:56.966603+0000","last_became_active":"2023-01-01T17:39:52.552694+0000","last_became_peered":"2023-01-01T17:39:52.552694+0000","last_unstale":"2023-01-01T17:39:56.966603+0000","last_undegraded":"2023-01-01T17:39:56.966603+0000","last_fullsized":"2023-01-01T17:39:56.966603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:51.516783+0000","last_clean_scrub_stamp":"2023-01-01T17:39:51.516783+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T21:05:31.448005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.978572+0000","last_change":"2023-01-01T17:39:52.959416+0000","last_active":"2023-01-01T17:39:56.978572+0000","last_peered":"2023-01-01T17:39:56.978572+0000","last_clean":"2023-01-01T17:39:56.978572+0000","last_became_active":"2023-01-01T17:39:52.959092+0000","last_became_peered":"2023-01-01T17:39:52.959092+0000","last_unstale":"2023-01-01T17:39:56.978572+0000","last_undegraded":"2023-01-01T17:39:56.978572+0000","last_fullsized":"2023-01-01T17:39:56.978572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T05:23:17.274474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.979030+0000","last_change":"2023-01-01T17:39:52.960401+0000","last_active":"2023-01-01T17:39:56.979030+0000","last_peered":"2023-01-01T17:39:56.979030+0000","last_clean":"2023-01-01T17:39:56.979030+0000","last_became_active":"2023-01-01T17:39:52.960104+0000","last_became_peered":"2023-01-01T17:39:52.960104+0000","last_unstale":"2023-01-01T17:39:56.979030+0000","last_undegraded":"2023-01-01T17:39:56.979030+0000","last_fullsized":"2023-01-01T17:39:56.979030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T22:26:50.173884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.971956+0000","last_change":"2023-01-01T17:39:52.961844+0000","last_active":"2023-01-01T17:39:56.971956+0000","last_peered":"2023-01-01T17:39:56.971956+0000","last_clean":"2023-01-01T17:39:56.971956+0000","last_became_active":"2023-01-01T17:39:52.961588+0000","last_became_peered":"2023-01-01T17:39:52.961588+0000","last_unstale":"2023-01-01T17:39:56.971956+0000","last_undegraded":"2023-01-01T17:39:56.971956+0000","last_fullsized":"2023-01-01T17:39:56.971956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:38:10.525560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.974677+0000","last_change":"2023-01-01T17:39:52.965441+0000","last_active":"2023-01-01T17:39:56.974677+0000","last_peered":"2023-01-01T17:39:56.974677+0000","last_clean":"2023-01-01T17:39:56.974677+0000","last_became_active":"2023-01-01T17:39:52.965156+0000","last_became_peered":"2023-01-01T17:39:52.965156+0000","last_unstale":"2023-01-01T17:39:56.974677+0000","last_undegraded":"2023-01-01T17:39:56.974677+0000","last_fullsized":"2023-01-01T17:39:56.974677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-03T01:57:37.343251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.974315+0000","last_change":"2023-01-01T17:39:52.949007+0000","last_active":"2023-01-01T17:39:56.974315+0000","last_peered":"2023-01-01T17:39:56.974315+0000","last_clean":"2023-01-01T17:39:56.974315+0000","last_became_active":"2023-01-01T17:39:52.948731+0000","last_became_peered":"2023-01-01T17:39:52.948731+0000","last_unstale":"2023-01-01T17:39:56.974315+0000","last_undegraded":"2023-01-01T17:39:56.974315+0000","last_fullsized":"2023-01-01T17:39:56.974315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T19:20:30.823975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-01-01T17:39:56.980912+0000","last_change":"2023-01-01T17:39:52.966309+0000","last_active":"2023-01-01T17:39:56.980912+0000","last_peered":"2023-01-01T17:39:56.980912+0000","last_clean":"2023-01-01T17:39:56.980912+0000","last_became_active":"2023-01-01T17:39:52.966028+0000","last_became_peered":"2023-01-01T17:39:52.966028+0000","last_unstale":"2023-01-01T17:39:56.980912+0000","last_undegraded":"2023-01-01T17:39:56.980912+0000","last_fullsized":"2023-01-01T17:39:56.980912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-01T17:39:52.521601+0000","last_clean_scrub_stamp":"2023-01-01T17:39:52.521601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-02T23:04:29.980357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64598,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9052,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":8704,"kb_avail":94362788,"statfs":{"total":96636764160,"available":96627494912,"internally_reserved":0,"allocated":348160,"data_stored":699152,"data_compressed":32299,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8912896},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8384,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363456,"statfs":{"total":96636764160,"available":96628178944,"internally_reserved":0,"allocated":253952,"data_stored":104726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.258}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.1720000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8960,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362880,"statfs":{"total":96636764160,"available":96627589120,"internally_reserved":0,"allocated":319488,"data_stored":695094,"data_compressed":32299,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8452,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363388,"statfs":{"total":96636764160,"available":96628109312,"internally_reserved":0,"allocated":258048,"data_stored":105308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8384,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363456,"statfs":{"total":96636764160,"available":96628178944,"internally_reserved":0,"allocated":253952,"data_stored":104726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8452,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363388,"statfs":{"total":96636764160,"available":96628109312,"internally_reserved":0,"allocated":258048,"data_stored":104816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8532,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363308,"statfs":{"total":96636764160,"available":96628027392,"internally_reserved":0,"allocated":274432,"data_stored":108624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8456,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363384,"statfs":{"total":96636764160,"available":96628105216,"internally_reserved":0,"allocated":262144,"data_stored":105378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32299,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32299,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-01T17:40:15.761 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-01-01T17:40:15.761 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-01-01T17:40:15.761 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-01-01T17:40:15.762 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-01-01T17:40:15.916 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.916+0000 7f2d47d84700 1 Processor -- start 2023-01-01T17:40:15.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.916+0000 7f2d47d84700 1 -- start start 2023-01-01T17:40:15.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.917+0000 7f2d47d84700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d40150a20 0x7f2d4006a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:15.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.917+0000 7f2d47d84700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2d400bb650 0x7f2d40153230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:15.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.917+0000 7f2d47d84700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d401567c0 con 0x7f2d40072d80 2023-01-01T17:40:15.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.917+0000 7f2d47d84700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d40157640 con 0x7f2d400bb650 2023-01-01T17:40:15.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.917+0000 7f2d47d84700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d400bbbc0 con 0x7f2d40150a20 2023-01-01T17:40:15.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.917+0000 7f2d45b20700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d40150a20 0x7f2d4006a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:15.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.917+0000 7f2d45b20700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d40150a20 0x7f2d4006a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.61:45172/0 (socket says 172.21.15.61:45172) 2023-01-01T17:40:15.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.917+0000 7f2d45b20700 1 -- 172.21.15.61:0/736890398 learned_addr learned my addr 172.21.15.61:0/736890398 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:15.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.917+0000 7f2d46321700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2d400bb650 0x7f2d40153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:15.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.918+0000 7f2d44b1e700 1 -- 172.21.15.61:0/736890398 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2490840677 0 0) 0x7f2d401567c0 con 0x7f2d40072d80 2023-01-01T17:40:15.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.918+0000 7f2d45b20700 1 -- 172.21.15.61:0/736890398 >> v2:172.21.15.149:3300/0 conn(0x7f2d400bb650 msgr2=0x7f2d40153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:15.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.918+0000 7f2d45b20700 1 --2- 172.21.15.61:0/736890398 >> v2:172.21.15.149:3300/0 conn(0x7f2d400bb650 0x7f2d40153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:15.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.918+0000 7f2d45b20700 1 -- 172.21.15.61:0/736890398 >> v1:172.21.15.149:6789/0 conn(0x7f2d40072d80 legacy=0x7f2d40156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:15.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.918+0000 7f2d45b20700 1 -- 172.21.15.61:0/736890398 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d400bbea0 con 0x7f2d40150a20 2023-01-01T17:40:15.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.918+0000 7f2d45b20700 1 --2- 172.21.15.61:0/736890398 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d40150a20 0x7f2d4006a590 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2d300098f0 tx=0x7f2d30009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc75e80eefd8238d server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:15.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.918+0000 7f2d44b1e700 1 -- 172.21.15.61:0/736890398 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d30011830 con 0x7f2d40150a20 2023-01-01T17:40:15.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.918+0000 7f2d44b1e700 1 -- 172.21.15.61:0/736890398 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d30011990 con 0x7f2d40150a20 2023-01-01T17:40:15.920 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.918+0000 7f2d44b1e700 1 -- 172.21.15.61:0/736890398 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d30011d20 con 0x7f2d40150a20 2023-01-01T17:40:15.923 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.919+0000 7f2d47d84700 1 -- 172.21.15.61:0/736890398 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d40150a20 msgr2=0x7f2d4006a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:15.923 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.919+0000 7f2d47d84700 1 --2- 172.21.15.61:0/736890398 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d40150a20 0x7f2d4006a590 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2d300098f0 tx=0x7f2d30009c00 comp rx=0 tx=0).stop 2023-01-01T17:40:15.923 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.919+0000 7f2d47d84700 1 -- 172.21.15.61:0/736890398 shutdown_connections 2023-01-01T17:40:15.923 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.919+0000 7f2d47d84700 1 --2- 172.21.15.61:0/736890398 >> v2:172.21.15.149:3300/0 conn(0x7f2d400bb650 0x7f2d40153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:15.923 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.919+0000 7f2d47d84700 1 --2- 172.21.15.61:0/736890398 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d40150a20 0x7f2d4006a590 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:15.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.919+0000 7f2d47d84700 1 -- 172.21.15.61:0/736890398 >> 172.21.15.61:0/736890398 conn(0x7f2d400c6090 msgr2=0x7f2d400c1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:15.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.919+0000 7f2d47d84700 1 -- 172.21.15.61:0/736890398 shutdown_connections 2023-01-01T17:40:15.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.919+0000 7f2d47d84700 1 -- 172.21.15.61:0/736890398 wait complete. 2023-01-01T17:40:15.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.920+0000 7f2d47d84700 1 Processor -- start 2023-01-01T17:40:15.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.920+0000 7f2d47d84700 1 -- start start 2023-01-01T17:40:15.924 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.920+0000 7f2d47d84700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d40072d80 0x7f2d400bf280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:15.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.920+0000 7f2d47d84700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d400bb650 0x7f2d400aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:15.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.920+0000 7f2d47d84700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d40150a20 0x7f2d4014d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:15.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.921+0000 7f2d47d84700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d401ec430 con 0x7f2d40150a20 2023-01-01T17:40:15.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.921+0000 7f2d47d84700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d401ec710 con 0x7f2d40072d80 2023-01-01T17:40:15.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.921+0000 7f2d47d84700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d400a83c0 con 0x7f2d400bb650 2023-01-01T17:40:15.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.921+0000 7f2d46321700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d40150a20 0x7f2d4014d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:15.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.921+0000 7f2d45b20700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d40072d80 0x7f2d400bf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:15.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.921+0000 7f2d46321700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d40150a20 0x7f2d4014d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46942/0 (socket says 172.21.15.61:46942) 2023-01-01T17:40:15.925 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.921+0000 7f2d46321700 1 -- 172.21.15.61:0/623503621 learned_addr learned my addr 172.21.15.61:0/623503621 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:15.926 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.921+0000 7f2d4531f700 1 --2- 172.21.15.61:0/623503621 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d400bb650 0x7f2d400aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:15.926 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.921+0000 7f2d46321700 1 -- 172.21.15.61:0/623503621 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d400bb650 msgr2=0x7f2d400aaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:15.926 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.921+0000 7f2d46321700 1 --2- 172.21.15.61:0/623503621 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d400bb650 0x7f2d400aaa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:15.926 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.921+0000 7f2d46321700 1 -- 172.21.15.61:0/623503621 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d40072d80 msgr2=0x7f2d400bf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:15.926 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.921+0000 7f2d46321700 1 --2- 172.21.15.61:0/623503621 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d40072d80 0x7f2d400bf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:15.926 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.921+0000 7f2d46321700 1 -- 172.21.15.61:0/623503621 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d30009550 con 0x7f2d40150a20 2023-01-01T17:40:15.926 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.921+0000 7f2d4531f700 1 --2- 172.21.15.61:0/623503621 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d400bb650 0x7f2d400aaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-01-01T17:40:15.926 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.921+0000 7f2d46321700 1 --2- 172.21.15.61:0/623503621 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d40150a20 0x7f2d4014d120 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2d3800efc0 tx=0x7f2d3800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:15.926 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.921+0000 7f2d367fc700 1 -- 172.21.15.61:0/623503621 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d38009ea0 con 0x7f2d40150a20 2023-01-01T17:40:15.926 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.921+0000 7f2d367fc700 1 -- 172.21.15.61:0/623503621 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3800f040 con 0x7f2d40150a20 2023-01-01T17:40:15.927 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.921+0000 7f2d47d84700 1 -- 172.21.15.61:0/623503621 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d40156a10 con 0x7f2d40150a20 2023-01-01T17:40:15.927 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.921+0000 7f2d367fc700 1 -- 172.21.15.61:0/623503621 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3800ced0 con 0x7f2d40150a20 2023-01-01T17:40:15.927 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.921+0000 7f2d47d84700 1 -- 172.21.15.61:0/623503621 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d400bc180 con 0x7f2d40150a20 2023-01-01T17:40:15.927 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.922+0000 7f2d47d84700 1 -- 172.21.15.61:0/623503621 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d400c25d0 con 0x7f2d40150a20 2023-01-01T17:40:15.927 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.923+0000 7f2d367fc700 1 -- 172.21.15.61:0/623503621 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f2d38014480 con 0x7f2d40150a20 2023-01-01T17:40:15.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.923+0000 7f2d367fc700 1 --2- 172.21.15.61:0/623503621 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f2d24063290 0x7f2d24065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:15.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.923+0000 7f2d367fc700 1 -- 172.21.15.61:0/623503621 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2d38080770 con 0x7f2d40150a20 2023-01-01T17:40:15.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.923+0000 7f2d45b20700 1 --2- 172.21.15.61:0/623503621 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f2d24063290 0x7f2d24065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:15.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.924+0000 7f2d45b20700 1 --2- 172.21.15.61:0/623503621 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f2d24063290 0x7f2d24065740 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2d30014040 tx=0x7f2d30008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:15.928 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:15.928+0000 7f2d367fc700 1 -- 172.21.15.61:0/623503621 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f2d3804f3e0 con 0x7f2d40150a20 2023-01-01T17:40:16.194 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.194+0000 7f2d47d84700 1 -- 172.21.15.61:0/623503621 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2d400bfa90 con 0x7f2d40150a20 2023-01-01T17:40:16.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.194+0000 7f2d367fc700 1 -- 172.21.15.61:0/623503621 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f2d38052a00 con 0x7f2d40150a20 2023-01-01T17:40:16.195 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:40:16.195 INFO:teuthology.orchestra.run.smithi061.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-01-01T17:40:16.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.196+0000 7f2d47d84700 1 -- 172.21.15.61:0/623503621 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f2d24063290 msgr2=0x7f2d24065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:16.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.196+0000 7f2d47d84700 1 --2- 172.21.15.61:0/623503621 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f2d24063290 0x7f2d24065740 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2d30014040 tx=0x7f2d30008030 comp rx=0 tx=0).stop 2023-01-01T17:40:16.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.196+0000 7f2d47d84700 1 -- 172.21.15.61:0/623503621 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d40150a20 msgr2=0x7f2d4014d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:16.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.196+0000 7f2d47d84700 1 --2- 172.21.15.61:0/623503621 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d40150a20 0x7f2d4014d120 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2d3800efc0 tx=0x7f2d3800c3a0 comp rx=0 tx=0).stop 2023-01-01T17:40:16.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.196+0000 7f2d47d84700 1 -- 172.21.15.61:0/623503621 shutdown_connections 2023-01-01T17:40:16.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.196+0000 7f2d47d84700 1 --2- 172.21.15.61:0/623503621 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f2d24063290 0x7f2d24065740 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:16.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.196+0000 7f2d47d84700 1 --2- 172.21.15.61:0/623503621 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f2d40150a20 0x7f2d4014d120 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:16.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.196+0000 7f2d47d84700 1 --2- 172.21.15.61:0/623503621 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2d40072d80 0x7f2d400bf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:16.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.196+0000 7f2d47d84700 1 --2- 172.21.15.61:0/623503621 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f2d400bb650 0x7f2d400aaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:16.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.196+0000 7f2d47d84700 1 -- 172.21.15.61:0/623503621 >> 172.21.15.61:0/623503621 conn(0x7f2d400c6090 msgr2=0x7f2d40156e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:16.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.196+0000 7f2d47d84700 1 -- 172.21.15.61:0/623503621 shutdown_connections 2023-01-01T17:40:16.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.196+0000 7f2d47d84700 1 -- 172.21.15.61:0/623503621 wait complete. 2023-01-01T17:40:16.209 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-01-01T17:40:16.209 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-01T17:40:16.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.333+0000 7f7306dee700 1 Processor -- start 2023-01-01T17:40:16.334 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.333+0000 7f7306dee700 1 -- start start 2023-01-01T17:40:16.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.334+0000 7f7306dee700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f730006a640 0x7f730014ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:16.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.334+0000 7f7306dee700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f73000c1ad0 0x7f73001504e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:16.336 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.334+0000 7f7306dee700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f730006dc10 con 0x7f7300157030 2023-01-01T17:40:16.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.334+0000 7f7306dee700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7300071770 con 0x7f73000c1ad0 2023-01-01T17:40:16.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.334+0000 7f7306dee700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7300156ba0 con 0x7f730006a640 2023-01-01T17:40:16.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.334+0000 7f72fffff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f73000c1ad0 0x7f73001504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:16.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.334+0000 7f72fffff700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f73000c1ad0 0x7f73001504e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46946/0 (socket says 172.21.15.61:46946) 2023-01-01T17:40:16.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.334+0000 7f72fffff700 1 -- 172.21.15.61:0/269949848 learned_addr learned my addr 172.21.15.61:0/269949848 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:16.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.335+0000 7f7304b8a700 1 --2- 172.21.15.61:0/269949848 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f730006a640 0x7f730014ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:16.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.335+0000 7f72fffff700 1 -- 172.21.15.61:0/269949848 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f730006a640 msgr2=0x7f730014ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:16.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.335+0000 7f72fffff700 1 --2- 172.21.15.61:0/269949848 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f730006a640 0x7f730014ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:16.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.335+0000 7f72fffff700 1 -- 172.21.15.61:0/269949848 >> v1:172.21.15.149:6789/0 conn(0x7f7300157030 legacy=0x7f7300152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:16.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.335+0000 7f72fffff700 1 -- 172.21.15.61:0/269949848 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f730006f7a0 con 0x7f73000c1ad0 2023-01-01T17:40:16.337 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.335+0000 7f72fffff700 1 --2- 172.21.15.61:0/269949848 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f73000c1ad0 0x7f73001504e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f72ec0098f0 tx=0x7f72ec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17fa27ab709c9452 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:16.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.335+0000 7f72ff7fe700 1 -- 172.21.15.61:0/269949848 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec00b8a0 con 0x7f73000c1ad0 2023-01-01T17:40:16.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.335+0000 7f72ff7fe700 1 -- 172.21.15.61:0/269949848 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ec00ba00 con 0x7f73000c1ad0 2023-01-01T17:40:16.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.335+0000 7f72ff7fe700 1 -- 172.21.15.61:0/269949848 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec00bd90 con 0x7f73000c1ad0 2023-01-01T17:40:16.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.336+0000 7f7306dee700 1 -- 172.21.15.61:0/269949848 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f73000c1ad0 msgr2=0x7f73001504e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:16.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.336+0000 7f7306dee700 1 --2- 172.21.15.61:0/269949848 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f73000c1ad0 0x7f73001504e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f72ec0098f0 tx=0x7f72ec009c00 comp rx=0 tx=0).stop 2023-01-01T17:40:16.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.336+0000 7f7306dee700 1 -- 172.21.15.61:0/269949848 shutdown_connections 2023-01-01T17:40:16.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.336+0000 7f7306dee700 1 --2- 172.21.15.61:0/269949848 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f730006a640 0x7f730014ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:16.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.336+0000 7f7306dee700 1 --2- 172.21.15.61:0/269949848 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f73000c1ad0 0x7f73001504e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:16.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.336+0000 7f7306dee700 1 -- 172.21.15.61:0/269949848 >> 172.21.15.61:0/269949848 conn(0x7f73000c1f30 msgr2=0x7f73000c2330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:16.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.336+0000 7f7306dee700 1 -- 172.21.15.61:0/269949848 shutdown_connections 2023-01-01T17:40:16.338 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.336+0000 7f7306dee700 1 -- 172.21.15.61:0/269949848 wait complete. 2023-01-01T17:40:16.341 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.337+0000 7f7306dee700 1 Processor -- start 2023-01-01T17:40:16.341 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.337+0000 7f7306dee700 1 -- start start 2023-01-01T17:40:16.341 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.338+0000 7f7306dee700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f730006a640 0x7f73001ec000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:16.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.338+0000 7f7306dee700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f73000c1ad0 0x7f730006c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:16.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.338+0000 7f7306dee700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7300157030 0x7f73001e91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:16.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.338+0000 7f7306dee700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73001ecf80 con 0x7f7300157030 2023-01-01T17:40:16.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.338+0000 7f7306dee700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73001523d0 con 0x7f730006a640 2023-01-01T17:40:16.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.338+0000 7f7306dee700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73000a9470 con 0x7f73000c1ad0 2023-01-01T17:40:16.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.338+0000 7f730538b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7300157030 0x7f73001e91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:16.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.338+0000 7f730538b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7300157030 0x7f73001e91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46956/0 (socket says 172.21.15.61:46956) 2023-01-01T17:40:16.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.338+0000 7f730538b700 1 -- 172.21.15.61:0/2831429330 learned_addr learned my addr 172.21.15.61:0/2831429330 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:16.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.338+0000 7f7304b8a700 1 --2- 172.21.15.61:0/2831429330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f730006a640 0x7f73001ec000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:16.342 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.338+0000 7f72fffff700 1 --2- 172.21.15.61:0/2831429330 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f73000c1ad0 0x7f730006c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:16.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.338+0000 7f730538b700 1 -- 172.21.15.61:0/2831429330 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f73000c1ad0 msgr2=0x7f730006c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:16.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.338+0000 7f730538b700 1 --2- 172.21.15.61:0/2831429330 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f73000c1ad0 0x7f730006c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:16.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.338+0000 7f730538b700 1 -- 172.21.15.61:0/2831429330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f730006a640 msgr2=0x7f73001ec000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:16.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.338+0000 7f730538b700 1 --2- 172.21.15.61:0/2831429330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f730006a640 0x7f73001ec000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:16.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.338+0000 7f730538b700 1 -- 172.21.15.61:0/2831429330 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ec009550 con 0x7f7300157030 2023-01-01T17:40:16.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.338+0000 7f730538b700 1 --2- 172.21.15.61:0/2831429330 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7300157030 0x7f73001e91c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f72f800cbc0 tx=0x7f72f800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:16.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.338+0000 7f72fd7fa700 1 -- 172.21.15.61:0/2831429330 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8003c00 con 0x7f7300157030 2023-01-01T17:40:16.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.339+0000 7f72fd7fa700 1 -- 172.21.15.61:0/2831429330 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f8003d60 con 0x7f7300157030 2023-01-01T17:40:16.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.339+0000 7f7306dee700 1 -- 172.21.15.61:0/2831429330 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f730006f4c0 con 0x7f7300157030 2023-01-01T17:40:16.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.339+0000 7f72fd7fa700 1 -- 172.21.15.61:0/2831429330 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f800aa20 con 0x7f7300157030 2023-01-01T17:40:16.343 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.339+0000 7f7306dee700 1 -- 172.21.15.61:0/2831429330 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f730006f1e0 con 0x7f7300157030 2023-01-01T17:40:16.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.339+0000 7f7306dee700 1 -- 172.21.15.61:0/2831429330 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7300156550 con 0x7f7300157030 2023-01-01T17:40:16.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.340+0000 7f72fd7fa700 1 -- 172.21.15.61:0/2831429330 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f72f8010050 con 0x7f7300157030 2023-01-01T17:40:16.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.340+0000 7f72fd7fa700 1 --2- 172.21.15.61:0/2831429330 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f72e4063290 0x7f72e4065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:16.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.340+0000 7f72fd7fa700 1 -- 172.21.15.61:0/2831429330 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f72f807fb00 con 0x7f7300157030 2023-01-01T17:40:16.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.340+0000 7f7304b8a700 1 --2- 172.21.15.61:0/2831429330 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f72e4063290 0x7f72e4065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:16.344 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.341+0000 7f7304b8a700 1 --2- 172.21.15.61:0/2831429330 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f72e4063290 0x7f72e4065740 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f72f40099b0 tx=0x7f72f4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:16.345 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.345+0000 7f72fd7fa700 1 -- 172.21.15.61:0/2831429330 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f72f804e8c0 con 0x7f7300157030 2023-01-01T17:40:16.536 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.536+0000 7f7306dee700 1 -- 172.21.15.61:0/2831429330 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73000668a0 con 0x7f7300157030 2023-01-01T17:40:16.537 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.537+0000 7f72fd7fa700 1 -- 172.21.15.61:0/2831429330 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18729 (secure 0 0 0) 0x7f72f8051ee0 con 0x7f7300157030 2023-01-01T17:40:16.538 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:40:16.538 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":24,"fsid":"fe0d3d8e-46ee-4ed9-92f8-749741721d01","created":"2023-01-01T17:39:34.752404+0000","modified":"2023-01-01T17:39:57.386830+0000","last_up_change":"2023-01-01T17:39:45.159720+0000","last_in_change":"2023-01-01T17:39:37.293057+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-01-01T17:39:46.110776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-01-01T17:39:46.276625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-01-01T17:39:50.568073+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-01-01T17:39:51.915351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-01-01T17:39:54.992107+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"5ba13bcd-4407-4cfd-8487-80917501e525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":94349},{"type":"v1","addr":"172.21.15.61:6825","nonce":94349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":94349},{"type":"v1","addr":"172.21.15.61:6827","nonce":94349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":94349},{"type":"v1","addr":"172.21.15.61:6831","nonce":94349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":94349},{"type":"v1","addr":"172.21.15.61:6829","nonce":94349}]},"public_addr":"172.21.15.61:6825/94349","cluster_addr":"172.21.15.61:6827/94349","heartbeat_back_addr":"172.21.15.61:6831/94349","heartbeat_front_addr":"172.21.15.61:6829/94349","state":["exists","up"]},{"osd":1,"uuid":"7dca9f34-ea22-4894-b238-5606b16b9c74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6811","nonce":94348},{"type":"v1","addr":"172.21.15.61:6813","nonce":94348}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":94348},{"type":"v1","addr":"172.21.15.61:6816","nonce":94348}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6821","nonce":94348},{"type":"v1","addr":"172.21.15.61:6823","nonce":94348}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":94348},{"type":"v1","addr":"172.21.15.61:6819","nonce":94348}]},"public_addr":"172.21.15.61:6813/94348","cluster_addr":"172.21.15.61:6816/94348","heartbeat_back_addr":"172.21.15.61:6823/94348","heartbeat_front_addr":"172.21.15.61:6819/94348","state":["exists","up"]},{"osd":2,"uuid":"7b43ea06-a7b6-49f4-a390-18ad14dfe4fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":94350},{"type":"v1","addr":"172.21.15.61:6809","nonce":94350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":94350},{"type":"v1","addr":"172.21.15.61:6812","nonce":94350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":94350},{"type":"v1","addr":"172.21.15.61:6822","nonce":94350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6815","nonce":94350},{"type":"v1","addr":"172.21.15.61:6817","nonce":94350}]},"public_addr":"172.21.15.61:6809/94350","cluster_addr":"172.21.15.61:6812/94350","heartbeat_back_addr":"172.21.15.61:6822/94350","heartbeat_front_addr":"172.21.15.61:6817/94350","state":["exists","up"]},{"osd":3,"uuid":"117c41d8-d40c-4cc0-b0e1-70bca058fa72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":94347},{"type":"v1","addr":"172.21.15.61:6801","nonce":94347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":94347},{"type":"v1","addr":"172.21.15.61:6803","nonce":94347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":94347},{"type":"v1","addr":"172.21.15.61:6807","nonce":94347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":94347},{"type":"v1","addr":"172.21.15.61:6805","nonce":94347}]},"public_addr":"172.21.15.61:6801/94347","cluster_addr":"172.21.15.61:6803/94347","heartbeat_back_addr":"172.21.15.61:6807/94347","heartbeat_front_addr":"172.21.15.61:6805/94347","state":["exists","up"]},{"osd":4,"uuid":"4073e0e8-c5dd-463f-aa1c-c9515ef09976","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":94711},{"type":"v1","addr":"172.21.15.149:6818","nonce":94711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":94711},{"type":"v1","addr":"172.21.15.149:6822","nonce":94711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":94711},{"type":"v1","addr":"172.21.15.149:6830","nonce":94711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":94711},{"type":"v1","addr":"172.21.15.149:6826","nonce":94711}]},"public_addr":"172.21.15.149:6818/94711","cluster_addr":"172.21.15.149:6822/94711","heartbeat_back_addr":"172.21.15.149:6830/94711","heartbeat_front_addr":"172.21.15.149:6826/94711","state":["exists","up"]},{"osd":5,"uuid":"88aa0c0f-e3c1-4dd3-af8c-61f4bc28504e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":94709},{"type":"v1","addr":"172.21.15.149:6809","nonce":94709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":94709},{"type":"v1","addr":"172.21.15.149:6811","nonce":94709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":94709},{"type":"v1","addr":"172.21.15.149:6815","nonce":94709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":94709},{"type":"v1","addr":"172.21.15.149:6813","nonce":94709}]},"public_addr":"172.21.15.149:6809/94709","cluster_addr":"172.21.15.149:6811/94709","heartbeat_back_addr":"172.21.15.149:6815/94709","heartbeat_front_addr":"172.21.15.149:6813/94709","state":["exists","up"]},{"osd":6,"uuid":"8b13fc0c-5f00-41c7-8923-c4570da77afd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":94710},{"type":"v1","addr":"172.21.15.149:6801","nonce":94710}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":94710},{"type":"v1","addr":"172.21.15.149:6803","nonce":94710}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":94710},{"type":"v1","addr":"172.21.15.149:6807","nonce":94710}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":94710},{"type":"v1","addr":"172.21.15.149:6805","nonce":94710}]},"public_addr":"172.21.15.149:6801/94710","cluster_addr":"172.21.15.149:6803/94710","heartbeat_back_addr":"172.21.15.149:6807/94710","heartbeat_front_addr":"172.21.15.149:6805/94710","state":["exists","up"]},{"osd":7,"uuid":"5390c6e5-39e7-4aa6-b73c-642458b2acf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6817","nonce":94734},{"type":"v1","addr":"172.21.15.149:6819","nonce":94734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6821","nonce":94734},{"type":"v1","addr":"172.21.15.149:6823","nonce":94734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6829","nonce":94734},{"type":"v1","addr":"172.21.15.149:6831","nonce":94734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6825","nonce":94734},{"type":"v1","addr":"172.21.15.149:6827","nonce":94734}]},"public_addr":"172.21.15.149:6819/94734","cluster_addr":"172.21.15.149:6823/94734","heartbeat_back_addr":"172.21.15.149:6831/94734","heartbeat_front_addr":"172.21.15.149:6827/94734","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.555826+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.508739+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.515601+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.472067+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.535257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.493397+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.554910+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-01T17:39:42.552343+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-01T17:40:16.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.539+0000 7f7306dee700 1 -- 172.21.15.61:0/2831429330 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f72e4063290 msgr2=0x7f72e4065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:16.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.539+0000 7f7306dee700 1 --2- 172.21.15.61:0/2831429330 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f72e4063290 0x7f72e4065740 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f72f40099b0 tx=0x7f72f4008040 comp rx=0 tx=0).stop 2023-01-01T17:40:16.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.539+0000 7f7306dee700 1 -- 172.21.15.61:0/2831429330 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7300157030 msgr2=0x7f73001e91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:16.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.539+0000 7f7306dee700 1 --2- 172.21.15.61:0/2831429330 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7300157030 0x7f73001e91c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f72f800cbc0 tx=0x7f72f800ced0 comp rx=0 tx=0).stop 2023-01-01T17:40:16.540 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.539+0000 7f7306dee700 1 -- 172.21.15.61:0/2831429330 shutdown_connections 2023-01-01T17:40:16.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.539+0000 7f7306dee700 1 --2- 172.21.15.61:0/2831429330 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f72e4063290 0x7f72e4065740 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:16.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.539+0000 7f7306dee700 1 --2- 172.21.15.61:0/2831429330 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f7300157030 0x7f73001e91c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:16.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.539+0000 7f7306dee700 1 --2- 172.21.15.61:0/2831429330 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f730006a640 0x7f73001ec000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:16.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.539+0000 7f7306dee700 1 --2- 172.21.15.61:0/2831429330 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f73000c1ad0 0x7f730006c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:16.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.539+0000 7f7306dee700 1 -- 172.21.15.61:0/2831429330 >> 172.21.15.61:0/2831429330 conn(0x7f73000c1f30 msgr2=0x7f73000c0660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:16.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.539+0000 7f7306dee700 1 -- 172.21.15.61:0/2831429330 shutdown_connections 2023-01-01T17:40:16.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.539+0000 7f7306dee700 1 -- 172.21.15.61:0/2831429330 wait complete. 2023-01-01T17:40:16.554 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-01-01T17:39:46.110776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-01-01T17:39:46.276625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-01-01T17:39:50.568073+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-01-01T17:39:51.915351+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-01-01T17:39:54.992107+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-01-01T17:40:16.556 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-01-01T17:40:16.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.685+0000 7f05c3a21700 1 Processor -- start 2023-01-01T17:40:16.685 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.685+0000 7f05c3a21700 1 -- start start 2023-01-01T17:40:16.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.686+0000 7f05c3a21700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05bc14cf50 0x7f05bc0c0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:16.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.686+0000 7f05c3a21700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f05bc0c0760 0x7f05bc069360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:16.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.686+0000 7f05c3a21700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05bc06aaa0 con 0x7f05bc06cff0 2023-01-01T17:40:16.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.686+0000 7f05c3a21700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05bc069e90 con 0x7f05bc0c0760 2023-01-01T17:40:16.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.686+0000 7f05c3a21700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc06a170 con 0x7f05bc14cf50 2023-01-01T17:40:16.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.686+0000 7f05c17bd700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05bc14cf50 0x7f05bc0c0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:16.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.686+0000 7f05c0fbc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f05bc0c0760 0x7f05bc069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:16.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.686+0000 7f05c1fbe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f05bc06cff0 0x7f05bc152ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.61:49288/0 (socket says 172.21.15.61:49288) 2023-01-01T17:40:16.689 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.686+0000 7f05c1fbe700 1 -- 172.21.15.61:0/1935140491 learned_addr learned my addr 172.21.15.61:0/1935140491 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:40:16.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.686+0000 7f05c17bd700 1 -- 172.21.15.61:0/1935140491 >> v2:172.21.15.149:3300/0 conn(0x7f05bc0c0760 msgr2=0x7f05bc069360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:16.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.686+0000 7f05c17bd700 1 --2- 172.21.15.61:0/1935140491 >> v2:172.21.15.149:3300/0 conn(0x7f05bc0c0760 0x7f05bc069360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:16.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.686+0000 7f05c17bd700 1 -- 172.21.15.61:0/1935140491 >> v1:172.21.15.149:6789/0 conn(0x7f05bc06cff0 legacy=0x7f05bc152ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:16.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.686+0000 7f05c17bd700 1 -- 172.21.15.61:0/1935140491 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05bc06a450 con 0x7f05bc14cf50 2023-01-01T17:40:16.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.686+0000 7f05c0fbc700 1 --2- 172.21.15.61:0/1935140491 >> v2:172.21.15.149:3300/0 conn(0x7f05bc0c0760 0x7f05bc069360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-01-01T17:40:16.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.687+0000 7f05c17bd700 1 --2- 172.21.15.61:0/1935140491 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05bc14cf50 0x7f05bc0c0220 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f05ac009840 tx=0x7f05ac009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2be65e0112b25f9e server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:16.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.687+0000 7f05b3fff700 1 -- 172.21.15.61:0/1935140491 <== mon.2 v2:172.21.15.149:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac011830 con 0x7f05bc14cf50 2023-01-01T17:40:16.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.687+0000 7f05b3fff700 1 -- 172.21.15.61:0/1935140491 <== mon.2 v2:172.21.15.149:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ac011990 con 0x7f05bc14cf50 2023-01-01T17:40:16.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.687+0000 7f05b3fff700 1 -- 172.21.15.61:0/1935140491 <== mon.2 v2:172.21.15.149:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac011d20 con 0x7f05bc14cf50 2023-01-01T17:40:16.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.687+0000 7f05c3a21700 1 -- 172.21.15.61:0/1935140491 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05bc14cf50 msgr2=0x7f05bc0c0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:16.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.687+0000 7f05c3a21700 1 --2- 172.21.15.61:0/1935140491 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05bc14cf50 0x7f05bc0c0220 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f05ac009840 tx=0x7f05ac009b50 comp rx=0 tx=0).stop 2023-01-01T17:40:16.690 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.687+0000 7f05c3a21700 1 -- 172.21.15.61:0/1935140491 shutdown_connections 2023-01-01T17:40:16.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.687+0000 7f05c3a21700 1 --2- 172.21.15.61:0/1935140491 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05bc14cf50 0x7f05bc0c0220 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:16.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.687+0000 7f05c3a21700 1 --2- 172.21.15.61:0/1935140491 >> v2:172.21.15.149:3300/0 conn(0x7f05bc0c0760 0x7f05bc069360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:16.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.687+0000 7f05c3a21700 1 -- 172.21.15.61:0/1935140491 >> 172.21.15.61:0/1935140491 conn(0x7f05bc0c1e80 msgr2=0x7f05bc0c2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:16.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.687+0000 7f05c3a21700 1 -- 172.21.15.61:0/1935140491 shutdown_connections 2023-01-01T17:40:16.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.687+0000 7f05c3a21700 1 -- 172.21.15.61:0/1935140491 wait complete. 2023-01-01T17:40:16.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.688+0000 7f05c3a21700 1 Processor -- start 2023-01-01T17:40:16.691 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.689+0000 7f05c3a21700 1 -- start start 2023-01-01T17:40:16.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.689+0000 7f05c3a21700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05bc06cff0 0x7f05bc06f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:16.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.689+0000 7f05c3a21700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05bc14cf50 0x7f05bc156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:16.693 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.689+0000 7f05c3a21700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f05bc154140 0x7f05bc1ebe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:16.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.689+0000 7f05c3a21700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc156800 con 0x7f05bc154140 2023-01-01T17:40:16.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.689+0000 7f05c3a21700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc06f890 con 0x7f05bc14cf50 2023-01-01T17:40:16.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.689+0000 7f05c3a21700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc0a88f0 con 0x7f05bc06cff0 2023-01-01T17:40:16.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.689+0000 7f05c1fbe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f05bc154140 0x7f05bc1ebe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:16.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.689+0000 7f05c1fbe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f05bc154140 0x7f05bc1ebe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46970/0 (socket says 172.21.15.61:46970) 2023-01-01T17:40:16.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.689+0000 7f05c1fbe700 1 -- 172.21.15.61:0/3995672436 learned_addr learned my addr 172.21.15.61:0/3995672436 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:16.694 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.690+0000 7f05c17bd700 1 --2- 172.21.15.61:0/3995672436 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05bc06cff0 0x7f05bc06f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:16.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.690+0000 7f05c0fbc700 1 --2- 172.21.15.61:0/3995672436 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05bc14cf50 0x7f05bc156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:16.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.690+0000 7f05c1fbe700 1 -- 172.21.15.61:0/3995672436 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05bc06cff0 msgr2=0x7f05bc06f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:16.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.690+0000 7f05c1fbe700 1 --2- 172.21.15.61:0/3995672436 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05bc06cff0 0x7f05bc06f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:16.695 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.690+0000 7f05c1fbe700 1 -- 172.21.15.61:0/3995672436 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05bc14cf50 msgr2=0x7f05bc156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:16.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.690+0000 7f05c1fbe700 1 --2- 172.21.15.61:0/3995672436 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05bc14cf50 0x7f05bc156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:16.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.690+0000 7f05c1fbe700 1 -- 172.21.15.61:0/3995672436 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b80094a0 con 0x7f05bc154140 2023-01-01T17:40:16.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.690+0000 7f05c1fbe700 1 --2- 172.21.15.61:0/3995672436 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f05bc154140 0x7f05bc1ebe60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f05b400cbc0 tx=0x7f05b400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:16.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.690+0000 7f05b1ffb700 1 -- 172.21.15.61:0/3995672436 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b400aaa0 con 0x7f05bc154140 2023-01-01T17:40:16.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.690+0000 7f05b1ffb700 1 -- 172.21.15.61:0/3995672436 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b400ac00 con 0x7f05bc154140 2023-01-01T17:40:16.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.690+0000 7f05c3a21700 1 -- 172.21.15.61:0/3995672436 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05ac0094a0 con 0x7f05bc154140 2023-01-01T17:40:16.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.690+0000 7f05b1ffb700 1 -- 172.21.15.61:0/3995672436 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b4012400 con 0x7f05bc154140 2023-01-01T17:40:16.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.690+0000 7f05c3a21700 1 -- 172.21.15.61:0/3995672436 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05bc0698a0 con 0x7f05bc154140 2023-01-01T17:40:16.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.691+0000 7f05c3a21700 1 -- 172.21.15.61:0/3995672436 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05bc06a730 con 0x7f05bc154140 2023-01-01T17:40:16.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.692+0000 7f05b1ffb700 1 -- 172.21.15.61:0/3995672436 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f05b4019030 con 0x7f05bc154140 2023-01-01T17:40:16.696 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.692+0000 7f05b1ffb700 1 --2- 172.21.15.61:0/3995672436 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f05a0063290 0x7f05a0065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:16.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.692+0000 7f05b1ffb700 1 -- 172.21.15.61:0/3995672436 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f05b407f820 con 0x7f05bc154140 2023-01-01T17:40:16.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.692+0000 7f05c17bd700 1 --2- 172.21.15.61:0/3995672436 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f05a0063290 0x7f05a0065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:16.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.693+0000 7f05c17bd700 1 --2- 172.21.15.61:0/3995672436 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f05a0063290 0x7f05a0065740 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f05ac000c00 tx=0x7f05ac01c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:16.697 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.696+0000 7f05b1ffb700 1 -- 172.21.15.61:0/3995672436 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f05b404aa30 con 0x7f05bc154140 2023-01-01T17:40:16.886 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.885+0000 7f05c3a21700 1 -- 172.21.15.61:0/3995672436 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f05bc069a30 con 0x7f05bc154140 2023-01-01T17:40:16.887 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.886+0000 7f05b1ffb700 1 -- 172.21.15.61:0/3995672436 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f05b404e610 con 0x7f05bc154140 2023-01-01T17:40:16.887 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 8 2023-01-01T17:40:16.888 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.888+0000 7f05c3a21700 1 -- 172.21.15.61:0/3995672436 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f05a0063290 msgr2=0x7f05a0065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:16.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.888+0000 7f05c3a21700 1 --2- 172.21.15.61:0/3995672436 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f05a0063290 0x7f05a0065740 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f05ac000c00 tx=0x7f05ac01c040 comp rx=0 tx=0).stop 2023-01-01T17:40:16.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.888+0000 7f05c3a21700 1 -- 172.21.15.61:0/3995672436 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f05bc154140 msgr2=0x7f05bc1ebe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:16.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.888+0000 7f05c3a21700 1 --2- 172.21.15.61:0/3995672436 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f05bc154140 0x7f05bc1ebe60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f05b400cbc0 tx=0x7f05b400ced0 comp rx=0 tx=0).stop 2023-01-01T17:40:16.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.888+0000 7f05c3a21700 1 -- 172.21.15.61:0/3995672436 shutdown_connections 2023-01-01T17:40:16.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.888+0000 7f05c3a21700 1 --2- 172.21.15.61:0/3995672436 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f05a0063290 0x7f05a0065740 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:16.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.888+0000 7f05c3a21700 1 --2- 172.21.15.61:0/3995672436 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f05bc154140 0x7f05bc1ebe60 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:16.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.888+0000 7f05c3a21700 1 --2- 172.21.15.61:0/3995672436 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f05bc06cff0 0x7f05bc06f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:16.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.888+0000 7f05c3a21700 1 --2- 172.21.15.61:0/3995672436 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05bc14cf50 0x7f05bc156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:16.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.888+0000 7f05c3a21700 1 -- 172.21.15.61:0/3995672436 >> 172.21.15.61:0/3995672436 conn(0x7f05bc0c1e80 msgr2=0x7f05bc14b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:16.890 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.888+0000 7f05c3a21700 1 -- 172.21.15.61:0/3995672436 shutdown_connections 2023-01-01T17:40:16.890 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:16.888+0000 7f05c3a21700 1 -- 172.21.15.61:0/3995672436 wait complete. 2023-01-01T17:40:16.901 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-01-01T17:40:17.030 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.030+0000 7f8dea68d700 1 Processor -- start 2023-01-01T17:40:17.031 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.030+0000 7f8dea68d700 1 -- start start 2023-01-01T17:40:17.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.031+0000 7f8dea68d700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f8de4071750 0x7f8de414f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:17.033 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.031+0000 7f8dea68d700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8de40c4e30 con 0x7f8de40c64f0 2023-01-01T17:40:17.034 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.031+0000 7f8dea68d700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8de41562c0 con 0x7f8de40c68c0 2023-01-01T17:40:17.034 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.031+0000 7f8dea68d700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8de406de00 con 0x7f8de4071750 2023-01-01T17:40:17.034 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.031+0000 7f8de8c2a700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f8de4071750 0x7f8de414f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:17.034 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.031+0000 7f8de3fff700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f8de40c64f0 0x7f8de40c19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40824/0 (socket says 172.21.15.61:40824) 2023-01-01T17:40:17.034 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.031+0000 7f8de3fff700 1 -- 172.21.15.61:0/548805639 learned_addr learned my addr 172.21.15.61:0/548805639 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:40:17.034 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.031+0000 7f8de8c2a700 1 -- 172.21.15.61:0/548805639 >> v1:172.21.15.149:6789/0 conn(0x7f8de40c68c0 legacy=0x7f8de41567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:17.034 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.031+0000 7f8de8c2a700 1 -- 172.21.15.61:0/548805639 >> v1:172.21.15.61:6789/0 conn(0x7f8de40c64f0 legacy=0x7f8de40c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:17.034 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.031+0000 7f8de8c2a700 1 -- 172.21.15.61:0/548805639 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de40c5080 con 0x7f8de4071750 2023-01-01T17:40:17.034 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.031+0000 7f8de2ffd700 1 -- 172.21.15.61:0/548805639 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 298034819 0 0) 0x7f8de40c4e30 con 0x7f8de40c64f0 2023-01-01T17:40:17.034 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.031+0000 7f8de8c2a700 1 --2- 172.21.15.61:0/548805639 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8de4071750 0x7f8de414f9d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc009d90 tx=0x7f8ddc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7280e1990cb68dd server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:17.034 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.031+0000 7f8de2ffd700 1 -- 172.21.15.61:0/548805639 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc00e070 con 0x7f8de4071750 2023-01-01T17:40:17.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.031+0000 7f8de2ffd700 1 -- 172.21.15.61:0/548805639 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ddc00bbd0 con 0x7f8de4071750 2023-01-01T17:40:17.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.031+0000 7f8de2ffd700 1 -- 172.21.15.61:0/548805639 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc012430 con 0x7f8de4071750 2023-01-01T17:40:17.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.032+0000 7f8dea68d700 1 -- 172.21.15.61:0/548805639 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8de4071750 msgr2=0x7f8de414f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:17.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.032+0000 7f8dea68d700 1 --2- 172.21.15.61:0/548805639 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8de4071750 0x7f8de414f9d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc009d90 tx=0x7f8ddc00b330 comp rx=0 tx=0).stop 2023-01-01T17:40:17.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.032+0000 7f8dea68d700 1 -- 172.21.15.61:0/548805639 shutdown_connections 2023-01-01T17:40:17.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.032+0000 7f8dea68d700 1 --2- 172.21.15.61:0/548805639 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8de4071750 0x7f8de414f9d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:17.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.032+0000 7f8dea68d700 1 -- 172.21.15.61:0/548805639 >> 172.21.15.61:0/548805639 conn(0x7f8de40a8420 msgr2=0x7f8de40c5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:17.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.032+0000 7f8dea68d700 1 -- 172.21.15.61:0/548805639 shutdown_connections 2023-01-01T17:40:17.035 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.032+0000 7f8dea68d700 1 -- 172.21.15.61:0/548805639 wait complete. 2023-01-01T17:40:17.036 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.033+0000 7f8dea68d700 1 Processor -- start 2023-01-01T17:40:17.036 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.033+0000 7f8dea68d700 1 -- start start 2023-01-01T17:40:17.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.034+0000 7f8dea68d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8de4071750 0x7f8de41dfd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:17.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.034+0000 7f8dea68d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8de40c64f0 0x7f8de414e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:17.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.034+0000 7f8dea68d700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8de414e6f0 0x7f8de406d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:17.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.034+0000 7f8dea68d700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de4146ad0 con 0x7f8de4071750 2023-01-01T17:40:17.038 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.034+0000 7f8dea68d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de414caa0 con 0x7f8de40c64f0 2023-01-01T17:40:17.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.034+0000 7f8dea68d700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de414d3a0 con 0x7f8de414e6f0 2023-01-01T17:40:17.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.034+0000 7f8de3fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8de4071750 0x7f8de41dfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:17.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.034+0000 7f8de3fff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8de4071750 0x7f8de41dfd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:46980/0 (socket says 172.21.15.61:46980) 2023-01-01T17:40:17.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.034+0000 7f8de3fff700 1 -- 172.21.15.61:0/4082408266 learned_addr learned my addr 172.21.15.61:0/4082408266 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:17.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.034+0000 7f8de8c2a700 1 --2- 172.21.15.61:0/4082408266 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8de414e6f0 0x7f8de406d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:17.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.034+0000 7f8de37fe700 1 --2- 172.21.15.61:0/4082408266 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8de40c64f0 0x7f8de414e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:17.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.034+0000 7f8de3fff700 1 -- 172.21.15.61:0/4082408266 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8de414e6f0 msgr2=0x7f8de406d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:17.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.034+0000 7f8de3fff700 1 --2- 172.21.15.61:0/4082408266 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8de414e6f0 0x7f8de406d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:17.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.034+0000 7f8de3fff700 1 -- 172.21.15.61:0/4082408266 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8de40c64f0 msgr2=0x7f8de414e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:17.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.034+0000 7f8de3fff700 1 --2- 172.21.15.61:0/4082408266 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8de40c64f0 0x7f8de414e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:17.039 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.034+0000 7f8de3fff700 1 -- 172.21.15.61:0/4082408266 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ddc009a70 con 0x7f8de4071750 2023-01-01T17:40:17.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.035+0000 7f8de3fff700 1 --2- 172.21.15.61:0/4082408266 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8de4071750 0x7f8de41dfd40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8dd400c550 tx=0x7f8dd400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:17.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.035+0000 7f8de0ff9700 1 -- 172.21.15.61:0/4082408266 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4004c80 con 0x7f8de4071750 2023-01-01T17:40:17.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.035+0000 7f8de0ff9700 1 -- 172.21.15.61:0/4082408266 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd4004e00 con 0x7f8de4071750 2023-01-01T17:40:17.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.035+0000 7f8dea68d700 1 -- 172.21.15.61:0/4082408266 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8de4152cd0 con 0x7f8de4071750 2023-01-01T17:40:17.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.035+0000 7f8de0ff9700 1 -- 172.21.15.61:0/4082408266 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4007310 con 0x7f8de4071750 2023-01-01T17:40:17.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.035+0000 7f8dea68d700 1 -- 172.21.15.61:0/4082408266 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8de406e1b0 con 0x7f8de4071750 2023-01-01T17:40:17.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.036+0000 7f8dea68d700 1 -- 172.21.15.61:0/4082408266 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8de4152e60 con 0x7f8de4071750 2023-01-01T17:40:17.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.036+0000 7f8de0ff9700 1 -- 172.21.15.61:0/4082408266 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f8dd401a020 con 0x7f8de4071750 2023-01-01T17:40:17.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.036+0000 7f8de0ff9700 1 --2- 172.21.15.61:0/4082408266 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f8dd0063290 0x7f8dd0065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:17.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.036+0000 7f8de0ff9700 1 -- 172.21.15.61:0/4082408266 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8dd407f9b0 con 0x7f8de4071750 2023-01-01T17:40:17.040 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.037+0000 7f8de37fe700 1 --2- 172.21.15.61:0/4082408266 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f8dd0063290 0x7f8dd0065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:17.041 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.037+0000 7f8de37fe700 1 --2- 172.21.15.61:0/4082408266 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f8dd0063290 0x7f8dd0065740 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8de4150190 tx=0x7f8dd8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:17.041 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.041+0000 7f8de0ff9700 1 -- 172.21.15.61:0/4082408266 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f8de4152e60 con 0x7f8de4071750 2023-01-01T17:40:17.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.227+0000 7f8dea68d700 1 -- 172.21.15.61:0/4082408266 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8de414d8f0 con 0x7f8de4071750 2023-01-01T17:40:17.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.227+0000 7f8de0ff9700 1 -- 172.21.15.61:0/4082408266 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8dd404e820 con 0x7f8de4071750 2023-01-01T17:40:17.228 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 1 2023-01-01T17:40:17.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.229+0000 7f8dea68d700 1 -- 172.21.15.61:0/4082408266 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f8dd0063290 msgr2=0x7f8dd0065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:17.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.229+0000 7f8dea68d700 1 --2- 172.21.15.61:0/4082408266 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f8dd0063290 0x7f8dd0065740 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8de4150190 tx=0x7f8dd8009040 comp rx=0 tx=0).stop 2023-01-01T17:40:17.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.229+0000 7f8dea68d700 1 -- 172.21.15.61:0/4082408266 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8de4071750 msgr2=0x7f8de41dfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:17.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.229+0000 7f8dea68d700 1 --2- 172.21.15.61:0/4082408266 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8de4071750 0x7f8de41dfd40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8dd400c550 tx=0x7f8dd400c910 comp rx=0 tx=0).stop 2023-01-01T17:40:17.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.229+0000 7f8dea68d700 1 -- 172.21.15.61:0/4082408266 shutdown_connections 2023-01-01T17:40:17.231 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.229+0000 7f8dea68d700 1 --2- 172.21.15.61:0/4082408266 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f8de414e6f0 0x7f8de406d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:17.231 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.229+0000 7f8dea68d700 1 --2- 172.21.15.61:0/4082408266 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f8dd0063290 0x7f8dd0065740 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:17.231 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.229+0000 7f8dea68d700 1 --2- 172.21.15.61:0/4082408266 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f8de4071750 0x7f8de41dfd40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:17.231 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.229+0000 7f8dea68d700 1 --2- 172.21.15.61:0/4082408266 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8de40c64f0 0x7f8de414e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:17.231 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.229+0000 7f8dea68d700 1 -- 172.21.15.61:0/4082408266 >> 172.21.15.61:0/4082408266 conn(0x7f8de40a8420 msgr2=0x7f8de4069360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:17.231 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.230+0000 7f8dea68d700 1 -- 172.21.15.61:0/4082408266 shutdown_connections 2023-01-01T17:40:17.231 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.230+0000 7f8dea68d700 1 -- 172.21.15.61:0/4082408266 wait complete. 2023-01-01T17:40:17.242 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-01-01T17:40:17.369 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.369+0000 7f44c000d700 1 Processor -- start 2023-01-01T17:40:17.370 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.369+0000 7f44c000d700 1 -- start start 2023-01-01T17:40:17.373 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.370+0000 7f44c000d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f44b80c3210 0x7f44b814f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:17.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.370+0000 7f44c000d700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b806f800 con 0x7f44b80c4150 2023-01-01T17:40:17.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.370+0000 7f44c000d700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b80aab40 con 0x7f44b80c4cc0 2023-01-01T17:40:17.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.370+0000 7f44c000d700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b80c4520 con 0x7f44b80c3210 2023-01-01T17:40:17.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.370+0000 7f44bdda9700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f44b80c4150 0x7f44b80c5a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40838/0 (socket says 172.21.15.61:40838) 2023-01-01T17:40:17.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.370+0000 7f44bdda9700 1 -- 172.21.15.61:0/541170020 learned_addr learned my addr 172.21.15.61:0/541170020 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:40:17.374 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.370+0000 7f44bd5a8700 1 --2- 172.21.15.61:0/541170020 >> v2:172.21.15.149:3300/0 conn(0x7f44b80c3210 0x7f44b814f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:17.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.370+0000 7f44bcda7700 1 -- 172.21.15.61:0/541170020 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3465890661 0 0) 0x7f44a8001110 con 0x7f44b80c4150 2023-01-01T17:40:17.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.370+0000 7f44bcda7700 1 -- 172.21.15.61:0/541170020 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44a40035b0 con 0x7f44b80c4150 2023-01-01T17:40:17.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.370+0000 7f44bcda7700 1 -- 172.21.15.61:0/541170020 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4148655267 0 0) 0x7f44a40035b0 con 0x7f44b80c4150 2023-01-01T17:40:17.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.371+0000 7f44bcda7700 1 -- 172.21.15.61:0/541170020 >> v2:172.21.15.149:3300/0 conn(0x7f44b80c3210 msgr2=0x7f44b814f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:17.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.371+0000 7f44bcda7700 1 --2- 172.21.15.61:0/541170020 >> v2:172.21.15.149:3300/0 conn(0x7f44b80c3210 0x7f44b814f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:17.375 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.371+0000 7f44bcda7700 1 -- 172.21.15.61:0/541170020 >> v1:172.21.15.149:6789/0 conn(0x7f44b80c4cc0 legacy=0x7f44b81599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:17.376 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.371+0000 7f44bcda7700 1 -- 172.21.15.61:0/541170020 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b80aade0 con 0x7f44b80c4150 2023-01-01T17:40:17.376 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.371+0000 7f44bcda7700 1 -- 172.21.15.61:0/541170020 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586489653 0 0) 0x7f44a8001800 con 0x7f44b80c4150 2023-01-01T17:40:17.376 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.371+0000 7f44bcda7700 1 -- 172.21.15.61:0/541170020 >> v1:172.21.15.61:6789/0 conn(0x7f44b80c4150 legacy=0x7f44b80c5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:17.376 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.371+0000 7f44bcda7700 1 --2- 172.21.15.61:0/541170020 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f44a4003a00 0x7f44a4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:17.376 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.371+0000 7f44bcda7700 1 --2- 172.21.15.61:0/541170020 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44a40043f0 0x7f44a40048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:17.376 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.371+0000 7f44bcda7700 1 --2- 172.21.15.61:0/541170020 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44a4005150 0x7f44a400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:17.376 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.371+0000 7f44bcda7700 1 -- 172.21.15.61:0/541170020 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b80c4520 con 0x7f44a4003a00 2023-01-01T17:40:17.376 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.371+0000 7f44bcda7700 1 -- 172.21.15.61:0/541170020 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a400c080 con 0x7f44a40043f0 2023-01-01T17:40:17.377 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.371+0000 7f44bcda7700 1 -- 172.21.15.61:0/541170020 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a400c240 con 0x7f44a4005150 2023-01-01T17:40:17.377 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.371+0000 7f44bdda9700 1 --2- 172.21.15.61:0/541170020 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f44a4003a00 0x7f44a4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:17.377 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.371+0000 7f44bd5a8700 1 --2- 172.21.15.61:0/541170020 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44a40043f0 0x7f44a40048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:17.377 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.371+0000 7f44be5aa700 1 --2- 172.21.15.61:0/541170020 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44a4005150 0x7f44a400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:17.377 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.371+0000 7f44bdda9700 1 -- 172.21.15.61:0/541170020 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44a4005150 msgr2=0x7f44a400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:17.377 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.371+0000 7f44bdda9700 1 --2- 172.21.15.61:0/541170020 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44a4005150 0x7f44a400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:17.377 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.371+0000 7f44bdda9700 1 -- 172.21.15.61:0/541170020 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44a40043f0 msgr2=0x7f44a40048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:17.377 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.371+0000 7f44bdda9700 1 --2- 172.21.15.61:0/541170020 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44a40043f0 0x7f44a40048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:17.377 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.371+0000 7f44bdda9700 1 -- 172.21.15.61:0/541170020 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a40035b0 con 0x7f44a4003a00 2023-01-01T17:40:17.378 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.371+0000 7f44be5aa700 1 -- 172.21.15.61:0/541170020 reap_dead start 2023-01-01T17:40:17.378 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.371+0000 7f44bdda9700 1 --2- 172.21.15.61:0/541170020 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f44a4003a00 0x7f44a4003dd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f44a8007ed0 tx=0x7f44a4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78a35e747890af2a server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:17.378 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.371+0000 7f44bcda7700 1 -- 172.21.15.61:0/541170020 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a800cdb0 con 0x7f44a4003a00 2023-01-01T17:40:17.378 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.371+0000 7f44bcda7700 1 -- 172.21.15.61:0/541170020 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a8005960 con 0x7f44a4003a00 2023-01-01T17:40:17.378 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.371+0000 7f44bcda7700 1 -- 172.21.15.61:0/541170020 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a8005cf0 con 0x7f44a4003a00 2023-01-01T17:40:17.378 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.372+0000 7f44c000d700 1 -- 172.21.15.61:0/541170020 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f44a4003a00 msgr2=0x7f44a4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:17.379 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.372+0000 7f44c000d700 1 --2- 172.21.15.61:0/541170020 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f44a4003a00 0x7f44a4003dd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f44a8007ed0 tx=0x7f44a4005880 comp rx=0 tx=0).stop 2023-01-01T17:40:17.379 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.372+0000 7f44c000d700 1 -- 172.21.15.61:0/541170020 shutdown_connections 2023-01-01T17:40:17.379 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.372+0000 7f44c000d700 1 --2- 172.21.15.61:0/541170020 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f44a4003a00 0x7f44a4003dd0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:17.379 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.372+0000 7f44c000d700 1 -- 172.21.15.61:0/541170020 >> 172.21.15.61:0/541170020 conn(0x7f44b80c2a40 msgr2=0x7f44b80c5310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:17.379 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.372+0000 7f44c000d700 1 -- 172.21.15.61:0/541170020 shutdown_connections 2023-01-01T17:40:17.379 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.372+0000 7f44c000d700 1 -- 172.21.15.61:0/541170020 wait complete. 2023-01-01T17:40:17.380 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.373+0000 7f44c000d700 1 Processor -- start 2023-01-01T17:40:17.380 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.373+0000 7f44c000d700 1 -- start start 2023-01-01T17:40:17.384 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.374+0000 7f44c000d700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44a4003a00 0x7f44b8152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:17.384 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.374+0000 7f44c000d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b81e8f30 0x7f44b80be9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:17.384 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.374+0000 7f44c000d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f44b8146ba0 0x7f44b8147010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:17.384 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.374+0000 7f44c000d700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b814fbd0 con 0x7f44b8146ba0 2023-01-01T17:40:17.384 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.374+0000 7f44c000d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b8153600 con 0x7f44b81e8f30 2023-01-01T17:40:17.384 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.374+0000 7f44c000d700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b80aa8e0 con 0x7f44a4003a00 2023-01-01T17:40:17.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.374+0000 7f44be5aa700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f44b8146ba0 0x7f44b8147010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:17.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.374+0000 7f44be5aa700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f44b8146ba0 0x7f44b8147010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47004/0 (socket says 172.21.15.61:47004) 2023-01-01T17:40:17.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.374+0000 7f44be5aa700 1 -- 172.21.15.61:0/1601846852 learned_addr learned my addr 172.21.15.61:0/1601846852 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:17.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.374+0000 7f44bdda9700 1 --2- 172.21.15.61:0/1601846852 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44a4003a00 0x7f44b8152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:17.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.374+0000 7f44bd5a8700 1 --2- 172.21.15.61:0/1601846852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b81e8f30 0x7f44b80be9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:17.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.374+0000 7f44be5aa700 1 -- 172.21.15.61:0/1601846852 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44a4003a00 msgr2=0x7f44b8152d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:17.385 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.374+0000 7f44be5aa700 1 --2- 172.21.15.61:0/1601846852 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44a4003a00 0x7f44b8152d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:17.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.374+0000 7f44be5aa700 1 -- 172.21.15.61:0/1601846852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b81e8f30 msgr2=0x7f44b80be9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:17.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.374+0000 7f44be5aa700 1 --2- 172.21.15.61:0/1601846852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b81e8f30 0x7f44b80be9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:17.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.374+0000 7f44be5aa700 1 -- 172.21.15.61:0/1601846852 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b806f520 con 0x7f44b8146ba0 2023-01-01T17:40:17.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.374+0000 7f44bd5a8700 1 --2- 172.21.15.61:0/1601846852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b81e8f30 0x7f44b80be9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-01-01T17:40:17.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.374+0000 7f44be5aa700 1 --2- 172.21.15.61:0/1601846852 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f44b8146ba0 0x7f44b8147010 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f44b0002230 tx=0x7f44b000d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:17.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.375+0000 7f44ae7fc700 1 -- 172.21.15.61:0/1601846852 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b0003c10 con 0x7f44b8146ba0 2023-01-01T17:40:17.386 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.375+0000 7f44ae7fc700 1 -- 172.21.15.61:0/1601846852 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b0003d70 con 0x7f44b8146ba0 2023-01-01T17:40:17.387 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.375+0000 7f44c000d700 1 -- 172.21.15.61:0/1601846852 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b806f240 con 0x7f44b8146ba0 2023-01-01T17:40:17.387 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.375+0000 7f44ae7fc700 1 -- 172.21.15.61:0/1601846852 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b000dc00 con 0x7f44b8146ba0 2023-01-01T17:40:17.387 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.375+0000 7f44c000d700 1 -- 172.21.15.61:0/1601846852 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b814f250 con 0x7f44b8146ba0 2023-01-01T17:40:17.387 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.376+0000 7f44c000d700 1 -- 172.21.15.61:0/1601846852 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b80aa130 con 0x7f44b8146ba0 2023-01-01T17:40:17.387 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.376+0000 7f44ae7fc700 1 -- 172.21.15.61:0/1601846852 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f44b000dd60 con 0x7f44b8146ba0 2023-01-01T17:40:17.387 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.376+0000 7f44ae7fc700 1 --2- 172.21.15.61:0/1601846852 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f449c0632c0 0x7f449c065770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:17.387 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.376+0000 7f44ae7fc700 1 -- 172.21.15.61:0/1601846852 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f44b00801f0 con 0x7f44b8146ba0 2023-01-01T17:40:17.388 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.376+0000 7f44bdda9700 1 --2- 172.21.15.61:0/1601846852 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f449c0632c0 0x7f449c065770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:17.388 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.377+0000 7f44bdda9700 1 --2- 172.21.15.61:0/1601846852 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f449c0632c0 0x7f449c065770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f44a8001030 tx=0x7f44a8007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:17.388 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.381+0000 7f44ae7fc700 1 -- 172.21.15.61:0/1601846852 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f44b80aa130 con 0x7f44b8146ba0 2023-01-01T17:40:17.573 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.572+0000 7f44c000d700 1 -- 172.21.15.61:0/1601846852 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f44b8150640 con 0x7f44b8146ba0 2023-01-01T17:40:17.573 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.573+0000 7f44ae7fc700 1 -- 172.21.15.61:0/1601846852 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f44b8150640 con 0x7f44b8146ba0 2023-01-01T17:40:17.573 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 32 2023-01-01T17:40:17.575 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.575+0000 7f44c000d700 1 -- 172.21.15.61:0/1601846852 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f449c0632c0 msgr2=0x7f449c065770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:17.575 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.575+0000 7f44c000d700 1 --2- 172.21.15.61:0/1601846852 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f449c0632c0 0x7f449c065770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f44a8001030 tx=0x7f44a8007000 comp rx=0 tx=0).stop 2023-01-01T17:40:17.575 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.575+0000 7f44c000d700 1 -- 172.21.15.61:0/1601846852 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f44b8146ba0 msgr2=0x7f44b8147010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:17.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.575+0000 7f44c000d700 1 --2- 172.21.15.61:0/1601846852 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f44b8146ba0 0x7f44b8147010 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f44b0002230 tx=0x7f44b000d430 comp rx=0 tx=0).stop 2023-01-01T17:40:17.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.575+0000 7f44c000d700 1 -- 172.21.15.61:0/1601846852 shutdown_connections 2023-01-01T17:40:17.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.575+0000 7f44c000d700 1 --2- 172.21.15.61:0/1601846852 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f449c0632c0 0x7f449c065770 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:17.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.575+0000 7f44c000d700 1 --2- 172.21.15.61:0/1601846852 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f44b8146ba0 0x7f44b8147010 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:17.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.575+0000 7f44c000d700 1 --2- 172.21.15.61:0/1601846852 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f44a4003a00 0x7f44b8152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:17.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.575+0000 7f44c000d700 1 --2- 172.21.15.61:0/1601846852 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44b81e8f30 0x7f44b80be9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:17.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.575+0000 7f44c000d700 1 -- 172.21.15.61:0/1601846852 >> 172.21.15.61:0/1601846852 conn(0x7f44b80c2a40 msgr2=0x7f44b814e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:17.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.575+0000 7f44c000d700 1 -- 172.21.15.61:0/1601846852 shutdown_connections 2023-01-01T17:40:17.576 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.575+0000 7f44c000d700 1 -- 172.21.15.61:0/1601846852 wait complete. 2023-01-01T17:40:17.587 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-01-01T17:40:17.714 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.713+0000 7fdf0492c700 1 Processor -- start 2023-01-01T17:40:17.714 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.713+0000 7fdf0492c700 1 -- start start 2023-01-01T17:40:17.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.714+0000 7fdf0492c700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf000c64f0 0x7fdf000c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:17.720 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.714+0000 7fdf0492c700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf000c4e30 con 0x7fdf00071750 2023-01-01T17:40:17.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.714+0000 7fdf0492c700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf001562c0 con 0x7fdf000c68c0 2023-01-01T17:40:17.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.714+0000 7fdf0492c700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0006de00 con 0x7fdf000c64f0 2023-01-01T17:40:17.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.714+0000 7fdefed9d700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7fdf00071750 0x7fdf0014f9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40862/0 (socket says 172.21.15.61:40862) 2023-01-01T17:40:17.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.714+0000 7fdefed9d700 1 -- 172.21.15.61:0/3175666003 learned_addr learned my addr 172.21.15.61:0/3175666003 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:40:17.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.715+0000 7fdefe59c700 1 --2- 172.21.15.61:0/3175666003 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf000c64f0 0x7fdf000c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:17.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.715+0000 7fdefd59a700 1 -- 172.21.15.61:0/3175666003 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2183194670 0 0) 0x7fdf000c4e30 con 0x7fdf00071750 2023-01-01T17:40:17.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.715+0000 7fdefd59a700 1 -- 172.21.15.61:0/3175666003 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdee80035b0 con 0x7fdf00071750 2023-01-01T17:40:17.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.715+0000 7fdefd59a700 1 -- 172.21.15.61:0/3175666003 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4086167647 0 0) 0x7fdee80035b0 con 0x7fdf00071750 2023-01-01T17:40:17.721 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.715+0000 7fdefd59a700 1 -- 172.21.15.61:0/3175666003 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf000c64f0 msgr2=0x7fdf000c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:17.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.715+0000 7fdefd59a700 1 --2- 172.21.15.61:0/3175666003 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf000c64f0 0x7fdf000c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:17.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.715+0000 7fdefd59a700 1 -- 172.21.15.61:0/3175666003 >> v1:172.21.15.149:6789/0 conn(0x7fdf000c68c0 legacy=0x7fdf001567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:17.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.715+0000 7fdefd59a700 1 -- 172.21.15.61:0/3175666003 --> v1:172.21.15.61:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf000c5080 con 0x7fdf00071750 2023-01-01T17:40:17.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.715+0000 7fdefd59a700 1 -- 172.21.15.61:0/3175666003 <== mon.0 v1:172.21.15.61:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 586489653 0 0) 0x7fdef80019f0 con 0x7fdf00071750 2023-01-01T17:40:17.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.715+0000 7fdefd59a700 1 -- 172.21.15.61:0/3175666003 >> v1:172.21.15.61:6789/0 conn(0x7fdf00071750 legacy=0x7fdf0014f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:17.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.715+0000 7fdefd59a700 1 --2- 172.21.15.61:0/3175666003 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdee8003a30 0x7fdee8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:17.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.715+0000 7fdefd59a700 1 --2- 172.21.15.61:0/3175666003 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf000c64f0 0x7fdee8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:17.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.715+0000 7fdefd59a700 1 --2- 172.21.15.61:0/3175666003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdee8004d90 0x7fdee8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:17.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.715+0000 7fdefd59a700 1 -- 172.21.15.61:0/3175666003 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0006de00 con 0x7fdee8003a30 2023-01-01T17:40:17.722 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.715+0000 7fdefd59a700 1 -- 172.21.15.61:0/3175666003 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee800bb20 con 0x7fdee8004d90 2023-01-01T17:40:17.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.715+0000 7fdefd59a700 1 -- 172.21.15.61:0/3175666003 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee800bce0 con 0x7fdf000c64f0 2023-01-01T17:40:17.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.715+0000 7fdefe59c700 1 --2- 172.21.15.61:0/3175666003 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdee8003a30 0x7fdee8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:17.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.715+0000 7fdefdd9b700 1 --2- 172.21.15.61:0/3175666003 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf000c64f0 0x7fdee8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:17.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.715+0000 7fdefed9d700 1 --2- 172.21.15.61:0/3175666003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdee8004d90 0x7fdee8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:17.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.716+0000 7fdefe59c700 1 -- 172.21.15.61:0/3175666003 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf000c64f0 msgr2=0x7fdee8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:17.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.716+0000 7fdefe59c700 1 --2- 172.21.15.61:0/3175666003 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf000c64f0 0x7fdee8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:17.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.716+0000 7fdefe59c700 1 -- 172.21.15.61:0/3175666003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdee8004d90 msgr2=0x7fdee8005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:17.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.716+0000 7fdefe59c700 1 --2- 172.21.15.61:0/3175666003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdee8004d90 0x7fdee8005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:17.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.716+0000 7fdefe59c700 1 -- 172.21.15.61:0/3175666003 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee80035b0 con 0x7fdee8003a30 2023-01-01T17:40:17.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.716+0000 7fdefed9d700 1 --2- 172.21.15.61:0/3175666003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdee8004d90 0x7fdee8005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-01T17:40:17.723 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.716+0000 7fdefe59c700 1 --2- 172.21.15.61:0/3175666003 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdee8003a30 0x7fdee8003e00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdef0009b40 tx=0x7fdee8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f3156f9c3c573ea server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:17.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.716+0000 7fdefd59a700 1 -- 172.21.15.61:0/3175666003 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef000e6c0 con 0x7fdee8003a30 2023-01-01T17:40:17.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.716+0000 7fdefd59a700 1 -- 172.21.15.61:0/3175666003 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef000e820 con 0x7fdee8003a30 2023-01-01T17:40:17.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.716+0000 7fdefd59a700 1 -- 172.21.15.61:0/3175666003 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef000ebd0 con 0x7fdee8003a30 2023-01-01T17:40:17.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.716+0000 7fdf0492c700 1 -- 172.21.15.61:0/3175666003 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdee8003a30 msgr2=0x7fdee8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:17.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.716+0000 7fdf0492c700 1 --2- 172.21.15.61:0/3175666003 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdee8003a30 0x7fdee8003e00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdef0009b40 tx=0x7fdee8005880 comp rx=0 tx=0).stop 2023-01-01T17:40:17.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.716+0000 7fdefed9d700 1 -- 172.21.15.61:0/3175666003 reap_dead start 2023-01-01T17:40:17.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.717+0000 7fdf0492c700 1 -- 172.21.15.61:0/3175666003 shutdown_connections 2023-01-01T17:40:17.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.717+0000 7fdf0492c700 1 -- 172.21.15.61:0/3175666003 >> 172.21.15.61:0/3175666003 conn(0x7fdf000a8420 msgr2=0x7fdf000c5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:17.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.717+0000 7fdf0492c700 1 -- 172.21.15.61:0/3175666003 shutdown_connections 2023-01-01T17:40:17.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.717+0000 7fdf0492c700 1 -- 172.21.15.61:0/3175666003 wait complete. 2023-01-01T17:40:17.724 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.718+0000 7fdf0492c700 1 Processor -- start 2023-01-01T17:40:17.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.718+0000 7fdf0492c700 1 -- start start 2023-01-01T17:40:17.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.719+0000 7fdf0492c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdee8003a30 0x7fdf00155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:17.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.719+0000 7fdf0492c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdf000a8ae0 0x7fdf000a6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:17.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.719+0000 7fdf0492c700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf0014f010 0x7fdf0014de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:17.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.719+0000 7fdf0492c700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf000aa840 con 0x7fdf000a8ae0 2023-01-01T17:40:17.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.719+0000 7fdf0492c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf000a6f70 con 0x7fdee8003a30 2023-01-01T17:40:17.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.719+0000 7fdf0492c700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0014ec60 con 0x7fdf0014f010 2023-01-01T17:40:17.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.719+0000 7fdefdd9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdf000a8ae0 0x7fdf000a6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:17.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.719+0000 7fdefdd9b700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdf000a8ae0 0x7fdf000a6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47022/0 (socket says 172.21.15.61:47022) 2023-01-01T17:40:17.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.719+0000 7fdefdd9b700 1 -- 172.21.15.61:0/3870095913 learned_addr learned my addr 172.21.15.61:0/3870095913 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:17.725 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.719+0000 7fdefe59c700 1 --2- 172.21.15.61:0/3870095913 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdee8003a30 0x7fdf00155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:17.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.719+0000 7fdefed9d700 1 --2- 172.21.15.61:0/3870095913 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf0014f010 0x7fdf0014de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:17.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.719+0000 7fdefdd9b700 1 -- 172.21.15.61:0/3870095913 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf0014f010 msgr2=0x7fdf0014de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:17.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.719+0000 7fdefdd9b700 1 --2- 172.21.15.61:0/3870095913 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf0014f010 0x7fdf0014de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:17.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.719+0000 7fdefdd9b700 1 -- 172.21.15.61:0/3870095913 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdee8003a30 msgr2=0x7fdf00155360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:17.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.719+0000 7fdefdd9b700 1 --2- 172.21.15.61:0/3870095913 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdee8003a30 0x7fdf00155360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:17.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.719+0000 7fdefdd9b700 1 -- 172.21.15.61:0/3870095913 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf00152cd0 con 0x7fdf000a8ae0 2023-01-01T17:40:17.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.719+0000 7fdefe59c700 1 --2- 172.21.15.61:0/3870095913 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdee8003a30 0x7fdf00155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-01-01T17:40:17.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.719+0000 7fdefdd9b700 1 --2- 172.21.15.61:0/3870095913 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdf000a8ae0 0x7fdf000a6020 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdef400f830 tx=0x7fdef400fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:17.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.719+0000 7fdeeeffd700 1 -- 172.21.15.61:0/3870095913 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef40052e0 con 0x7fdf000a8ae0 2023-01-01T17:40:17.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.719+0000 7fdeeeffd700 1 -- 172.21.15.61:0/3870095913 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef4005480 con 0x7fdf000a8ae0 2023-01-01T17:40:17.726 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.719+0000 7fdeeeffd700 1 -- 172.21.15.61:0/3870095913 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef40038c0 con 0x7fdf000a8ae0 2023-01-01T17:40:17.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.719+0000 7fdf0492c700 1 -- 172.21.15.61:0/3870095913 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf0006e1b0 con 0x7fdf000a8ae0 2023-01-01T17:40:17.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.719+0000 7fdf0492c700 1 -- 172.21.15.61:0/3870095913 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf000a7460 con 0x7fdf000a8ae0 2023-01-01T17:40:17.727 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.720+0000 7fdf0492c700 1 -- 172.21.15.61:0/3870095913 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf00152e60 con 0x7fdf000a8ae0 2023-01-01T17:40:17.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.721+0000 7fdeeeffd700 1 -- 172.21.15.61:0/3870095913 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7fdef4003a20 con 0x7fdf000a8ae0 2023-01-01T17:40:17.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.721+0000 7fdeeeffd700 1 --2- 172.21.15.61:0/3870095913 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fdee00632c0 0x7fdee0065770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:17.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.721+0000 7fdeeeffd700 1 -- 172.21.15.61:0/3870095913 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdef407fd90 con 0x7fdf000a8ae0 2023-01-01T17:40:17.728 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.721+0000 7fdefe59c700 1 --2- 172.21.15.61:0/3870095913 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fdee00632c0 0x7fdee0065770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:17.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.722+0000 7fdefe59c700 1 --2- 172.21.15.61:0/3870095913 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fdee00632c0 0x7fdee0065770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdef000a010 tx=0x7fdef0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:17.729 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.725+0000 7fdeeeffd700 1 -- 172.21.15.61:0/3870095913 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7fdf00152e60 con 0x7fdf000a8ae0 2023-01-01T17:40:17.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.914+0000 7fdf0492c700 1 -- 172.21.15.61:0/3870095913 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdf00152e60 con 0x7fdf000a8ae0 2023-01-01T17:40:17.915 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.915+0000 7fdeeeffd700 1 -- 172.21.15.61:0/3870095913 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdf00152e60 con 0x7fdf000a8ae0 2023-01-01T17:40:17.915 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 64 2023-01-01T17:40:17.917 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.917+0000 7fdf0492c700 1 -- 172.21.15.61:0/3870095913 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fdee00632c0 msgr2=0x7fdee0065770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:17.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.917+0000 7fdf0492c700 1 --2- 172.21.15.61:0/3870095913 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fdee00632c0 0x7fdee0065770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdef000a010 tx=0x7fdef0008030 comp rx=0 tx=0).stop 2023-01-01T17:40:17.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.917+0000 7fdf0492c700 1 -- 172.21.15.61:0/3870095913 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdf000a8ae0 msgr2=0x7fdf000a6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:17.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.917+0000 7fdf0492c700 1 --2- 172.21.15.61:0/3870095913 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdf000a8ae0 0x7fdf000a6020 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdef400f830 tx=0x7fdef400fbf0 comp rx=0 tx=0).stop 2023-01-01T17:40:17.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.917+0000 7fdf0492c700 1 -- 172.21.15.61:0/3870095913 shutdown_connections 2023-01-01T17:40:17.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.917+0000 7fdf0492c700 1 --2- 172.21.15.61:0/3870095913 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fdf0014f010 0x7fdf0014de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:17.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.917+0000 7fdf0492c700 1 --2- 172.21.15.61:0/3870095913 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdee8003a30 0x7fdf00155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:17.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.917+0000 7fdf0492c700 1 --2- 172.21.15.61:0/3870095913 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fdee00632c0 0x7fdee0065770 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:17.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.917+0000 7fdf0492c700 1 --2- 172.21.15.61:0/3870095913 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fdf000a8ae0 0x7fdf000a6020 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:17.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.917+0000 7fdf0492c700 1 -- 172.21.15.61:0/3870095913 >> 172.21.15.61:0/3870095913 conn(0x7fdf000a8420 msgr2=0x7fdf00070d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:17.918 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.917+0000 7fdf0492c700 1 -- 172.21.15.61:0/3870095913 shutdown_connections 2023-01-01T17:40:17.919 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:17.917+0000 7fdf0492c700 1 -- 172.21.15.61:0/3870095913 wait complete. 2023-01-01T17:40:17.930 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-01-01T17:40:18.057 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.057+0000 7f4d61b23700 1 Processor -- start 2023-01-01T17:40:18.057 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.057+0000 7f4d61b23700 1 -- start start 2023-01-01T17:40:18.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.058+0000 7f4d61b23700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4d5c0c64f0 0x7f4d5c0c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:18.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.058+0000 7f4d61b23700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d5c0c68c0 0x7f4d5c0c1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:18.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.058+0000 7f4d61b23700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4d5c071750 0x7f4d5c1567c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:18.061 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.058+0000 7f4d61b23700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d5c0c4e30 con 0x7f4d5c0c64f0 2023-01-01T17:40:18.062 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.058+0000 7f4d61b23700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d5c1562c0 con 0x7f4d5c071750 2023-01-01T17:40:18.062 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.058+0000 7f4d61b23700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c06de00 con 0x7f4d5c0c68c0 2023-01-01T17:40:18.062 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.058+0000 7f4d5b7fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4d5c0c64f0 0x7f4d5c0c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:18.062 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.058+0000 7f4d5b7fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f4d5c0c64f0 0x7f4d5c0c19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47028/0 (socket says 172.21.15.61:47028) 2023-01-01T17:40:18.062 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.058+0000 7f4d5b7fe700 1 -- 172.21.15.61:0/1734168502 learned_addr learned my addr 172.21.15.61:0/1734168502 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:18.062 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.058+0000 7f4d53fff700 1 --2- 172.21.15.61:0/1734168502 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d5c0c68c0 0x7f4d5c0c1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:18.062 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.058+0000 7f4d5bfff700 1 --2- 172.21.15.61:0/1734168502 >> v2:172.21.15.149:3300/0 conn(0x7f4d5c071750 0x7f4d5c1567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:18.062 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.058+0000 7f4d5b7fe700 1 -- 172.21.15.61:0/1734168502 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d5c0c68c0 msgr2=0x7f4d5c0c1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:18.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.058+0000 7f4d5b7fe700 1 --2- 172.21.15.61:0/1734168502 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d5c0c68c0 0x7f4d5c0c1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:18.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.058+0000 7f4d5b7fe700 1 -- 172.21.15.61:0/1734168502 >> v2:172.21.15.149:3300/0 conn(0x7f4d5c071750 msgr2=0x7f4d5c1567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:18.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.058+0000 7f4d5b7fe700 1 --2- 172.21.15.61:0/1734168502 >> v2:172.21.15.149:3300/0 conn(0x7f4d5c071750 0x7f4d5c1567c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:18.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.058+0000 7f4d5b7fe700 1 -- 172.21.15.61:0/1734168502 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5c0c5080 con 0x7f4d5c0c64f0 2023-01-01T17:40:18.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.058+0000 7f4d5b7fe700 1 --2- 172.21.15.61:0/1734168502 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d5c0c64f0 0x7f4d5c0c19e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c0c5b20 tx=0x7f4d4c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa2a08c7d2c08de server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:18.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.058+0000 7f4d5affd700 1 -- 172.21.15.61:0/1734168502 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c011830 con 0x7f4d5c0c64f0 2023-01-01T17:40:18.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.058+0000 7f4d5affd700 1 -- 172.21.15.61:0/1734168502 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4c011990 con 0x7f4d5c0c64f0 2023-01-01T17:40:18.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.058+0000 7f4d5affd700 1 -- 172.21.15.61:0/1734168502 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c011d20 con 0x7f4d5c0c64f0 2023-01-01T17:40:18.063 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.059+0000 7f4d61b23700 1 -- 172.21.15.61:0/1734168502 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d5c0c64f0 msgr2=0x7f4d5c0c19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:18.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.059+0000 7f4d61b23700 1 --2- 172.21.15.61:0/1734168502 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d5c0c64f0 0x7f4d5c0c19e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c0c5b20 tx=0x7f4d4c009bd0 comp rx=0 tx=0).stop 2023-01-01T17:40:18.064 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.059+0000 7f4d61b23700 1 -- 172.21.15.61:0/1734168502 shutdown_connections 2023-01-01T17:40:18.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.059+0000 7f4d61b23700 1 --2- 172.21.15.61:0/1734168502 >> v2:172.21.15.149:3300/0 conn(0x7f4d5c071750 0x7f4d5c1567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:18.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.059+0000 7f4d61b23700 1 --2- 172.21.15.61:0/1734168502 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d5c0c64f0 0x7f4d5c0c19e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:18.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.059+0000 7f4d61b23700 1 --2- 172.21.15.61:0/1734168502 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d5c0c68c0 0x7f4d5c0c1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:18.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.059+0000 7f4d61b23700 1 -- 172.21.15.61:0/1734168502 >> 172.21.15.61:0/1734168502 conn(0x7f4d5c0a8420 msgr2=0x7f4d5c0c5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:18.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.059+0000 7f4d61b23700 1 -- 172.21.15.61:0/1734168502 shutdown_connections 2023-01-01T17:40:18.065 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.059+0000 7f4d61b23700 1 -- 172.21.15.61:0/1734168502 wait complete. 2023-01-01T17:40:18.066 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.060+0000 7f4d61b23700 1 Processor -- start 2023-01-01T17:40:18.066 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.060+0000 7f4d61b23700 1 -- start start 2023-01-01T17:40:18.070 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.061+0000 7f4d61b23700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d5c071750 0x7f4d5c144f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:18.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.061+0000 7f4d61b23700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d5c0c64f0 0x7f4d5c150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:18.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.061+0000 7f4d61b23700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d5c14d940 0x7f4d5c14ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:18.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.061+0000 7f4d61b23700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c151780 con 0x7f4d5c071750 2023-01-01T17:40:18.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.061+0000 7f4d61b23700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c152750 con 0x7f4d5c14d940 2023-01-01T17:40:18.071 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.061+0000 7f4d61b23700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c1529f0 con 0x7f4d5c0c64f0 2023-01-01T17:40:18.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.061+0000 7f4d5b7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d5c071750 0x7f4d5c144f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:18.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.061+0000 7f4d5b7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d5c071750 0x7f4d5c144f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47034/0 (socket says 172.21.15.61:47034) 2023-01-01T17:40:18.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.061+0000 7f4d5b7fe700 1 -- 172.21.15.61:0/2492275448 learned_addr learned my addr 172.21.15.61:0/2492275448 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:18.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.061+0000 7f4d5bfff700 1 --2- 172.21.15.61:0/2492275448 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d5c14d940 0x7f4d5c14ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:18.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.061+0000 7f4d53fff700 1 --2- 172.21.15.61:0/2492275448 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d5c0c64f0 0x7f4d5c150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:18.072 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.061+0000 7f4d5b7fe700 1 -- 172.21.15.61:0/2492275448 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d5c0c64f0 msgr2=0x7f4d5c150960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:18.073 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.061+0000 7f4d5b7fe700 1 --2- 172.21.15.61:0/2492275448 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d5c0c64f0 0x7f4d5c150960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:18.073 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.061+0000 7f4d5b7fe700 1 -- 172.21.15.61:0/2492275448 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d5c14d940 msgr2=0x7f4d5c14ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:18.073 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.061+0000 7f4d5b7fe700 1 --2- 172.21.15.61:0/2492275448 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d5c14d940 0x7f4d5c14ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:18.073 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.061+0000 7f4d5b7fe700 1 -- 172.21.15.61:0/2492275448 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4c009550 con 0x7f4d5c071750 2023-01-01T17:40:18.073 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.061+0000 7f4d5bfff700 1 --2- 172.21.15.61:0/2492275448 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d5c14d940 0x7f4d5c14ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-01T17:40:18.073 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.062+0000 7f4d5b7fe700 1 --2- 172.21.15.61:0/2492275448 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d5c071750 0x7f4d5c144f50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c000c00 tx=0x7f4d4c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:18.073 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.062+0000 7f4d58ff9700 1 -- 172.21.15.61:0/2492275448 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c004300 con 0x7f4d5c071750 2023-01-01T17:40:18.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.062+0000 7f4d58ff9700 1 -- 172.21.15.61:0/2492275448 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4c01f070 con 0x7f4d5c071750 2023-01-01T17:40:18.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.062+0000 7f4d61b23700 1 -- 172.21.15.61:0/2492275448 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d5c152cd0 con 0x7f4d5c071750 2023-01-01T17:40:18.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.062+0000 7f4d58ff9700 1 -- 172.21.15.61:0/2492275448 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c0036a0 con 0x7f4d5c071750 2023-01-01T17:40:18.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.062+0000 7f4d61b23700 1 -- 172.21.15.61:0/2492275448 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d5c06e1b0 con 0x7f4d5c071750 2023-01-01T17:40:18.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.063+0000 7f4d61b23700 1 -- 172.21.15.61:0/2492275448 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d5c152e60 con 0x7f4d5c071750 2023-01-01T17:40:18.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.063+0000 7f4d58ff9700 1 -- 172.21.15.61:0/2492275448 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f4d4c02a020 con 0x7f4d5c071750 2023-01-01T17:40:18.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.063+0000 7f4d58ff9700 1 --2- 172.21.15.61:0/2492275448 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f4d3c063290 0x7f4d3c065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:18.074 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.063+0000 7f4d58ff9700 1 -- 172.21.15.61:0/2492275448 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4d4c0810c0 con 0x7f4d5c071750 2023-01-01T17:40:18.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.063+0000 7f4d53fff700 1 --2- 172.21.15.61:0/2492275448 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f4d3c063290 0x7f4d3c065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:18.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.064+0000 7f4d53fff700 1 --2- 172.21.15.61:0/2492275448 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f4d3c063290 0x7f4d3c065740 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c0c00e0 tx=0x7f4d44008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:18.075 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.068+0000 7f4d58ff9700 1 -- 172.21.15.61:0/2492275448 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f4d5c152e60 con 0x7f4d5c071750 2023-01-01T17:40:18.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.258+0000 7f4d61b23700 1 -- 172.21.15.61:0/2492275448 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4d5c152e60 con 0x7f4d5c071750 2023-01-01T17:40:18.259 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.259+0000 7f4d58ff9700 1 -- 172.21.15.61:0/2492275448 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4d5c152e60 con 0x7f4d5c071750 2023-01-01T17:40:18.260 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 32 2023-01-01T17:40:18.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.261+0000 7f4d61b23700 1 -- 172.21.15.61:0/2492275448 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f4d3c063290 msgr2=0x7f4d3c065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:18.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.261+0000 7f4d61b23700 1 --2- 172.21.15.61:0/2492275448 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f4d3c063290 0x7f4d3c065740 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c0c00e0 tx=0x7f4d44008040 comp rx=0 tx=0).stop 2023-01-01T17:40:18.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.261+0000 7f4d61b23700 1 -- 172.21.15.61:0/2492275448 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d5c071750 msgr2=0x7f4d5c144f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:18.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.261+0000 7f4d61b23700 1 --2- 172.21.15.61:0/2492275448 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d5c071750 0x7f4d5c144f50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c000c00 tx=0x7f4d4c004750 comp rx=0 tx=0).stop 2023-01-01T17:40:18.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.261+0000 7f4d61b23700 1 -- 172.21.15.61:0/2492275448 shutdown_connections 2023-01-01T17:40:18.262 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.261+0000 7f4d61b23700 1 --2- 172.21.15.61:0/2492275448 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d5c14d940 0x7f4d5c14ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:18.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.261+0000 7f4d61b23700 1 --2- 172.21.15.61:0/2492275448 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f4d3c063290 0x7f4d3c065740 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:18.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.261+0000 7f4d61b23700 1 --2- 172.21.15.61:0/2492275448 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f4d5c071750 0x7f4d5c144f50 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:18.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.261+0000 7f4d61b23700 1 --2- 172.21.15.61:0/2492275448 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f4d5c0c64f0 0x7f4d5c150960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:18.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.261+0000 7f4d61b23700 1 -- 172.21.15.61:0/2492275448 >> 172.21.15.61:0/2492275448 conn(0x7f4d5c0a8420 msgr2=0x7f4d5c070d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:18.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.261+0000 7f4d61b23700 1 -- 172.21.15.61:0/2492275448 shutdown_connections 2023-01-01T17:40:18.263 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.261+0000 7f4d61b23700 1 -- 172.21.15.61:0/2492275448 wait complete. 2023-01-01T17:40:18.274 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-01-01T17:40:18.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.398+0000 7fcff4cde700 1 Processor -- start 2023-01-01T17:40:18.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.398+0000 7fcff4cde700 1 -- start start 2023-01-01T17:40:18.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.399+0000 7fcff4cde700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcff0070810 0x7fcff006fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:18.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.399+0000 7fcff4cde700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fcff00a5270 0x7fcff00c2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:18.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.399+0000 7fcff4cde700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcff0150ad0 con 0x7fcff00715c0 2023-01-01T17:40:18.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.399+0000 7fcff4cde700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff00c3c30 con 0x7fcff00a5270 2023-01-01T17:40:18.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.399+0000 7fcff4cde700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff00c4120 con 0x7fcff0070810 2023-01-01T17:40:18.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.400+0000 7fcfee59c700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcff0070810 0x7fcff006fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:18.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.400+0000 7fcfeed9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fcff00a5270 0x7fcff00c2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:18.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.400+0000 7fcfee59c700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcff0070810 0x7fcff006fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3301/0 says I am v2:172.21.15.61:45282/0 (socket says 172.21.15.61:45282) 2023-01-01T17:40:18.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.400+0000 7fcfee59c700 1 -- 172.21.15.61:0/3862157451 learned_addr learned my addr 172.21.15.61:0/3862157451 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:18.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.400+0000 7fcfeed9d700 1 --2- 172.21.15.61:0/3862157451 >> v2:172.21.15.149:3300/0 conn(0x7fcff00a5270 0x7fcff00c2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.61:42882/0 (socket says 172.21.15.61:42882) 2023-01-01T17:40:18.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.400+0000 7fcfedd9b700 1 --1- 172.21.15.61:0/3862157451 >> v1:172.21.15.149:6789/0 conn(0x7fcff00715c0 0x7fcff00c06b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.61:49366/0 (socket says 172.21.15.61:49366) 2023-01-01T17:40:18.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.400+0000 7fcfeed9d700 1 -- 172.21.15.61:0/3862157451 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcff0070810 msgr2=0x7fcff006fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:18.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.400+0000 7fcfeed9d700 1 --2- 172.21.15.61:0/3862157451 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcff0070810 0x7fcff006fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:18.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.400+0000 7fcfeed9d700 1 -- 172.21.15.61:0/3862157451 >> v1:172.21.15.149:6789/0 conn(0x7fcff00715c0 legacy=0x7fcff00c06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:18.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.400+0000 7fcfeed9d700 1 -- 172.21.15.61:0/3862157451 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff00c2f80 con 0x7fcff00a5270 2023-01-01T17:40:18.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.400+0000 7fcfed59a700 1 -- 172.21.15.61:0/3862157451 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2540494558 0 0) 0x7fcff0150ad0 con 0x7fcff00715c0 2023-01-01T17:40:18.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.400+0000 7fcfeed9d700 1 --2- 172.21.15.61:0/3862157451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcff00a5270 0x7fcff00c2240 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8009d90 tx=0x7fcfe800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c3a972ba44c9bec server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:18.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.400+0000 7fcfed59a700 1 -- 172.21.15.61:0/3862157451 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe800e070 con 0x7fcff00a5270 2023-01-01T17:40:18.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.400+0000 7fcfed59a700 1 -- 172.21.15.61:0/3862157451 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe800bb20 con 0x7fcff00a5270 2023-01-01T17:40:18.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.400+0000 7fcfed59a700 1 -- 172.21.15.61:0/3862157451 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8012430 con 0x7fcff00a5270 2023-01-01T17:40:18.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.401+0000 7fcff4cde700 1 -- 172.21.15.61:0/3862157451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcff00a5270 msgr2=0x7fcff00c2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:18.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.401+0000 7fcff4cde700 1 --2- 172.21.15.61:0/3862157451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcff00a5270 0x7fcff00c2240 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8009d90 tx=0x7fcfe800b330 comp rx=0 tx=0).stop 2023-01-01T17:40:18.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.401+0000 7fcff4cde700 1 -- 172.21.15.61:0/3862157451 shutdown_connections 2023-01-01T17:40:18.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.401+0000 7fcff4cde700 1 --2- 172.21.15.61:0/3862157451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcff00a5270 0x7fcff00c2240 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:18.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.401+0000 7fcff4cde700 1 --2- 172.21.15.61:0/3862157451 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcff0070810 0x7fcff006fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:18.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.401+0000 7fcff4cde700 1 -- 172.21.15.61:0/3862157451 >> 172.21.15.61:0/3862157451 conn(0x7fcff006b100 msgr2=0x7fcff00c5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:18.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.401+0000 7fcff4cde700 1 -- 172.21.15.61:0/3862157451 shutdown_connections 2023-01-01T17:40:18.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.401+0000 7fcff4cde700 1 -- 172.21.15.61:0/3862157451 wait complete. 2023-01-01T17:40:18.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.402+0000 7fcff4cde700 1 Processor -- start 2023-01-01T17:40:18.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.402+0000 7fcff4cde700 1 -- start start 2023-01-01T17:40:18.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.403+0000 7fcff4cde700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcff0070810 0x7fcff00c4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:18.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.403+0000 7fcff4cde700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcff00715c0 0x7fcff00aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:18.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.403+0000 7fcff4cde700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcff00a5270 0x7fcff00ab480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:18.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.403+0000 7fcff4cde700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff0147120 con 0x7fcff00a5270 2023-01-01T17:40:18.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.403+0000 7fcff4cde700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff00a70e0 con 0x7fcff0070810 2023-01-01T17:40:18.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.403+0000 7fcff4cde700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff00a9d90 con 0x7fcff00715c0 2023-01-01T17:40:18.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.403+0000 7fcfeed9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcff00a5270 0x7fcff00ab480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:18.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.403+0000 7fcfeed9d700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcff00a5270 0x7fcff00ab480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47050/0 (socket says 172.21.15.61:47050) 2023-01-01T17:40:18.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.403+0000 7fcfeed9d700 1 -- 172.21.15.61:0/1710950528 learned_addr learned my addr 172.21.15.61:0/1710950528 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:18.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.403+0000 7fcfedd9b700 1 --2- 172.21.15.61:0/1710950528 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcff00715c0 0x7fcff00aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:18.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.403+0000 7fcfee59c700 1 --2- 172.21.15.61:0/1710950528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcff0070810 0x7fcff00c4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:18.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.403+0000 7fcfeed9d700 1 -- 172.21.15.61:0/1710950528 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcff00715c0 msgr2=0x7fcff00aaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:18.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.403+0000 7fcfeed9d700 1 --2- 172.21.15.61:0/1710950528 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcff00715c0 0x7fcff00aaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:18.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.403+0000 7fcfeed9d700 1 -- 172.21.15.61:0/1710950528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcff0070810 msgr2=0x7fcff00c4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:18.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.403+0000 7fcfeed9d700 1 --2- 172.21.15.61:0/1710950528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcff0070810 0x7fcff00c4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:18.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.403+0000 7fcfeed9d700 1 -- 172.21.15.61:0/1710950528 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe8009a70 con 0x7fcff00a5270 2023-01-01T17:40:18.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.404+0000 7fcfeed9d700 1 --2- 172.21.15.61:0/1710950528 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcff00a5270 0x7fcff00ab480 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcff00c6af0 tx=0x7fcfe8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:18.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.404+0000 7fcfdeffd700 1 -- 172.21.15.61:0/1710950528 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8012430 con 0x7fcff00a5270 2023-01-01T17:40:18.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.404+0000 7fcfdeffd700 1 -- 172.21.15.61:0/1710950528 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe8020070 con 0x7fcff00a5270 2023-01-01T17:40:18.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.404+0000 7fcff4cde700 1 -- 172.21.15.61:0/1710950528 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcff00c3e40 con 0x7fcff00a5270 2023-01-01T17:40:18.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.404+0000 7fcfdeffd700 1 -- 172.21.15.61:0/1710950528 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8004280 con 0x7fcff00a5270 2023-01-01T17:40:18.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.404+0000 7fcff4cde700 1 -- 172.21.15.61:0/1710950528 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcff00a4ec0 con 0x7fcff00a5270 2023-01-01T17:40:18.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.405+0000 7fcff4cde700 1 -- 172.21.15.61:0/1710950528 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcff0070be0 con 0x7fcff00a5270 2023-01-01T17:40:18.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.405+0000 7fcfdeffd700 1 -- 172.21.15.61:0/1710950528 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7fcfe80043e0 con 0x7fcff00a5270 2023-01-01T17:40:18.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.405+0000 7fcfdeffd700 1 --2- 172.21.15.61:0/1710950528 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fcfd0063290 0x7fcfd0065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:18.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.406+0000 7fcfdeffd700 1 -- 172.21.15.61:0/1710950528 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcfe8022070 con 0x7fcff00a5270 2023-01-01T17:40:18.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.406+0000 7fcfee59c700 1 --2- 172.21.15.61:0/1710950528 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fcfd0063290 0x7fcfd0065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:18.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.406+0000 7fcfee59c700 1 --2- 172.21.15.61:0/1710950528 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fcfd0063290 0x7fcfd0065740 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcfe400b240 tx=0x7fcfe400b4d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:18.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.410+0000 7fcfdeffd700 1 -- 172.21.15.61:0/1710950528 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7fcfe8050d60 con 0x7fcff00a5270 2023-01-01T17:40:18.644 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.644+0000 7fcff4cde700 1 -- 172.21.15.61:0/1710950528 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcff00668a0 con 0x7fcff00a5270 2023-01-01T17:40:18.645 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.644+0000 7fcfdeffd700 1 -- 172.21.15.61:0/1710950528 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4634 (secure 0 0 0) 0x7fcfe8054380 con 0x7fcff00a5270 2023-01-01T17:40:18.645 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-01-01T17:40:18.645 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/671276443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":671276443},{"type":"v1","addr":"172.21.15.149:6835","nonce":671276443}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.61:6836/1287782466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6834","nonce":1287782466},{"type":"v1","addr":"172.21.15.61:6836","nonce":1287782466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/594691675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":594691675},{"type":"v1","addr":"172.21.15.149:6833","nonce":594691675}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-01-01T17:39:52.938920+0000","modified":"2023-01-01T17:40:09.538397+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.61:6837/426398173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6835","nonce":426398173},{"type":"v1","addr":"172.21.15.61:6837","nonce":426398173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-01-01T17:40:18.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.646+0000 7fcff4cde700 1 -- 172.21.15.61:0/1710950528 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fcfd0063290 msgr2=0x7fcfd0065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:18.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.646+0000 7fcff4cde700 1 --2- 172.21.15.61:0/1710950528 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fcfd0063290 0x7fcfd0065740 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcfe400b240 tx=0x7fcfe400b4d0 comp rx=0 tx=0).stop 2023-01-01T17:40:18.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.646+0000 7fcff4cde700 1 -- 172.21.15.61:0/1710950528 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcff00a5270 msgr2=0x7fcff00ab480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:18.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.646+0000 7fcff4cde700 1 --2- 172.21.15.61:0/1710950528 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcff00a5270 0x7fcff00ab480 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcff00c6af0 tx=0x7fcfe8004ad0 comp rx=0 tx=0).stop 2023-01-01T17:40:18.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.646+0000 7fcff4cde700 1 -- 172.21.15.61:0/1710950528 shutdown_connections 2023-01-01T17:40:18.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.646+0000 7fcff4cde700 1 --2- 172.21.15.61:0/1710950528 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7fcfd0063290 0x7fcfd0065740 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:18.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.646+0000 7fcff4cde700 1 --2- 172.21.15.61:0/1710950528 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7fcff00a5270 0x7fcff00ab480 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:18.647 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.646+0000 7fcff4cde700 1 --2- 172.21.15.61:0/1710950528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcff0070810 0x7fcff00c4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:18.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.646+0000 7fcff4cde700 1 --2- 172.21.15.61:0/1710950528 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7fcff00715c0 0x7fcff00aaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:18.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.646+0000 7fcff4cde700 1 -- 172.21.15.61:0/1710950528 >> 172.21.15.61:0/1710950528 conn(0x7fcff006b100 msgr2=0x7fcff014b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:18.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.646+0000 7fcff4cde700 1 -- 172.21.15.61:0/1710950528 shutdown_connections 2023-01-01T17:40:18.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:18.646+0000 7fcff4cde700 1 -- 172.21.15.61:0/1710950528 wait complete. 2023-01-01T17:40:18.648 INFO:teuthology.orchestra.run.smithi061.stderr:dumped fsmap epoch 9 2023-01-01T17:40:19.061 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-01-01T17:39:52.938920+0000', 'modified': '2023-01-01T17:40:09.538397+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4291}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4291': {'gid': 4291, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.61:6837/426398173', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.61:6835', 'nonce': 426398173}, {'type': 'v1', 'addr': '172.21.15.61:6837', 'nonce': 426398173}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-01-01T17:40:19.062 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-01-01T17:40:19.062 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-01-01T17:40:19.195 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.191+0000 7f41225e6700 1 Processor -- start 2023-01-01T17:40:19.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.191+0000 7f41225e6700 1 -- start start 2023-01-01T17:40:19.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.191+0000 7f41225e6700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f411c06b030 0x7f411c0c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:19.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.191+0000 7f41225e6700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f411c0c9530 con 0x7f411c156490 2023-01-01T17:40:19.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.191+0000 7f41225e6700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f411c1530d0 con 0x7f411c153bb0 2023-01-01T17:40:19.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.191+0000 7f41225e6700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f411c0c9810 con 0x7f411c06b030 2023-01-01T17:40:19.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.192+0000 7f4120b83700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f411c156490 0x7f411c150230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:40908/0 (socket says 172.21.15.61:40908) 2023-01-01T17:40:19.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.192+0000 7f4120b83700 1 -- 172.21.15.61:0/2989199619 learned_addr learned my addr 172.21.15.61:0/2989199619 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:40:19.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.192+0000 7f411bfff700 1 --2- 172.21.15.61:0/2989199619 >> v2:172.21.15.149:3300/0 conn(0x7f411c06b030 0x7f411c0c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:19.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.192+0000 7f411affd700 1 -- 172.21.15.61:0/2989199619 <== mon.0 v1:172.21.15.61:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3799777532 0 0) 0x7f411c0c9530 con 0x7f411c156490 2023-01-01T17:40:19.196 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.192+0000 7f411affd700 1 -- 172.21.15.61:0/2989199619 --> v1:172.21.15.61:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41040035b0 con 0x7f411c156490 2023-01-01T17:40:19.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.192+0000 7f411affd700 1 -- 172.21.15.61:0/2989199619 <== mon.1 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1022577338 0 0) 0x7f411c1530d0 con 0x7f411c153bb0 2023-01-01T17:40:19.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.192+0000 7f411affd700 1 -- 172.21.15.61:0/2989199619 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f411c0c9530 con 0x7f411c153bb0 2023-01-01T17:40:19.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.192+0000 7f411bfff700 1 -- 172.21.15.61:0/2989199619 >> v1:172.21.15.149:6789/0 conn(0x7f411c153bb0 legacy=0x7f411c06b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:19.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.192+0000 7f411bfff700 1 -- 172.21.15.61:0/2989199619 >> v1:172.21.15.61:6789/0 conn(0x7f411c156490 legacy=0x7f411c150230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:19.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.192+0000 7f411affd700 1 -- 172.21.15.61:0/2989199619 <== mon.0 v1:172.21.15.61:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3459859888 0 0) 0x7f41040035b0 con 0x7f411c156490 2023-01-01T17:40:19.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.192+0000 7f411bfff700 1 -- 172.21.15.61:0/2989199619 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f411c1533b0 con 0x7f411c06b030 2023-01-01T17:40:19.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.192+0000 7f411bfff700 1 --2- 172.21.15.61:0/2989199619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f411c06b030 0x7f411c0c4ff0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f410c009840 tx=0x7f410c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2942acd08bb55364 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:19.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.193+0000 7f411affd700 1 -- 172.21.15.61:0/2989199619 <== mon.1 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41140019f0 con 0x7f411c06b030 2023-01-01T17:40:19.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.193+0000 7f411affd700 1 -- 172.21.15.61:0/2989199619 <== mon.1 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f410c004030 con 0x7f411c06b030 2023-01-01T17:40:19.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.193+0000 7f411affd700 1 -- 172.21.15.61:0/2989199619 <== mon.1 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410c0043c0 con 0x7f411c06b030 2023-01-01T17:40:19.197 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.193+0000 7f41225e6700 1 -- 172.21.15.61:0/2989199619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f411c06b030 msgr2=0x7f411c0c4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:19.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.193+0000 7f41225e6700 1 --2- 172.21.15.61:0/2989199619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f411c06b030 0x7f411c0c4ff0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f410c009840 tx=0x7f410c009b50 comp rx=0 tx=0).stop 2023-01-01T17:40:19.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.193+0000 7f41225e6700 1 -- 172.21.15.61:0/2989199619 shutdown_connections 2023-01-01T17:40:19.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.193+0000 7f41225e6700 1 --2- 172.21.15.61:0/2989199619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f411c06b030 0x7f411c0c4ff0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.193+0000 7f41225e6700 1 -- 172.21.15.61:0/2989199619 >> 172.21.15.61:0/2989199619 conn(0x7f411c070a90 msgr2=0x7f411c070e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:19.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.193+0000 7f41225e6700 1 -- 172.21.15.61:0/2989199619 shutdown_connections 2023-01-01T17:40:19.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.193+0000 7f41225e6700 1 -- 172.21.15.61:0/2989199619 wait complete. 2023-01-01T17:40:19.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.195+0000 7f41225e6700 1 Processor -- start 2023-01-01T17:40:19.198 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.195+0000 7f41225e6700 1 -- start start 2023-01-01T17:40:19.200 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.196+0000 7f41225e6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f411c06b030 0x7f411c1eb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:19.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.196+0000 7f41225e6700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f411c153bb0 0x7f411c1466e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:19.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.196+0000 7f41225e6700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f411c156490 0x7f411c1512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:19.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.196+0000 7f41225e6700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411c151dd0 con 0x7f411c156490 2023-01-01T17:40:19.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.196+0000 7f41225e6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411c14c800 con 0x7f411c06b030 2023-01-01T17:40:19.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.196+0000 7f41225e6700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411c0a9d30 con 0x7f411c153bb0 2023-01-01T17:40:19.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.196+0000 7f4120b83700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f411c156490 0x7f411c1512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:19.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.196+0000 7f4120b83700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f411c156490 0x7f411c1512d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47064/0 (socket says 172.21.15.61:47064) 2023-01-01T17:40:19.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.196+0000 7f4120b83700 1 -- 172.21.15.61:0/1914557604 learned_addr learned my addr 172.21.15.61:0/1914557604 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:19.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.196+0000 7f411b7fe700 1 --2- 172.21.15.61:0/1914557604 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f411c153bb0 0x7f411c1466e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:19.201 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.196+0000 7f411bfff700 1 --2- 172.21.15.61:0/1914557604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f411c06b030 0x7f411c1eb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:19.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.196+0000 7f4120b83700 1 -- 172.21.15.61:0/1914557604 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f411c153bb0 msgr2=0x7f411c1466e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:19.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.196+0000 7f4120b83700 1 --2- 172.21.15.61:0/1914557604 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f411c153bb0 0x7f411c1466e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.196+0000 7f4120b83700 1 -- 172.21.15.61:0/1914557604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f411c06b030 msgr2=0x7f411c1eb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:19.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.196+0000 7f4120b83700 1 --2- 172.21.15.61:0/1914557604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f411c06b030 0x7f411c1eb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.196+0000 7f4120b83700 1 -- 172.21.15.61:0/1914557604 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f410c0094a0 con 0x7f411c156490 2023-01-01T17:40:19.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.196+0000 7f4120b83700 1 --2- 172.21.15.61:0/1914557604 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f411c156490 0x7f411c1512d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f411400cc00 tx=0x7f411400cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:19.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.197+0000 7f4118ff9700 1 -- 172.21.15.61:0/1914557604 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411400aa20 con 0x7f411c156490 2023-01-01T17:40:19.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.197+0000 7f4118ff9700 1 -- 172.21.15.61:0/1914557604 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411400ab80 con 0x7f411c156490 2023-01-01T17:40:19.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.197+0000 7f41225e6700 1 -- 172.21.15.61:0/1914557604 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f411c0c9200 con 0x7f411c156490 2023-01-01T17:40:19.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.197+0000 7f4118ff9700 1 -- 172.21.15.61:0/1914557604 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41140070d0 con 0x7f411c156490 2023-01-01T17:40:19.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.197+0000 7f41225e6700 1 -- 172.21.15.61:0/1914557604 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f411c153690 con 0x7f411c156490 2023-01-01T17:40:19.202 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.198+0000 7f4118ff9700 1 -- 172.21.15.61:0/1914557604 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f411401a030 con 0x7f411c156490 2023-01-01T17:40:19.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.198+0000 7f4118ff9700 1 --2- 172.21.15.61:0/1914557604 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f4108063290 0x7f4108065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:19.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.199+0000 7f4118ff9700 1 -- 172.21.15.61:0/1914557604 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f411407f920 con 0x7f411c156490 2023-01-01T17:40:19.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.199+0000 7f411bfff700 1 --2- 172.21.15.61:0/1914557604 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f4108063290 0x7f4108065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:19.203 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.199+0000 7f411bfff700 1 --2- 172.21.15.61:0/1914557604 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f4108063290 0x7f4108065740 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f410c0090b0 tx=0x7f410c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:19.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.201+0000 7f412e760b80 1 Processor -- start 2023-01-01T17:40:19.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.201+0000 7f412e760b80 1 -- start start 2023-01-01T17:40:19.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.202+0000 7f412e760b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f7384c970 0x562f73857670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:19.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.202+0000 7f412e760b80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562f73813710 0x562f7384cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:19.205 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.202+0000 7f412e760b80 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f73810460 0x562f7384e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:19.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.202+0000 7f412e760b80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f7377c240 con 0x562f73813710 2023-01-01T17:40:19.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.202+0000 7f412e760b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f736fc170 con 0x562f7384c970 2023-01-01T17:40:19.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.202+0000 7f412e760b80 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x562f73769950 con 0x562f73810460 2023-01-01T17:40:19.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.202+0000 7f411b7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562f73813710 0x562f7384cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:19.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.202+0000 7f411b7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562f73813710 0x562f7384cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47070/0 (socket says 172.21.15.61:47070) 2023-01-01T17:40:19.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.202+0000 7f411b7fe700 1 -- 172.21.15.61:0/3201790320 learned_addr learned my addr 172.21.15.61:0/3201790320 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:19.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.202+0000 7f411bfff700 1 --2- 172.21.15.61:0/3201790320 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f7384c970 0x562f73857670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:19.206 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.202+0000 7f4120b83700 1 --2- 172.21.15.61:0/3201790320 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f73810460 0x562f7384e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:19.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.202+0000 7f411b7fe700 1 -- 172.21.15.61:0/3201790320 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f73810460 msgr2=0x562f7384e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:19.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.202+0000 7f411b7fe700 1 --2- 172.21.15.61:0/3201790320 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f73810460 0x562f7384e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.202+0000 7f411b7fe700 1 -- 172.21.15.61:0/3201790320 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f7384c970 msgr2=0x562f73857670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:19.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.202+0000 7f411b7fe700 1 --2- 172.21.15.61:0/3201790320 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f7384c970 0x562f73857670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.202+0000 7f411b7fe700 1 -- 172.21.15.61:0/3201790320 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f73788510 con 0x562f73813710 2023-01-01T17:40:19.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.202+0000 7f411b7fe700 1 --2- 172.21.15.61:0/3201790320 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562f73813710 0x562f7384cd40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4110001730 tx=0x7f4110007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f147c8f37aa33fc server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:19.212 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.202+0000 7f4101ffb700 1 -- 172.21.15.61:0/3201790320 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4110005320 con 0x562f73813710 2023-01-01T17:40:19.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.202+0000 7f4101ffb700 1 -- 172.21.15.61:0/3201790320 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4110005480 con 0x562f73813710 2023-01-01T17:40:19.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.202+0000 7f4101ffb700 1 -- 172.21.15.61:0/3201790320 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41100038a0 con 0x562f73813710 2023-01-01T17:40:19.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.203+0000 7f412e760b80 1 -- 172.21.15.61:0/3201790320 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562f73813710 msgr2=0x562f7384cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:19.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.203+0000 7f412e760b80 1 --2- 172.21.15.61:0/3201790320 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562f73813710 0x562f7384cd40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4110001730 tx=0x7f4110007db0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.203+0000 7f412e760b80 1 -- 172.21.15.61:0/3201790320 shutdown_connections 2023-01-01T17:40:19.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.203+0000 7f412e760b80 1 --2- 172.21.15.61:0/3201790320 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f73810460 0x562f7384e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.203+0000 7f412e760b80 1 --2- 172.21.15.61:0/3201790320 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f7384c970 0x562f73857670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.203+0000 7f412e760b80 1 --2- 172.21.15.61:0/3201790320 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562f73813710 0x562f7384cd40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.213 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.203+0000 7f412e760b80 1 -- 172.21.15.61:0/3201790320 >> 172.21.15.61:0/3201790320 conn(0x562f7380eb60 msgr2=0x562f7380fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:19.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.203+0000 7f412e760b80 1 -- 172.21.15.61:0/3201790320 shutdown_connections 2023-01-01T17:40:19.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.203+0000 7f412e760b80 1 -- 172.21.15.61:0/3201790320 wait complete. 2023-01-01T17:40:19.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.204+0000 7f412e760b80 1 -- start start 2023-01-01T17:40:19.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.204+0000 7f412e760b80 1 Processor -- start 2023-01-01T17:40:19.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.205+0000 7f412e760b80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562f73810460 0x562f73855980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:19.214 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.205+0000 7f412e760b80 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f73813710 0x562f7385e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:19.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.205+0000 7f412e760b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f7384c970 0x562f7382d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:19.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.205+0000 7f412e760b80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f73763030 con 0x562f73810460 2023-01-01T17:40:19.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.205+0000 7f412e760b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f735e88d0 con 0x562f7384c970 2023-01-01T17:40:19.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.205+0000 7f412e760b80 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x562f7385eaa0 con 0x562f73813710 2023-01-01T17:40:19.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.205+0000 7f412e760b80 10 client.0 _ll_register_callbacks cb 0x562f7370a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-01-01T17:40:19.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.205+0000 7f411bfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562f73810460 0x562f73855980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:19.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.205+0000 7f411bfff700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562f73810460 0x562f73855980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47074/0 (socket says 172.21.15.61:47074) 2023-01-01T17:40:19.216 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.205+0000 7f411bfff700 1 -- 172.21.15.61:0/643592186 learned_addr learned my addr 172.21.15.61:0/643592186 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:19.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.205+0000 7f411b7fe700 1 --2- 172.21.15.61:0/643592186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f73813710 0x562f7385e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:19.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.205+0000 7f4120b83700 1 --2- 172.21.15.61:0/643592186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f7384c970 0x562f7382d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:19.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.205+0000 7f411bfff700 1 -- 172.21.15.61:0/643592186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f73813710 msgr2=0x562f7385e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:19.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.205+0000 7f411bfff700 1 --2- 172.21.15.61:0/643592186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f73813710 0x562f7385e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.205+0000 7f411bfff700 1 -- 172.21.15.61:0/643592186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f7384c970 msgr2=0x562f7382d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:19.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.205+0000 7f411bfff700 1 --2- 172.21.15.61:0/643592186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f7384c970 0x562f7382d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.205+0000 7f411bfff700 1 -- 172.21.15.61:0/643592186 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f411c0c9530 con 0x562f73810460 2023-01-01T17:40:19.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.205+0000 7f411bfff700 1 --2- 172.21.15.61:0/643592186 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562f73810460 0x562f73855980 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f410c009ea0 tx=0x7f410c00e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=618ce8b2cdd04767 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:19.217 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.205+0000 7f40faffd700 10 client.0 ms_handle_connect on v2:172.21.15.61:3300/0 2023-01-01T17:40:19.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.205+0000 7f40faffd700 1 -- 172.21.15.61:0/643592186 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410c02b050 con 0x562f73810460 2023-01-01T17:40:19.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.205+0000 7f40faffd700 1 -- 172.21.15.61:0/643592186 <== mon.0 v2:172.21.15.61:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f410c003e20 con 0x562f73810460 2023-01-01T17:40:19.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.205+0000 7f412e760b80 1 -- 172.21.15.61:0/643592186 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562f738046b0 con 0x562f73810460 2023-01-01T17:40:19.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.206+0000 7f40faffd700 1 -- 172.21.15.61:0/643592186 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f410c020070 con 0x562f73810460 2023-01-01T17:40:19.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.206+0000 7f412e760b80 10 client.4764 fetch_fsmap learned FSMap version 9 2023-01-01T17:40:19.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.206+0000 7f412e760b80 1 -- 172.21.15.61:0/643592186 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x562f73592d90 con 0x562f73810460 2023-01-01T17:40:19.218 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.206+0000 7f40faffd700 1 -- 172.21.15.61:0/643592186 <== mon.0 v2:172.21.15.61:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562f738046b0 con 0x562f73810460 2023-01-01T17:40:19.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.206+0000 7f40faffd700 1 -- 172.21.15.61:0/643592186 <== mon.0 v2:172.21.15.61:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f410c011630 con 0x562f73810460 2023-01-01T17:40:19.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.206+0000 7f412e760b80 10 client.4764 fetch_fsmap finished waiting for FSMap version 9 2023-01-01T17:40:19.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.206+0000 7f412e760b80 10 client.4764 resolve_mds: resolved name 'a' to daemon mds.a 2023-01-01T17:40:19.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.206+0000 7f412e760b80 20 client.4764 populate_metadata read hostname 'smithi061' 2023-01-01T17:40:19.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.206+0000 7f412e760b80 1 --2- 172.21.15.61:0/643592186 >> [v2:172.21.15.61:6835/426398173,v1:172.21.15.61:6837/426398173] conn(0x562f7382d790 0x562f738610f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:19.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.206+0000 7f412e760b80 4 client.4764 mds_command: new command op to 4291 tid=0[{"prefix": "get_command_descriptions"}] 2023-01-01T17:40:19.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.206+0000 7f412e760b80 1 -- 172.21.15.61:0/643592186 --> [v2:172.21.15.61:6835/426398173,v1:172.21.15.61:6837/426398173] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562f7375c0b0 con 0x562f7382d790 2023-01-01T17:40:19.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.206+0000 7f411b7fe700 1 --2- 172.21.15.61:0/643592186 >> [v2:172.21.15.61:6835/426398173,v1:172.21.15.61:6837/426398173] conn(0x562f7382d790 0x562f738610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:19.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.206+0000 7f40faffd700 10 client.4764 ms_handle_connect on v2:172.21.15.61:6835/426398173 2023-01-01T17:40:19.219 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.206+0000 7f411b7fe700 1 --2- 172.21.15.61:0/643592186 >> [v2:172.21.15.61:6835/426398173,v1:172.21.15.61:6837/426398173] conn(0x562f7382d790 0x562f738610f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76c103c618bb2b4a server_cookie=68ccf44fac450139 in_seq=0 out_seq=0 2023-01-01T17:40:19.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.207+0000 7f40faffd700 1 -- 172.21.15.61:0/643592186 <== mds.0 v2:172.21.15.61:6835/426398173 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17527 (crc 0 0 0) 0x562f7375c0b0 con 0x562f7382d790 2023-01-01T17:40:19.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.207+0000 7f40faffd700 10 client.4764 handle_command_reply: tid=0 2023-01-01T17:40:19.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.207+0000 7f412e760b80 1 client.4764 shutdown 2023-01-01T17:40:19.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.207+0000 7f412e760b80 1 -- 172.21.15.61:0/643592186 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562f73810460 msgr2=0x562f73855980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:19.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.207+0000 7f412e760b80 1 --2- 172.21.15.61:0/643592186 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562f73810460 0x562f73855980 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f410c009ea0 tx=0x7f410c00e000 comp rx=0 tx=0).stop 2023-01-01T17:40:19.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.207+0000 7f412e760b80 1 -- 172.21.15.61:0/643592186 shutdown_connections 2023-01-01T17:40:19.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.207+0000 7f412e760b80 1 --2- 172.21.15.61:0/643592186 >> [v2:172.21.15.61:6835/426398173,v1:172.21.15.61:6837/426398173] conn(0x562f7382d790 0x562f738610f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.207+0000 7f412e760b80 1 --2- 172.21.15.61:0/643592186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f7384c970 0x562f7382d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.207+0000 7f412e760b80 1 --2- 172.21.15.61:0/643592186 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562f73810460 0x562f73855980 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.207+0000 7f40faffd700 0 client.4764 ms_handle_reset on v2:172.21.15.61:6835/426398173 2023-01-01T17:40:19.220 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.207+0000 7f412e760b80 1 --2- 172.21.15.61:0/643592186 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f73813710 0x562f7385e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.207+0000 7f412e760b80 1 -- 172.21.15.61:0/643592186 >> 172.21.15.61:0/643592186 conn(0x562f7380eb60 msgr2=0x562f7384e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:19.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.207+0000 7f412e760b80 1 -- 172.21.15.61:0/643592186 shutdown_connections 2023-01-01T17:40:19.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.207+0000 7f412e760b80 1 -- 172.21.15.61:0/643592186 wait complete. 2023-01-01T17:40:19.221 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.207+0000 7f412e760b80 20 client.4764 trim_cache size 0 max 16384 2023-01-01T17:40:19.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.225+0000 7f412e760b80 1 Processor -- start 2023-01-01T17:40:19.225 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.225+0000 7f412e760b80 1 -- start start 2023-01-01T17:40:19.227 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.225+0000 7f412e760b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f73810460 0x562f738500a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:19.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.225+0000 7f412e760b80 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f73813710 0x562f73836790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:19.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.225+0000 7f412e760b80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562f7384c970 0x562f73836cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:19.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.225+0000 7f412e760b80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f73812590 con 0x562f7384c970 2023-01-01T17:40:19.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.225+0000 7f412e760b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f7380df60 con 0x562f73810460 2023-01-01T17:40:19.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.225+0000 7f412e760b80 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x562f7382fb20 con 0x562f73813710 2023-01-01T17:40:19.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.225+0000 7f4120b83700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562f7384c970 0x562f73836cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:19.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.225+0000 7f4120b83700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562f7384c970 0x562f73836cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47086/0 (socket says 172.21.15.61:47086) 2023-01-01T17:40:19.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.225+0000 7f4120b83700 1 -- 172.21.15.61:0/3239871067 learned_addr learned my addr 172.21.15.61:0/3239871067 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:19.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.226+0000 7f411bfff700 1 --2- 172.21.15.61:0/3239871067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f73810460 0x562f738500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:19.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.226+0000 7f411b7fe700 1 --2- 172.21.15.61:0/3239871067 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f73813710 0x562f73836790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:19.228 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.226+0000 7f4120b83700 1 -- 172.21.15.61:0/3239871067 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f73813710 msgr2=0x562f73836790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:19.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.226+0000 7f4120b83700 1 --2- 172.21.15.61:0/3239871067 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f73813710 0x562f73836790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.226+0000 7f4120b83700 1 -- 172.21.15.61:0/3239871067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f73810460 msgr2=0x562f738500a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:19.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.226+0000 7f4120b83700 1 --2- 172.21.15.61:0/3239871067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f73810460 0x562f738500a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.226+0000 7f4120b83700 1 -- 172.21.15.61:0/3239871067 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f73870a20 con 0x562f7384c970 2023-01-01T17:40:19.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.226+0000 7f4120b83700 1 --2- 172.21.15.61:0/3239871067 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562f7384c970 0x562f73836cd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f411407dcc0 tx=0x7f4114009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=128d3e9123d89d98 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:19.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.226+0000 7f41027fc700 1 -- 172.21.15.61:0/3239871067 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41140592e0 con 0x562f7384c970 2023-01-01T17:40:19.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.226+0000 7f41027fc700 1 -- 172.21.15.61:0/3239871067 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4114059440 con 0x562f7384c970 2023-01-01T17:40:19.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.226+0000 7f41027fc700 1 -- 172.21.15.61:0/3239871067 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41140595b0 con 0x562f7384c970 2023-01-01T17:40:19.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.226+0000 7f412e760b80 1 -- 172.21.15.61:0/3239871067 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562f7384c970 msgr2=0x562f73836cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:19.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.226+0000 7f412e760b80 1 --2- 172.21.15.61:0/3239871067 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562f7384c970 0x562f73836cd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f411407dcc0 tx=0x7f4114009040 comp rx=0 tx=0).stop 2023-01-01T17:40:19.229 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.226+0000 7f412e760b80 1 -- 172.21.15.61:0/3239871067 shutdown_connections 2023-01-01T17:40:19.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.226+0000 7f412e760b80 1 --2- 172.21.15.61:0/3239871067 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562f7384c970 0x562f73836cd0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.226+0000 7f412e760b80 1 --2- 172.21.15.61:0/3239871067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f73810460 0x562f738500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.226+0000 7f412e760b80 1 --2- 172.21.15.61:0/3239871067 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f73813710 0x562f73836790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.226+0000 7f412e760b80 1 -- 172.21.15.61:0/3239871067 >> 172.21.15.61:0/3239871067 conn(0x562f7380eb60 msgr2=0x562f7384b260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:19.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.227+0000 7f412e760b80 1 -- 172.21.15.61:0/3239871067 shutdown_connections 2023-01-01T17:40:19.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.227+0000 7f412e760b80 1 -- 172.21.15.61:0/3239871067 wait complete. 2023-01-01T17:40:19.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.227+0000 7f412e760b80 1 -- start start 2023-01-01T17:40:19.230 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.227+0000 7f412e760b80 1 Processor -- start 2023-01-01T17:40:19.233 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.228+0000 7f412e760b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f73810460 0x562f73811a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:19.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.228+0000 7f412e760b80 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562f73813710 0x562f738b6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:19.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.228+0000 7f412e760b80 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f7384c970 0x562f73850dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:19.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.228+0000 7f412e760b80 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f738b7100 con 0x562f73813710 2023-01-01T17:40:19.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.228+0000 7f412e760b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f738444d0 con 0x562f73810460 2023-01-01T17:40:19.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.228+0000 7f412e760b80 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x562f7384f080 con 0x562f7384c970 2023-01-01T17:40:19.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.228+0000 7f412e760b80 10 client.0 _ll_register_callbacks cb 0x7f410c004470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-01-01T17:40:19.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.228+0000 7f411b7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562f73813710 0x562f738b6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:19.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.228+0000 7f411b7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562f73813710 0x562f738b6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47090/0 (socket says 172.21.15.61:47090) 2023-01-01T17:40:19.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.228+0000 7f411b7fe700 1 -- 172.21.15.61:0/2542803432 learned_addr learned my addr 172.21.15.61:0/2542803432 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:19.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.228+0000 7f411bfff700 1 --2- 172.21.15.61:0/2542803432 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f73810460 0x562f73811a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:19.234 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.228+0000 7f4120b83700 1 --2- 172.21.15.61:0/2542803432 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f7384c970 0x562f73850dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:19.235 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.228+0000 7f411b7fe700 1 -- 172.21.15.61:0/2542803432 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f7384c970 msgr2=0x562f73850dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:19.235 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.228+0000 7f411b7fe700 1 --2- 172.21.15.61:0/2542803432 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f7384c970 0x562f73850dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.235 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.228+0000 7f411b7fe700 1 -- 172.21.15.61:0/2542803432 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f73810460 msgr2=0x562f73811a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:19.235 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.228+0000 7f411b7fe700 1 --2- 172.21.15.61:0/2542803432 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f73810460 0x562f73811a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.235 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.228+0000 7f411b7fe700 1 -- 172.21.15.61:0/2542803432 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f411c153690 con 0x562f73813710 2023-01-01T17:40:19.235 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.229+0000 7f411b7fe700 1 --2- 172.21.15.61:0/2542803432 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562f73813710 0x562f738b6800 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4110001200 tx=0x7f4110000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b7467e120d1edc server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:19.235 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.229+0000 7f40faffd700 10 client.0 ms_handle_connect on v2:172.21.15.61:3300/0 2023-01-01T17:40:19.235 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.229+0000 7f40faffd700 1 -- 172.21.15.61:0/2542803432 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4110027070 con 0x562f73813710 2023-01-01T17:40:19.235 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.229+0000 7f40faffd700 1 -- 172.21.15.61:0/2542803432 <== mon.0 v2:172.21.15.61:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4110007a70 con 0x562f73813710 2023-01-01T17:40:19.235 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.229+0000 7f412e760b80 1 -- 172.21.15.61:0/2542803432 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4110005480 con 0x562f73813710 2023-01-01T17:40:19.235 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.229+0000 7f40faffd700 1 -- 172.21.15.61:0/2542803432 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4110006860 con 0x562f73813710 2023-01-01T17:40:19.236 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.229+0000 7f412e760b80 10 client.4770 fetch_fsmap learned FSMap version 9 2023-01-01T17:40:19.236 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.229+0000 7f412e760b80 1 -- 172.21.15.61:0/2542803432 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x562f7357bc10 con 0x562f73813710 2023-01-01T17:40:19.236 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.229+0000 7f40faffd700 1 -- 172.21.15.61:0/2542803432 <== mon.0 v2:172.21.15.61:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4110005480 con 0x562f73813710 2023-01-01T17:40:19.236 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.229+0000 7f40faffd700 1 -- 172.21.15.61:0/2542803432 <== mon.0 v2:172.21.15.61:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f4110001760 con 0x562f73813710 2023-01-01T17:40:19.236 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.229+0000 7f412e760b80 10 client.4770 fetch_fsmap finished waiting for FSMap version 9 2023-01-01T17:40:19.236 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.229+0000 7f412e760b80 10 client.4770 resolve_mds: resolved name 'a' to daemon mds.a 2023-01-01T17:40:19.236 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.229+0000 7f412e760b80 20 client.4770 populate_metadata read hostname 'smithi061' 2023-01-01T17:40:19.236 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.229+0000 7f412e760b80 1 --2- 172.21.15.61:0/2542803432 >> [v2:172.21.15.61:6835/426398173,v1:172.21.15.61:6837/426398173] conn(0x562f73851310 0x562f738516e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:19.236 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.229+0000 7f412e760b80 4 client.4770 mds_command: new command op to 4291 tid=0[{"prefix": "status"}] 2023-01-01T17:40:19.236 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.229+0000 7f412e760b80 1 -- 172.21.15.61:0/2542803432 --> [v2:172.21.15.61:6835/426398173,v1:172.21.15.61:6837/426398173] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562f7375bdd0 con 0x562f73851310 2023-01-01T17:40:19.236 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.229+0000 7f411bfff700 1 --2- 172.21.15.61:0/2542803432 >> [v2:172.21.15.61:6835/426398173,v1:172.21.15.61:6837/426398173] conn(0x562f73851310 0x562f738516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:19.236 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.229+0000 7f40faffd700 10 client.4770 ms_handle_connect on v2:172.21.15.61:6835/426398173 2023-01-01T17:40:19.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.230+0000 7f411bfff700 1 --2- 172.21.15.61:0/2542803432 >> [v2:172.21.15.61:6835/426398173,v1:172.21.15.61:6837/426398173] conn(0x562f73851310 0x562f738516e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfe3871da5ecded1 server_cookie=3fb04b489f7ce2bb in_seq=0 out_seq=0 2023-01-01T17:40:19.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.230+0000 7f40faffd700 1 -- 172.21.15.61:0/2542803432 <== mds.0 v2:172.21.15.61:6835/426398173 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x562f7375bdd0 con 0x562f73851310 2023-01-01T17:40:19.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.230+0000 7f40faffd700 10 client.4770 handle_command_reply: tid=0 2023-01-01T17:40:19.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.230+0000 7f412e760b80 1 client.4770 shutdown 2023-01-01T17:40:19.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.230+0000 7f412e760b80 1 -- 172.21.15.61:0/2542803432 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562f73813710 msgr2=0x562f738b6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:19.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.230+0000 7f412e760b80 1 --2- 172.21.15.61:0/2542803432 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562f73813710 0x562f738b6800 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4110001200 tx=0x7f4110000ed0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.230+0000 7f412e760b80 1 -- 172.21.15.61:0/2542803432 shutdown_connections 2023-01-01T17:40:19.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.230+0000 7f412e760b80 1 --2- 172.21.15.61:0/2542803432 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x562f7384c970 0x562f73850dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.230+0000 7f412e760b80 1 --2- 172.21.15.61:0/2542803432 >> [v2:172.21.15.61:6835/426398173,v1:172.21.15.61:6837/426398173] conn(0x562f73851310 0x562f738516e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.230+0000 7f412e760b80 1 --2- 172.21.15.61:0/2542803432 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x562f73810460 0x562f73811a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.237 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.230+0000 7f412e760b80 1 --2- 172.21.15.61:0/2542803432 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x562f73813710 0x562f738b6800 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.230+0000 7f40faffd700 0 client.4770 ms_handle_reset on v2:172.21.15.61:6835/426398173 2023-01-01T17:40:19.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.230+0000 7f412e760b80 1 -- 172.21.15.61:0/2542803432 >> 172.21.15.61:0/2542803432 conn(0x562f7380eb60 msgr2=0x562f73836790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:19.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.230+0000 7f412e760b80 1 -- 172.21.15.61:0/2542803432 shutdown_connections 2023-01-01T17:40:19.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.230+0000 7f412e760b80 1 -- 172.21.15.61:0/2542803432 wait complete. 2023-01-01T17:40:19.238 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.230+0000 7f412e760b80 20 client.4770 trim_cache size 0 max 16384 2023-01-01T17:40:19.238 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-01-01T17:40:19.238 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster_fsid": "fe0d3d8e-46ee-4ed9-92f8-749741721d01", 2023-01-01T17:40:19.238 INFO:teuthology.orchestra.run.smithi061.stdout: "whoami": 0, 2023-01-01T17:40:19.238 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 4291, 2023-01-01T17:40:19.239 INFO:teuthology.orchestra.run.smithi061.stdout: "want_state": "up:active", 2023-01-01T17:40:19.239 INFO:teuthology.orchestra.run.smithi061.stdout: "state": "up:active", 2023-01-01T17:40:19.239 INFO:teuthology.orchestra.run.smithi061.stdout: "fs_name": "cephfs", 2023-01-01T17:40:19.239 INFO:teuthology.orchestra.run.smithi061.stdout: "rank_uptime": 26.290101263, 2023-01-01T17:40:19.239 INFO:teuthology.orchestra.run.smithi061.stdout: "mdsmap_epoch": 9, 2023-01-01T17:40:19.239 INFO:teuthology.orchestra.run.smithi061.stdout: "osdmap_epoch": 24, 2023-01-01T17:40:19.239 INFO:teuthology.orchestra.run.smithi061.stdout: "osdmap_epoch_barrier": 24, 2023-01-01T17:40:19.239 INFO:teuthology.orchestra.run.smithi061.stdout: "uptime": 31.799125020999998 2023-01-01T17:40:19.239 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-01-01T17:40:19.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.231+0000 7f41225e6700 1 -- 172.21.15.61:0/1914557604 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f4108063290 msgr2=0x7f4108065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:19.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.231+0000 7f41225e6700 1 --2- 172.21.15.61:0/1914557604 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f4108063290 0x7f4108065740 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f410c0090b0 tx=0x7f410c008030 comp rx=0 tx=0).stop 2023-01-01T17:40:19.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.231+0000 7f41225e6700 1 -- 172.21.15.61:0/1914557604 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f411c156490 msgr2=0x7f411c1512d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:19.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.231+0000 7f41225e6700 1 --2- 172.21.15.61:0/1914557604 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f411c156490 0x7f411c1512d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f411400cc00 tx=0x7f411400cf10 comp rx=0 tx=0).stop 2023-01-01T17:40:19.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.231+0000 7f41225e6700 1 -- 172.21.15.61:0/1914557604 shutdown_connections 2023-01-01T17:40:19.240 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.231+0000 7f41225e6700 1 --2- 172.21.15.61:0/1914557604 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f4108063290 0x7f4108065740 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.231+0000 7f41225e6700 1 --2- 172.21.15.61:0/1914557604 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f411c156490 0x7f411c1512d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.231+0000 7f41225e6700 1 --2- 172.21.15.61:0/1914557604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f411c06b030 0x7f411c1eb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.231+0000 7f41225e6700 1 --2- 172.21.15.61:0/1914557604 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f411c153bb0 0x7f411c1466e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.231+0000 7f41225e6700 1 -- 172.21.15.61:0/1914557604 >> 172.21.15.61:0/1914557604 conn(0x7f411c070a90 msgr2=0x7f411c155790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:19.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.231+0000 7f41225e6700 1 -- 172.21.15.61:0/1914557604 shutdown_connections 2023-01-01T17:40:19.241 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.231+0000 7f41225e6700 1 -- 172.21.15.61:0/1914557604 wait complete. 2023-01-01T17:40:19.243 INFO:teuthology.run_tasks:Running task parallel... 2023-01-01T17:40:19.253 INFO:teuthology.task.parallel:starting parallel... 2023-01-01T17:40:19.254 INFO:teuthology.task.parallel:In parallel, running task sequential... 2023-01-01T17:40:19.255 INFO:teuthology.task.sequential:In sequential, running task ceph-fuse... 2023-01-01T17:40:19.257 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-01-01T17:40:19.257 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-01-01T17:40:19.258 INFO:tasks.ceph_fuse:client.0 config is {} 2023-01-01T17:40:19.258 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-01-01T17:40:19.258 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-01-01T17:40:19.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:19.258 DEBUG:teuthology.orchestra.run.smithi061:> ip netns list 2023-01-01T17:40:19.259 INFO:teuthology.task.parallel:In parallel, running task sequential... 2023-01-01T17:40:19.259 INFO:teuthology.task.sequential:In sequential, running task kclient... 2023-01-01T17:40:19.262 INFO:tasks.kclient:Mounting kernel clients... 2023-01-01T17:40:19.263 INFO:tasks.kclient:config is {'client.1': {}} 2023-01-01T17:40:19.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:19.263 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2023-01-01T17:40:19.280 INFO:teuthology.orchestra.run.smithi061.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-01-01T17:40:19.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:19.281 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-01-01T17:40:19.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:19.284 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link delete ceph-brx 2023-01-01T17:40:19.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:19.357 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip link delete ceph-brx 2023-01-01T17:40:19.357 INFO:teuthology.orchestra.run.smithi149.stderr:Cannot find device "ceph-brx" 2023-01-01T17:40:19.358 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-01T17:40:19.359 INFO:tasks.kclient:client.1 config is {} 2023-01-01T17:40:19.359 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-01-01T17:40:19.359 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-01-01T17:40:19.359 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-01-01T17:40:19.475 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-01-01T17:40:19.475 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-01-01T17:40:19.543 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.543+0000 7f1e852fe700 1 Processor -- start 2023-01-01T17:40:19.544 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.543+0000 7f1e852fe700 1 -- start start 2023-01-01T17:40:19.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.544+0000 7f1e852fe700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1e80150280 0x7f1e8006a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:19.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.544+0000 7f1e852fe700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e800c1a70 0x7f1e800bfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:19.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.544+0000 7f1e852fe700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e8006f1e0 con 0x7f1e8006a8b0 2023-01-01T17:40:19.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.544+0000 7f1e852fe700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e80152d40 con 0x7f1e80150280 2023-01-01T17:40:19.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.544+0000 7f1e852fe700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e80071950 con 0x7f1e800c1a70 2023-01-01T17:40:19.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.544+0000 7f1e7effd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1e80150280 0x7f1e8006a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:19.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.544+0000 7f1e7effd700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7f1e80150280 0x7f1e8006a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47096/0 (socket says 172.21.15.61:47096) 2023-01-01T17:40:19.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.544+0000 7f1e7effd700 1 -- 172.21.15.61:0/2682026127 learned_addr learned my addr 172.21.15.61:0/2682026127 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:19.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.544+0000 7f1e7e7fc700 1 --2- 172.21.15.61:0/2682026127 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e800c1a70 0x7f1e800bfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:19.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.544+0000 7f1e7effd700 1 -- 172.21.15.61:0/2682026127 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e800c1a70 msgr2=0x7f1e800bfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:19.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.544+0000 7f1e7effd700 1 --2- 172.21.15.61:0/2682026127 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e800c1a70 0x7f1e800bfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.544+0000 7f1e7effd700 1 -- 172.21.15.61:0/2682026127 >> v1:172.21.15.149:6789/0 conn(0x7f1e8006a8b0 legacy=0x7f1e80156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:19.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.544+0000 7f1e7effd700 1 -- 172.21.15.61:0/2682026127 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8006f710 con 0x7f1e80150280 2023-01-01T17:40:19.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.544+0000 7f1e7e7fc700 1 --2- 172.21.15.61:0/2682026127 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e800c1a70 0x7f1e800bfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-01-01T17:40:19.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.545+0000 7f1e7effd700 1 --2- 172.21.15.61:0/2682026127 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1e80150280 0x7f1e8006a370 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1e700098f0 tx=0x7f1e70009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27d4d0176a00d973 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:19.548 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.545+0000 7f1e7dffb700 1 -- 172.21.15.61:0/2682026127 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7000b8a0 con 0x7f1e80150280 2023-01-01T17:40:19.548 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.545+0000 7f1e7dffb700 1 -- 172.21.15.61:0/2682026127 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7000ba00 con 0x7f1e80150280 2023-01-01T17:40:19.548 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.545+0000 7f1e7dffb700 1 -- 172.21.15.61:0/2682026127 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7000bd90 con 0x7f1e80150280 2023-01-01T17:40:19.548 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.545+0000 7f1e852fe700 1 -- 172.21.15.61:0/2682026127 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1e80150280 msgr2=0x7f1e8006a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:19.548 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.545+0000 7f1e852fe700 1 --2- 172.21.15.61:0/2682026127 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1e80150280 0x7f1e8006a370 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1e700098f0 tx=0x7f1e70009c00 comp rx=0 tx=0).stop 2023-01-01T17:40:19.548 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.545+0000 7f1e852fe700 1 -- 172.21.15.61:0/2682026127 shutdown_connections 2023-01-01T17:40:19.548 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.545+0000 7f1e852fe700 1 --2- 172.21.15.61:0/2682026127 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1e80150280 0x7f1e8006a370 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.548 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.545+0000 7f1e852fe700 1 --2- 172.21.15.61:0/2682026127 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e800c1a70 0x7f1e800bfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.548 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.545+0000 7f1e852fe700 1 -- 172.21.15.61:0/2682026127 >> 172.21.15.61:0/2682026127 conn(0x7f1e800c1f30 msgr2=0x7f1e800c2330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:19.548 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.546+0000 7f1e852fe700 1 -- 172.21.15.61:0/2682026127 shutdown_connections 2023-01-01T17:40:19.549 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.546+0000 7f1e852fe700 1 -- 172.21.15.61:0/2682026127 wait complete. 2023-01-01T17:40:19.551 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.547+0000 7f1e852fe700 1 Processor -- start 2023-01-01T17:40:19.551 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.547+0000 7f1e852fe700 1 -- start start 2023-01-01T17:40:19.552 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.548+0000 7f1e852fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e8006a8b0 0x7f1e800a8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:19.552 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.548+0000 7f1e852fe700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e800c1a70 0x7f1e8014ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:19.552 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.548+0000 7f1e852fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1e80150280 0x7f1e801eba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:19.552 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.548+0000 7f1e852fe700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e801457a0 con 0x7f1e80150280 2023-01-01T17:40:19.552 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.548+0000 7f1e852fe700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e800a8790 con 0x7f1e8006a8b0 2023-01-01T17:40:19.552 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.548+0000 7f1e852fe700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e800a8460 con 0x7f1e800c1a70 2023-01-01T17:40:19.552 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.548+0000 7f1e7f7fe700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1e80150280 0x7f1e801eba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:19.552 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.548+0000 7f1e7effd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e8006a8b0 0x7f1e800a8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:19.552 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.548+0000 7f1e7effd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e8006a8b0 0x7f1e800a8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.61:42938/0 (socket says 172.21.15.61:42938) 2023-01-01T17:40:19.552 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.548+0000 7f1e7effd700 1 -- 172.21.15.61:0/3351182903 learned_addr learned my addr 172.21.15.61:0/3351182903 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:19.553 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.548+0000 7f1e7e7fc700 1 --2- 172.21.15.61:0/3351182903 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e800c1a70 0x7f1e8014ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:19.553 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.548+0000 7f1e7f7fe700 1 -- 172.21.15.61:0/3351182903 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e800c1a70 msgr2=0x7f1e8014ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:19.553 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.548+0000 7f1e7f7fe700 1 --2- 172.21.15.61:0/3351182903 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e800c1a70 0x7f1e8014ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.553 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.548+0000 7f1e7f7fe700 1 -- 172.21.15.61:0/3351182903 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e8006a8b0 msgr2=0x7f1e800a8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:19.553 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.548+0000 7f1e7f7fe700 1 --2- 172.21.15.61:0/3351182903 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e8006a8b0 0x7f1e800a8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.553 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.548+0000 7f1e7f7fe700 1 -- 172.21.15.61:0/3351182903 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e70009550 con 0x7f1e80150280 2023-01-01T17:40:19.553 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.548+0000 7f1e7effd700 1 --2- 172.21.15.61:0/3351182903 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e8006a8b0 0x7f1e800a8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-01-01T17:40:19.553 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.548+0000 7f1e7e7fc700 1 --2- 172.21.15.61:0/3351182903 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e800c1a70 0x7f1e8014ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-01-01T17:40:19.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.548+0000 7f1e7f7fe700 1 --2- 172.21.15.61:0/3351182903 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1e80150280 0x7f1e801eba20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1e7800cae0 tx=0x7f1e7800cdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:19.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.549+0000 7f1e677fe700 1 -- 172.21.15.61:0/3351182903 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e78003c00 con 0x7f1e80150280 2023-01-01T17:40:19.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.549+0000 7f1e677fe700 1 -- 172.21.15.61:0/3351182903 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e78003d60 con 0x7f1e80150280 2023-01-01T17:40:19.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.549+0000 7f1e852fe700 1 -- 172.21.15.61:0/3351182903 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e80152f30 con 0x7f1e80150280 2023-01-01T17:40:19.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.549+0000 7f1e677fe700 1 -- 172.21.15.61:0/3351182903 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7800aa20 con 0x7f1e80150280 2023-01-01T17:40:19.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.549+0000 7f1e852fe700 1 -- 172.21.15.61:0/3351182903 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e8006f430 con 0x7f1e80150280 2023-01-01T17:40:19.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.550+0000 7f1e852fe700 1 -- 172.21.15.61:0/3351182903 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e801531f0 con 0x7f1e80150280 2023-01-01T17:40:19.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.551+0000 7f1e677fe700 1 -- 172.21.15.61:0/3351182903 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7f1e78010050 con 0x7f1e80150280 2023-01-01T17:40:19.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.551+0000 7f1e677fe700 1 --2- 172.21.15.61:0/3351182903 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f1e6c063290 0x7f1e6c065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:19.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.551+0000 7f1e677fe700 1 -- 172.21.15.61:0/3351182903 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1e7807fa30 con 0x7f1e80150280 2023-01-01T17:40:19.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.551+0000 7f1e7effd700 1 --2- 172.21.15.61:0/3351182903 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f1e6c063290 0x7f1e6c065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:19.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.552+0000 7f1e7effd700 1 --2- 172.21.15.61:0/3351182903 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f1e6c063290 0x7f1e6c065740 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1e801492d0 tx=0x7f1e70008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:19.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.556+0000 7f1e677fe700 1 -- 172.21.15.61:0/3351182903 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7f1e7804e7f0 con 0x7f1e80150280 2023-01-01T17:40:19.645 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.645+0000 7ffa94fe2700 1 Processor -- start 2023-01-01T17:40:19.645 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.645+0000 7ffa94fe2700 1 -- start start 2023-01-01T17:40:19.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.646+0000 7ffa94fe2700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ffa9006ebb0 0x7ffa900c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:19.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.646+0000 7ffa94fe2700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa9006dce0 0x7ffa90153650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:19.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.646+0000 7ffa94fe2700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa900c4f00 con 0x7ffa9006f3d0 2023-01-01T17:40:19.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.646+0000 7ffa94fe2700 1 -- --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa900c68c0 con 0x7ffa9006ebb0 2023-01-01T17:40:19.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.646+0000 7ffa94fe2700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa90152f20 con 0x7ffa9006dce0 2023-01-01T17:40:19.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.646+0000 7ffa8e59c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ffa9006ebb0 0x7ffa900c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:19.648 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.646+0000 7ffa8e59c700 1 --2- >> v2:172.21.15.61:3300/0 conn(0x7ffa9006ebb0 0x7ffa900c5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47110/0 (socket says 172.21.15.61:47110) 2023-01-01T17:40:19.649 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.646+0000 7ffa8e59c700 1 -- 172.21.15.61:0/1257327582 learned_addr learned my addr 172.21.15.61:0/1257327582 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:19.649 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.646+0000 7ffa8ed9d700 1 --2- 172.21.15.61:0/1257327582 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa9006dce0 0x7ffa90153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:19.649 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.646+0000 7ffa8e59c700 1 -- 172.21.15.61:0/1257327582 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa9006dce0 msgr2=0x7ffa90153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-01-01T17:40:19.649 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.646+0000 7ffa8e59c700 1 --2- 172.21.15.61:0/1257327582 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa9006dce0 0x7ffa90153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.649 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.646+0000 7ffa8e59c700 1 -- 172.21.15.61:0/1257327582 >> v1:172.21.15.149:6789/0 conn(0x7ffa9006f3d0 legacy=0x7ffa900a8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:19.649 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.646+0000 7ffa8e59c700 1 -- 172.21.15.61:0/1257327582 --> v2:172.21.15.61:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa901531c0 con 0x7ffa9006ebb0 2023-01-01T17:40:19.649 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.646+0000 7ffa8e59c700 1 --2- 172.21.15.61:0/1257327582 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffa9006ebb0 0x7ffa900c5b80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ffa800098f0 tx=0x7ffa80009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee8614e18f75347c server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:19.649 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.647+0000 7ffa8d59a700 1 -- 172.21.15.61:0/1257327582 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa80011830 con 0x7ffa9006ebb0 2023-01-01T17:40:19.649 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.647+0000 7ffa8d59a700 1 -- 172.21.15.61:0/1257327582 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa80011990 con 0x7ffa9006ebb0 2023-01-01T17:40:19.649 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.647+0000 7ffa8d59a700 1 -- 172.21.15.61:0/1257327582 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa80011d20 con 0x7ffa9006ebb0 2023-01-01T17:40:19.649 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.647+0000 7ffa94fe2700 1 -- 172.21.15.61:0/1257327582 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffa9006ebb0 msgr2=0x7ffa900c5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:19.650 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.647+0000 7ffa94fe2700 1 --2- 172.21.15.61:0/1257327582 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffa9006ebb0 0x7ffa900c5b80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ffa800098f0 tx=0x7ffa80009c00 comp rx=0 tx=0).stop 2023-01-01T17:40:19.650 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.647+0000 7ffa94fe2700 1 -- 172.21.15.61:0/1257327582 shutdown_connections 2023-01-01T17:40:19.650 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.647+0000 7ffa94fe2700 1 --2- 172.21.15.61:0/1257327582 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa9006dce0 0x7ffa90153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.650 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.647+0000 7ffa94fe2700 1 --2- 172.21.15.61:0/1257327582 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffa9006ebb0 0x7ffa900c5b80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.650 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.647+0000 7ffa94fe2700 1 -- 172.21.15.61:0/1257327582 >> 172.21.15.61:0/1257327582 conn(0x7ffa90069fa0 msgr2=0x7ffa900c6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:19.650 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.647+0000 7ffa94fe2700 1 -- 172.21.15.61:0/1257327582 shutdown_connections 2023-01-01T17:40:19.650 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.647+0000 7ffa94fe2700 1 -- 172.21.15.61:0/1257327582 wait complete. 2023-01-01T17:40:19.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.649+0000 7ffa94fe2700 1 Processor -- start 2023-01-01T17:40:19.652 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.649+0000 7ffa94fe2700 1 -- start start 2023-01-01T17:40:19.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.650+0000 7ffa94fe2700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffa9006dce0 0x7ffa900ac340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:19.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.650+0000 7ffa94fe2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa9006ebb0 0x7ffa900aad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:19.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.650+0000 7ffa94fe2700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa9006f3d0 0x7ffa90144ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:19.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.650+0000 7ffa94fe2700 1 -- --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa900aa880 con 0x7ffa9006dce0 2023-01-01T17:40:19.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.650+0000 7ffa94fe2700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa900a9c70 con 0x7ffa9006ebb0 2023-01-01T17:40:19.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.650+0000 7ffa94fe2700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa900a9f50 con 0x7ffa9006f3d0 2023-01-01T17:40:19.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.650+0000 7ffa8e59c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffa9006dce0 0x7ffa900ac340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:19.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.650+0000 7ffa8e59c700 1 --2- >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffa9006dce0 0x7ffa900ac340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.61:3300/0 says I am v2:172.21.15.61:47116/0 (socket says 172.21.15.61:47116) 2023-01-01T17:40:19.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.650+0000 7ffa8e59c700 1 -- 172.21.15.61:0/2937182606 learned_addr learned my addr 172.21.15.61:0/2937182606 (peer_addr_for_me v2:172.21.15.61:0/0) 2023-01-01T17:40:19.653 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.650+0000 7ffa8ed9d700 1 --2- 172.21.15.61:0/2937182606 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa9006f3d0 0x7ffa90144ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:19.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.650+0000 7ffa8dd9b700 1 --2- 172.21.15.61:0/2937182606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa9006ebb0 0x7ffa900aad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:19.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.650+0000 7ffa8e59c700 1 -- 172.21.15.61:0/2937182606 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa9006f3d0 msgr2=0x7ffa90144ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:19.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.650+0000 7ffa8e59c700 1 --2- 172.21.15.61:0/2937182606 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa9006f3d0 0x7ffa90144ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.650+0000 7ffa8e59c700 1 -- 172.21.15.61:0/2937182606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa9006ebb0 msgr2=0x7ffa900aad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:19.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.650+0000 7ffa8e59c700 1 --2- 172.21.15.61:0/2937182606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa9006ebb0 0x7ffa900aad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.650+0000 7ffa8e59c700 1 -- 172.21.15.61:0/2937182606 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa80009550 con 0x7ffa9006dce0 2023-01-01T17:40:19.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.650+0000 7ffa8ed9d700 1 --2- 172.21.15.61:0/2937182606 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa9006f3d0 0x7ffa90144ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-01-01T17:40:19.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.651+0000 7ffa8e59c700 1 --2- 172.21.15.61:0/2937182606 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffa9006dce0 0x7ffa900ac340 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ffa80000c00 tx=0x7ffa80004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:19.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.651+0000 7ffa7effd700 1 -- 172.21.15.61:0/2937182606 <== mon.0 v2:172.21.15.61:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa80004570 con 0x7ffa9006dce0 2023-01-01T17:40:19.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.651+0000 7ffa94fe2700 1 -- 172.21.15.61:0/2937182606 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa9006ef80 con 0x7ffa9006dce0 2023-01-01T17:40:19.654 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.651+0000 7ffa7effd700 1 -- 172.21.15.61:0/2937182606 <== mon.0 v2:172.21.15.61:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8001f070 con 0x7ffa9006dce0 2023-01-01T17:40:19.655 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.651+0000 7ffa7effd700 1 -- 172.21.15.61:0/2937182606 <== mon.0 v2:172.21.15.61:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa800038c0 con 0x7ffa9006dce0 2023-01-01T17:40:19.655 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.651+0000 7ffa94fe2700 1 -- 172.21.15.61:0/2937182606 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa900a9870 con 0x7ffa9006dce0 2023-01-01T17:40:19.655 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.652+0000 7ffa94fe2700 1 -- 172.21.15.61:0/2937182606 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa900c4c20 con 0x7ffa9006dce0 2023-01-01T17:40:19.655 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.652+0000 7ffa7effd700 1 -- 172.21.15.61:0/2937182606 <== mon.0 v2:172.21.15.61:3300/0 4 ==== mgrmap(e 5) v1 ==== 81947+0+0 (secure 0 0 0) 0x7ffa8002a020 con 0x7ffa9006dce0 2023-01-01T17:40:19.655 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.652+0000 7ffa7effd700 1 --2- 172.21.15.61:0/2937182606 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7ffa70063290 0x7ffa70065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:40:19.656 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.653+0000 7ffa7effd700 1 -- 172.21.15.61:0/2937182606 <== mon.0 v2:172.21.15.61:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ffa800813f0 con 0x7ffa9006dce0 2023-01-01T17:40:19.656 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.653+0000 7ffa8dd9b700 1 --2- 172.21.15.61:0/2937182606 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7ffa70063290 0x7ffa70065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:40:19.656 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.653+0000 7ffa8dd9b700 1 --2- 172.21.15.61:0/2937182606 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7ffa70063290 0x7ffa70065740 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffa84000f60 tx=0x7ffa84009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-01-01T17:40:19.657 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.657+0000 7ffa7effd700 1 -- 172.21.15.61:0/2937182606 <== mon.0 v2:172.21.15.61:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170513 (secure 0 0 0) 0x7ffa80050130 con 0x7ffa9006dce0 2023-01-01T17:40:19.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.795+0000 7f1e852fe700 1 -- 172.21.15.61:0/3351182903 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1e800668a0 con 0x7f1e80150280 2023-01-01T17:40:19.796 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.795+0000 7f1e677fe700 1 -- 172.21.15.61:0/3351182903 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f1e78051e10 con 0x7f1e80150280 2023-01-01T17:40:19.796 INFO:teuthology.orchestra.run.smithi061.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-01-01T17:40:19.798 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.797+0000 7f1e852fe700 1 -- 172.21.15.61:0/3351182903 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f1e6c063290 msgr2=0x7f1e6c065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:19.798 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.797+0000 7f1e852fe700 1 --2- 172.21.15.61:0/3351182903 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f1e6c063290 0x7f1e6c065740 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1e801492d0 tx=0x7f1e70008030 comp rx=0 tx=0).stop 2023-01-01T17:40:19.798 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.797+0000 7f1e852fe700 1 -- 172.21.15.61:0/3351182903 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1e80150280 msgr2=0x7f1e801eba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:19.798 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.797+0000 7f1e852fe700 1 --2- 172.21.15.61:0/3351182903 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1e80150280 0x7f1e801eba20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1e7800cae0 tx=0x7f1e7800cdf0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.798 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.797+0000 7f1e852fe700 1 -- 172.21.15.61:0/3351182903 shutdown_connections 2023-01-01T17:40:19.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.797+0000 7f1e852fe700 1 --2- 172.21.15.61:0/3351182903 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7f1e6c063290 0x7f1e6c065740 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.797+0000 7f1e852fe700 1 --2- 172.21.15.61:0/3351182903 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7f1e80150280 0x7f1e801eba20 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.797+0000 7f1e852fe700 1 --2- 172.21.15.61:0/3351182903 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e8006a8b0 0x7f1e800a8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.797+0000 7f1e852fe700 1 --2- 172.21.15.61:0/3351182903 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f1e800c1a70 0x7f1e8014ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.797+0000 7f1e852fe700 1 -- 172.21.15.61:0/3351182903 >> 172.21.15.61:0/3351182903 conn(0x7f1e800c1f30 msgr2=0x7f1e801519b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:19.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.797+0000 7f1e852fe700 1 -- 172.21.15.61:0/3351182903 shutdown_connections 2023-01-01T17:40:19.799 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.797+0000 7f1e852fe700 1 -- 172.21.15.61:0/3351182903 wait complete. 2023-01-01T17:40:19.811 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-01-01T17:40:19.811 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-01-01T17:40:19.811 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2023-01-01T17:40:19.811 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-01-01T17:40:19.811 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-01-01T17:40:19.811 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-01-01T17:40:19.811 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-01-01T17:40:19.811 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-01-01T17:40:19.811 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-01-01T17:40:19.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:19.812 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2023-01-01T17:40:19.833 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-01-01T17:40:19.834 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-01-01T17:40:19.834 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2023-01-01T17:40:19.834 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-01-01T17:40:19.834 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2023-01-01T17:40:19.834 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-01-01T17:40:19.834 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-01-01T17:40:19.834 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2023-01-01T17:40:19.834 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-01-01T17:40:19.834 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2023-01-01T17:40:19.834 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-01-01T17:40:19.835 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2023-01-01T17:40:19.835 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-01-01T17:40:19.835 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2023-01-01T17:40:19.835 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-01-01T17:40:19.835 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42516sec preferred_lft 42516sec 2023-01-01T17:40:19.835 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::d91c:3c02:e162:4202/64 scope link noprefixroute 2023-01-01T17:40:19.835 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-01-01T17:40:19.835 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-01-01T17:40:19.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:19.836 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-01-01T17:40:19.836 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-01-01T17:40:19.836 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add name ceph-brx type bridge 2023-01-01T17:40:19.836 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip addr flush dev ceph-brx 2023-01-01T17:40:19.836 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set ceph-brx up 2023-01-01T17:40:19.836 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-01-01T17:40:19.836 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-01-01T17:40:19.891 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.890+0000 7ffa94fe2700 1 -- 172.21.15.61:0/2937182606 --> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ffa900668a0 con 0x7ffa9006dce0 2023-01-01T17:40:19.891 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.891+0000 7ffa7effd700 1 -- 172.21.15.61:0/2937182606 <== mon.0 v2:172.21.15.61:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7ffa80053750 con 0x7ffa9006dce0 2023-01-01T17:40:19.891 INFO:teuthology.orchestra.run.smithi061.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-01-01T17:40:19.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.893+0000 7ffa94fe2700 1 -- 172.21.15.61:0/2937182606 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7ffa70063290 msgr2=0x7ffa70065740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:19.893 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.893+0000 7ffa94fe2700 1 --2- 172.21.15.61:0/2937182606 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7ffa70063290 0x7ffa70065740 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffa84000f60 tx=0x7ffa84009040 comp rx=0 tx=0).stop 2023-01-01T17:40:19.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.893+0000 7ffa94fe2700 1 -- 172.21.15.61:0/2937182606 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffa9006dce0 msgr2=0x7ffa900ac340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:40:19.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.893+0000 7ffa94fe2700 1 --2- 172.21.15.61:0/2937182606 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffa9006dce0 0x7ffa900ac340 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ffa80000c00 tx=0x7ffa80004750 comp rx=0 tx=0).stop 2023-01-01T17:40:19.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.893+0000 7ffa94fe2700 1 -- 172.21.15.61:0/2937182606 shutdown_connections 2023-01-01T17:40:19.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.893+0000 7ffa94fe2700 1 --2- 172.21.15.61:0/2937182606 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7ffa9006f3d0 0x7ffa90144ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.893+0000 7ffa94fe2700 1 --2- 172.21.15.61:0/2937182606 >> [v2:172.21.15.61:6832/94075,v1:172.21.15.61:6833/94075] conn(0x7ffa70063290 0x7ffa70065740 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.893+0000 7ffa94fe2700 1 --2- 172.21.15.61:0/2937182606 >> [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] conn(0x7ffa9006dce0 0x7ffa900ac340 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.893+0000 7ffa94fe2700 1 --2- 172.21.15.61:0/2937182606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffa9006ebb0 0x7ffa900aad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:40:19.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.893+0000 7ffa94fe2700 1 -- 172.21.15.61:0/2937182606 >> 172.21.15.61:0/2937182606 conn(0x7ffa90069fa0 msgr2=0x7ffa900bbcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-01-01T17:40:19.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.893+0000 7ffa94fe2700 1 -- 172.21.15.61:0/2937182606 shutdown_connections 2023-01-01T17:40:19.894 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:40:19.893+0000 7ffa94fe2700 1 -- 172.21.15.61:0/2937182606 wait complete. 2023-01-01T17:40:19.905 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-01-01T17:40:19.905 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-01-01T17:40:19.906 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi061.front.sepia.ceph.com 2023-01-01T17:40:19.906 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-01-01T17:40:19.906 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-01-01T17:40:19.906 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-01-01T17:40:19.906 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-01-01T17:40:19.906 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-01-01T17:40:19.906 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-01-01T17:40:19.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:19.906 DEBUG:teuthology.orchestra.run.smithi061:> ip addr 2023-01-01T17:40:19.924 INFO:teuthology.orchestra.run.smithi061.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-01-01T17:40:19.924 INFO:teuthology.orchestra.run.smithi061.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-01-01T17:40:19.924 INFO:teuthology.orchestra.run.smithi061.stdout: inet 127.0.0.1/8 scope host lo 2023-01-01T17:40:19.924 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-01-01T17:40:19.924 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 ::1/128 scope host 2023-01-01T17:40:19.924 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-01-01T17:40:19.924 INFO:teuthology.orchestra.run.smithi061.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-01-01T17:40:19.924 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:a8:bb:0c brd ff:ff:ff:ff:ff:ff 2023-01-01T17:40:19.924 INFO:teuthology.orchestra.run.smithi061.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-01-01T17:40:19.925 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:a8:bb:0d brd ff:ff:ff:ff:ff:ff 2023-01-01T17:40:19.925 INFO:teuthology.orchestra.run.smithi061.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-01-01T17:40:19.925 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:b6:f8:b8 brd ff:ff:ff:ff:ff:ff 2023-01-01T17:40:19.925 INFO:teuthology.orchestra.run.smithi061.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-01-01T17:40:19.925 INFO:teuthology.orchestra.run.smithi061.stdout: link/ether 0c:c4:7a:b6:f8:b9 brd ff:ff:ff:ff:ff:ff 2023-01-01T17:40:19.925 INFO:teuthology.orchestra.run.smithi061.stdout: inet 172.21.15.61/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-01-01T17:40:19.925 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft 42505sec preferred_lft 42505sec 2023-01-01T17:40:19.925 INFO:teuthology.orchestra.run.smithi061.stdout: inet6 fe80::f70e:cc41:1d49:8df7/64 scope link noprefixroute 2023-01-01T17:40:19.925 INFO:teuthology.orchestra.run.smithi061.stdout: valid_lft forever preferred_lft forever 2023-01-01T17:40:19.925 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-01-01T17:40:19.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:19.926 DEBUG:teuthology.orchestra.run.smithi061:> (cd / && exec bash -c ' 2023-01-01T17:40:19.926 DEBUG:teuthology.orchestra.run.smithi061:> set -e 2023-01-01T17:40:19.926 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip link add name ceph-brx type bridge 2023-01-01T17:40:19.926 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip addr flush dev ceph-brx 2023-01-01T17:40:19.926 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip link set ceph-brx up 2023-01-01T17:40:19.926 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-01-01T17:40:19.926 DEBUG:teuthology.orchestra.run.smithi061:> ') 2023-01-01T17:40:20.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:20.005 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-01-01T17:40:20.033 INFO:teuthology.orchestra.run.smithi149.stdout:1 2023-01-01T17:40:20.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:20.034 DEBUG:teuthology.orchestra.run.smithi149:> route 2023-01-01T17:40:20.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:20.043 DEBUG:teuthology.orchestra.run.smithi061:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-01-01T17:40:20.069 INFO:teuthology.orchestra.run.smithi061.stdout:1 2023-01-01T17:40:20.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:20.071 DEBUG:teuthology.orchestra.run.smithi061:> route 2023-01-01T17:40:20.109 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2023-01-01T17:40:20.110 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-01-01T17:40:20.110 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-01-01T17:40:20.110 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-01-01T17:40:20.110 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-01-01T17:40:20.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:20.110 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-01-01T17:40:20.110 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-01-01T17:40:20.111 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-01-01T17:40:20.111 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-01-01T17:40:20.111 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-01-01T17:40:20.111 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-01-01T17:40:20.130 INFO:teuthology.orchestra.run.smithi061.stdout:Kernel IP routing table 2023-01-01T17:40:20.130 INFO:teuthology.orchestra.run.smithi061.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-01-01T17:40:20.130 INFO:teuthology.orchestra.run.smithi061.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-01-01T17:40:20.130 INFO:teuthology.orchestra.run.smithi061.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-01-01T17:40:20.130 INFO:teuthology.orchestra.run.smithi061.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-01-01T17:40:20.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:20.131 DEBUG:teuthology.orchestra.run.smithi061:> (cd / && exec bash -c ' 2023-01-01T17:40:20.131 DEBUG:teuthology.orchestra.run.smithi061:> set -e 2023-01-01T17:40:20.131 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-01-01T17:40:20.131 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-01-01T17:40:20.131 DEBUG:teuthology.orchestra.run.smithi061:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-01-01T17:40:20.131 DEBUG:teuthology.orchestra.run.smithi061:> ') 2023-01-01T17:40:20.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:20.238 DEBUG:teuthology.orchestra.run.smithi061:> ip netns list 2023-01-01T17:40:20.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:20.256 DEBUG:teuthology.orchestra.run.smithi061:> ip netns list-id 2023-01-01T17:40:20.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:20.313 DEBUG:teuthology.orchestra.run.smithi061:> (cd / && exec bash -c ' 2023-01-01T17:40:20.313 DEBUG:teuthology.orchestra.run.smithi061:> set -e 2023-01-01T17:40:20.313 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-01-01T17:40:20.313 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-01-01T17:40:20.313 DEBUG:teuthology.orchestra.run.smithi061:> ') 2023-01-01T17:40:20.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:20.377 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2023-01-01T17:40:20.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:20.394 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list-id 2023-01-01T17:40:20.408 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-01-01T17:40:20.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:20.408 DEBUG:teuthology.orchestra.run.smithi061:> (cd / && exec bash -c ' 2023-01-01T17:40:20.408 DEBUG:teuthology.orchestra.run.smithi061:> set -e 2023-01-01T17:40:20.409 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-01-01T17:40:20.409 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-01-01T17:40:20.409 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-01-01T17:40:20.409 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-01-01T17:40:20.409 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-01-01T17:40:20.409 DEBUG:teuthology.orchestra.run.smithi061:> ') 2023-01-01T17:40:20.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:20.452 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-01-01T17:40:20.452 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-01-01T17:40:20.452 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-01-01T17:40:20.453 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-01-01T17:40:20.453 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-01-01T17:40:20.546 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-01-01T17:40:20.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:20.546 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-01-01T17:40:20.547 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-01-01T17:40:20.547 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-01-01T17:40:20.547 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-01-01T17:40:20.547 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-01-01T17:40:20.547 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-01-01T17:40:20.547 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-01-01T17:40:20.547 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-01-01T17:40:20.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:20.610 DEBUG:teuthology.orchestra.run.smithi061:> (cd / && exec bash -c ' 2023-01-01T17:40:20.610 DEBUG:teuthology.orchestra.run.smithi061:> set -e 2023-01-01T17:40:20.611 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip link set brx.0 up 2023-01-01T17:40:20.611 DEBUG:teuthology.orchestra.run.smithi061:> sudo ip link set dev brx.0 master ceph-brx 2023-01-01T17:40:20.611 DEBUG:teuthology.orchestra.run.smithi061:> ') 2023-01-01T17:40:20.722 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-01-01T17:40:20.722 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-01-01T17:40:20.723 DEBUG:teuthology.orchestra.run.smithi061:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-01-01T17:40:20.744 INFO:teuthology.orchestra.run.smithi061.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-01-01T17:40:20.745 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-01-01T17:40:20.745 DEBUG:teuthology.orchestra.run.smithi061:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-01-01T17:40:20.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:20.766 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-01-01T17:40:20.766 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-01-01T17:40:20.766 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2023-01-01T17:40:20.766 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set dev brx.0 master ceph-brx 2023-01-01T17:40:20.766 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-01-01T17:40:20.802 DEBUG:teuthology.orchestra.run.smithi061:> sudo modprobe fuse 2023-01-01T17:40:20.865 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-01-01T17:40:20.865 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-01-01T17:40:20.871 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-01-01T17:40:20.871 DEBUG:teuthology.orchestra.run.smithi061:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-01-01T17:40:20.886 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-01-01T17:40:20.886 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-01-01T17:40:20.886 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-01-01T17:40:20.938 INFO:teuthology.orchestra.run.smithi061.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-01-01T17:40:20.939 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-01-01T17:40:20.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:20.940 DEBUG:teuthology.orchestra.run.smithi061:> ls /sys/fs/fuse/connections 2023-01-01T17:40:20.942 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-01-01T17:40:20.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:20.942 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-01-01T17:40:20.999 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-01-01T17:40:20.999 DEBUG:teuthology.orchestra.run.smithi061:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/) 2023-01-01T17:40:21.039 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-01-01T17:40:21.040 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-01-01T17:40:21.042 DEBUG:teuthology.orchestra.run.smithi061:> sudo modprobe fuse 2023-01-01T17:40:21.068 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-01-01T17:40:21.068 DEBUG:teuthology.orchestra.run.smithi061:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-01-01T17:40:21.132 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:2023-01-01T17:40:21.132+0000 7fcaefffe5c0 -1 init, newargv = 0x563fa16152e0 newargc=15 2023-01-01T17:40:21.132 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:ceph-fuse[104093]: starting ceph client 2023-01-01T17:40:21.138 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-01-01T17:40:21.138 INFO:teuthology.orchestra.run.smithi061.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-01-01T17:40:21.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:21.139 DEBUG:teuthology.orchestra.run.smithi061:> ls /sys/fs/fuse/connections 2023-01-01T17:40:21.143 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-01-01T17:40:21.144 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-01-01T17:40:21.144 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.61:3300,172.21.15.149:3300,172.21.15.149:3301" 2023-01-01T17:40:21.144 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with new device syntax: 1@fe0d3d8e-46ee-4ed9-92f8-749741721d01.cephfs=/ 2023-01-01T17:40:21.144 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.61:3300/172.21.15.149:3300/172.21.15.149:3301" will pass to kernel 2023-01-01T17:40:21.144 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: v2 mount support check returned 2 2023-01-01T17:40:21.144 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: kernel does not support v2 syntax 2023-01-01T17:40:21.144 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2023-01-01T17:40:21.149 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi061.stderr:ceph-fuse[104093]: starting fuse 2023-01-01T17:40:21.166 INFO:teuthology.orchestra.run.smithi061.stdout:46 2023-01-01T17:40:21.166 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-01-01T17:40:21.166 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-01-01T17:40:21.166 DEBUG:teuthology.orchestra.run.smithi061:> import glob 2023-01-01T17:40:21.166 DEBUG:teuthology.orchestra.run.smithi061:> import re 2023-01-01T17:40:21.166 DEBUG:teuthology.orchestra.run.smithi061:> import os 2023-01-01T17:40:21.166 DEBUG:teuthology.orchestra.run.smithi061:> import subprocess 2023-01-01T17:40:21.166 DEBUG:teuthology.orchestra.run.smithi061:> 2023-01-01T17:40:21.167 DEBUG:teuthology.orchestra.run.smithi061:> def _find_admin_socket(client_name): 2023-01-01T17:40:21.167 DEBUG:teuthology.orchestra.run.smithi061:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-01-01T17:40:21.167 DEBUG:teuthology.orchestra.run.smithi061:> files = glob.glob(asok_path) 2023-01-01T17:40:21.167 DEBUG:teuthology.orchestra.run.smithi061:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-01-01T17:40:21.167 DEBUG:teuthology.orchestra.run.smithi061:> 2023-01-01T17:40:21.167 DEBUG:teuthology.orchestra.run.smithi061:> # Given a non-glob path, it better be there 2023-01-01T17:40:21.167 DEBUG:teuthology.orchestra.run.smithi061:> if "*" not in asok_path: 2023-01-01T17:40:21.167 DEBUG:teuthology.orchestra.run.smithi061:> assert(len(files) == 1) 2023-01-01T17:40:21.167 DEBUG:teuthology.orchestra.run.smithi061:> return files[0] 2023-01-01T17:40:21.167 DEBUG:teuthology.orchestra.run.smithi061:> 2023-01-01T17:40:21.167 DEBUG:teuthology.orchestra.run.smithi061:> for f in files: 2023-01-01T17:40:21.167 DEBUG:teuthology.orchestra.run.smithi061:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-01-01T17:40:21.168 DEBUG:teuthology.orchestra.run.smithi061:> if os.path.exists("/proc/{0}".format(pid)): 2023-01-01T17:40:21.168 DEBUG:teuthology.orchestra.run.smithi061:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-01-01T17:40:21.168 DEBUG:teuthology.orchestra.run.smithi061:> contents = proc_f.read() 2023-01-01T17:40:21.168 DEBUG:teuthology.orchestra.run.smithi061:> if mountpoint in contents: 2023-01-01T17:40:21.168 DEBUG:teuthology.orchestra.run.smithi061:> return f 2023-01-01T17:40:21.168 DEBUG:teuthology.orchestra.run.smithi061:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-01-01T17:40:21.168 DEBUG:teuthology.orchestra.run.smithi061:> 2023-01-01T17:40:21.168 DEBUG:teuthology.orchestra.run.smithi061:> print(_find_admin_socket("client.0")) 2023-01-01T17:40:21.168 DEBUG:teuthology.orchestra.run.smithi061:> ' 2023-01-01T17:40:21.175 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-01-01T17:40:21.175 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-01-01T17:40:21.175 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.61:3300,172.21.15.149:3300,172.21.15.149:3301" 2023-01-01T17:40:21.176 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with new device syntax: 1@fe0d3d8e-46ee-4ed9-92f8-749741721d01.cephfs=/ 2023-01-01T17:40:21.176 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.61:3300/172.21.15.149:3300/172.21.15.149:3301" will pass to kernel 2023-01-01T17:40:21.176 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: v2 mount support check returned 2 2023-01-01T17:40:21.176 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: kernel does not support v2 syntax 2023-01-01T17:40:21.176 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2023-01-01T17:40:21.176 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.61:6789,172.21.15.149:6789,172.21.15.149:6790" 2023-01-01T17:40:21.176 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.61:6789,172.21.15.149:6789,172.21.15.149:6790:/ 2023-01-01T17:40:21.176 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=fe0d3d8e-46ee-4ed9-92f8-749741721d01" will pass to kernel 2023-01-01T17:40:21.179 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-01-01T17:40:21.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:21.179 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-01-01T17:40:21.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:21.210 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-01-01T17:40:21.293 INFO:teuthology.orchestra.run.smithi061.stdout:/var/run/ceph/ceph-client.0.104093.asok 2023-01-01T17:40:21.310 INFO:teuthology.orchestra.run.smithi149.stdout:client4723 2023-01-01T17:40:21.311 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-01T17:40:21.311 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-01-01T17:40:21.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:21.332 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-01-01T17:40:21.430 INFO:teuthology.orchestra.run.smithi149.stdout:client4723 2023-01-01T17:40:21.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:21.431 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-01-01T17:40:21.474 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.104093.asok 2023-01-01T17:40:21.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:21.475 DEBUG:teuthology.orchestra.run.smithi061:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.104093.asok status 2023-01-01T17:40:21.495 INFO:teuthology.orchestra.run.smithi149.stdout:client4723 2023-01-01T17:40:21.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:21.495 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/fe0d3d8e-46ee-4ed9-92f8-749741721d01.client4723/status') 2023-01-01T17:40:21.544 INFO:teuthology.orchestra.run.smithi149.stdout:instance: client.4723 (3)192.168.0.1:0/1239105327 2023-01-01T17:40:21.544 INFO:teuthology.orchestra.run.smithi149.stdout:blocklisted: false 2023-01-01T17:40:21.545 INFO:teuthology.orchestra.run.smithi149.stderr:0+1 records in 2023-01-01T17:40:21.545 INFO:teuthology.orchestra.run.smithi149.stderr:0+1 records out 2023-01-01T17:40:21.545 INFO:teuthology.orchestra.run.smithi149.stderr:69 bytes copied, 2.2019e-05 s, 3.1 MB/s 2023-01-01T17:40:21.546 INFO:teuthology.task.sequential:In sequential, running task workunit... 2023-01-01T17:40:21.550 INFO:tasks.workunit:Pulling workunits from ref 2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a 2023-01-01T17:40:21.550 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-01-01T17:40:21.550 DEBUG:teuthology.orchestra.run.smithi149:> stat -- /home/ubuntu/cephtest/mnt.1 2023-01-01T17:40:21.603 INFO:teuthology.orchestra.run.smithi149.stdout: File: /home/ubuntu/cephtest/mnt.1 2023-01-01T17:40:21.603 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-01-01T17:40:21.603 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 2eh/46d Inode: 1 Links: 2 2023-01-01T17:40:21.603 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-01T17:40:21.603 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:cephfs_t:s0 2023-01-01T17:40:21.604 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-01-01T17:40:21.604 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2023-01-01 17:39:52.941950109 +0000 2023-01-01T17:40:21.604 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2023-01-01 17:40:02.103837745 +0000 2023-01-01T17:40:21.604 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2023-01-01 17:39:52.941950109 +0000 2023-01-01T17:40:21.604 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2023-01-01T17:40:21.604 DEBUG:teuthology.orchestra.run.smithi149:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2023-01-01T17:40:21.636 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2023-01-01T17:40:21.636 INFO:teuthology.orchestra.run.smithi061.stdout: "metadata": { 2023-01-01T17:40:21.636 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_sha1": "2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a", 2023-01-01T17:40:21.636 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph_version": "ceph version 18.0.0-1638-g2d451fdb (2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a) reef (dev)", 2023-01-01T17:40:21.636 INFO:teuthology.orchestra.run.smithi061.stdout: "entity_id": "0", 2023-01-01T17:40:21.636 INFO:teuthology.orchestra.run.smithi061.stdout: "hostname": "smithi061", 2023-01-01T17:40:21.637 INFO:teuthology.orchestra.run.smithi061.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-01-01T17:40:21.637 INFO:teuthology.orchestra.run.smithi061.stdout: "pid": "104093", 2023-01-01T17:40:21.637 INFO:teuthology.orchestra.run.smithi061.stdout: "root": "/" 2023-01-01T17:40:21.637 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-01-01T17:40:21.637 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_count": 0, 2023-01-01T17:40:21.637 INFO:teuthology.orchestra.run.smithi061.stdout: "dentry_pinned_count": 0, 2023-01-01T17:40:21.637 INFO:teuthology.orchestra.run.smithi061.stdout: "id": 4788, 2023-01-01T17:40:21.637 INFO:teuthology.orchestra.run.smithi061.stdout: "inst": { 2023-01-01T17:40:21.637 INFO:teuthology.orchestra.run.smithi061.stdout: "name": { 2023-01-01T17:40:21.637 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "client", 2023-01-01T17:40:21.637 INFO:teuthology.orchestra.run.smithi061.stdout: "num": 4788 2023-01-01T17:40:21.638 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-01-01T17:40:21.638 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-01-01T17:40:21.638 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-01-01T17:40:21.638 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-01-01T17:40:21.638 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 1759060001 2023-01-01T17:40:21.638 INFO:teuthology.orchestra.run.smithi061.stdout: } 2023-01-01T17:40:21.638 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-01-01T17:40:21.638 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": { 2023-01-01T17:40:21.638 INFO:teuthology.orchestra.run.smithi061.stdout: "type": "v1", 2023-01-01T17:40:21.638 INFO:teuthology.orchestra.run.smithi061.stdout: "addr": "192.168.0.1:0", 2023-01-01T17:40:21.638 INFO:teuthology.orchestra.run.smithi061.stdout: "nonce": 1759060001 2023-01-01T17:40:21.638 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2023-01-01T17:40:21.639 INFO:teuthology.orchestra.run.smithi061.stdout: "inst_str": "client.4788 192.168.0.1:0/1759060001", 2023-01-01T17:40:21.639 INFO:teuthology.orchestra.run.smithi061.stdout: "addr_str": "192.168.0.1:0/1759060001", 2023-01-01T17:40:21.639 INFO:teuthology.orchestra.run.smithi061.stdout: "inode_count": 1, 2023-01-01T17:40:21.639 INFO:teuthology.orchestra.run.smithi061.stdout: "mds_epoch": 9, 2023-01-01T17:40:21.639 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch": 24, 2023-01-01T17:40:21.639 INFO:teuthology.orchestra.run.smithi061.stdout: "osd_epoch_barrier": 0, 2023-01-01T17:40:21.639 INFO:teuthology.orchestra.run.smithi061.stdout: "blocklisted": false, 2023-01-01T17:40:21.639 INFO:teuthology.orchestra.run.smithi061.stdout: "fs_name": "cephfs" 2023-01-01T17:40:21.639 INFO:teuthology.orchestra.run.smithi061.stdout:} 2023-01-01T17:40:21.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:21.646 DEBUG:teuthology.orchestra.run.smithi061:> stat --file-system '--printf=%T 2023-01-01T17:40:21.646 DEBUG:teuthology.orchestra.run.smithi061:> ' -- /home/ubuntu/cephtest/mnt.0 2023-01-01T17:40:21.664 INFO:teuthology.orchestra.run.smithi061.stdout:fuseblk 2023-01-01T17:40:21.664 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-01-01T17:40:21.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:40:21.665 DEBUG:teuthology.orchestra.run.smithi061:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-01-01T17:40:21.678 INFO:tasks.workunit:timeout=3h 2023-01-01T17:40:21.679 INFO:tasks.workunit:cleanup=True 2023-01-01T17:40:21.679 DEBUG:teuthology.orchestra.run.smithi149:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a 2023-01-01T17:40:21.732 INFO:teuthology.task.sequential:In sequential, running task workunit... 2023-01-01T17:40:21.733 INFO:tasks.workunit:Pulling workunits from ref 2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a 2023-01-01T17:40:21.733 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-01-01T17:40:21.734 DEBUG:teuthology.orchestra.run.smithi061:> stat -- /home/ubuntu/cephtest/mnt.0 2023-01-01T17:40:21.736 INFO:tasks.workunit.client.1.smithi149.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2023-01-01T17:40:21.791 INFO:teuthology.orchestra.run.smithi061.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-01-01T17:40:21.791 INFO:teuthology.orchestra.run.smithi061.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2023-01-01T17:40:21.791 INFO:teuthology.orchestra.run.smithi061.stdout:Device: 2eh/46d Inode: 1 Links: 3 2023-01-01T17:40:21.791 INFO:teuthology.orchestra.run.smithi061.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-01T17:40:21.791 INFO:teuthology.orchestra.run.smithi061.stdout:Context: system_u:object_r:fusefs_t:s0 2023-01-01T17:40:21.791 INFO:teuthology.orchestra.run.smithi061.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-01-01T17:40:21.791 INFO:teuthology.orchestra.run.smithi061.stdout:Modify: 2023-01-01 17:40:21.668842026 +0000 2023-01-01T17:40:21.791 INFO:teuthology.orchestra.run.smithi061.stdout:Change: 2023-01-01 17:40:21.668842026 +0000 2023-01-01T17:40:21.792 INFO:teuthology.orchestra.run.smithi061.stdout: Birth: - 2023-01-01T17:40:21.792 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-01-01T17:40:21.792 DEBUG:teuthology.orchestra.run.smithi061:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-01-01T17:40:21.864 INFO:tasks.workunit:timeout=3h 2023-01-01T17:40:21.864 INFO:tasks.workunit:cleanup=True 2023-01-01T17:40:21.865 DEBUG:teuthology.orchestra.run.smithi061:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a 2023-01-01T17:40:21.922 INFO:tasks.workunit.client.0.smithi061.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-01-01T17:40:28.453 DEBUG:teuthology.orchestra.run.smithi061:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-01-01T17:40:28.456 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-01-01T17:40:58.519 DEBUG:teuthology.orchestra.run.smithi061:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-01-01T17:40:58.522 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-01-01T17:41:10.175 INFO:tasks.workunit.client.0.smithi061.stderr:Note: switching to '2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a'. 2023-01-01T17:41:10.175 INFO:tasks.workunit.client.0.smithi061.stderr: 2023-01-01T17:41:10.175 INFO:tasks.workunit.client.0.smithi061.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-01-01T17:41:10.175 INFO:tasks.workunit.client.0.smithi061.stderr:changes and commit them, and you can discard any commits you make in this 2023-01-01T17:41:10.175 INFO:tasks.workunit.client.0.smithi061.stderr:state without impacting any branches by switching back to a branch. 2023-01-01T17:41:10.175 INFO:tasks.workunit.client.0.smithi061.stderr: 2023-01-01T17:41:10.175 INFO:tasks.workunit.client.0.smithi061.stderr:If you want to create a new branch to retain commits you create, you may 2023-01-01T17:41:10.175 INFO:tasks.workunit.client.0.smithi061.stderr:do so (now or later) by using -c with the switch command. Example: 2023-01-01T17:41:10.175 INFO:tasks.workunit.client.0.smithi061.stderr: 2023-01-01T17:41:10.176 INFO:tasks.workunit.client.0.smithi061.stderr: git switch -c 2023-01-01T17:41:10.176 INFO:tasks.workunit.client.0.smithi061.stderr: 2023-01-01T17:41:10.176 INFO:tasks.workunit.client.0.smithi061.stderr:Or undo this operation with: 2023-01-01T17:41:10.176 INFO:tasks.workunit.client.0.smithi061.stderr: 2023-01-01T17:41:10.176 INFO:tasks.workunit.client.0.smithi061.stderr: git switch - 2023-01-01T17:41:10.176 INFO:tasks.workunit.client.0.smithi061.stderr: 2023-01-01T17:41:10.176 INFO:tasks.workunit.client.0.smithi061.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-01-01T17:41:10.176 INFO:tasks.workunit.client.0.smithi061.stderr: 2023-01-01T17:41:10.176 INFO:tasks.workunit.client.0.smithi061.stderr:HEAD is now at 2d451fdbbd7 Merge PR #46357 into wip-vshankar-testing-20221221.044733 2023-01-01T17:41:10.178 DEBUG:teuthology.orchestra.run.smithi061:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-01-01T17:41:10.201 INFO:tasks.workunit.client.0.smithi061.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-01-01T17:41:10.203 INFO:tasks.workunit.client.0.smithi061.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-01-01T17:41:10.203 INFO:tasks.workunit.client.0.smithi061.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-01-01T17:41:10.751 INFO:tasks.workunit.client.0.smithi061.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-01-01T17:41:10.813 INFO:tasks.workunit.client.0.smithi061.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-01-01T17:41:10.852 INFO:tasks.workunit.client.0.smithi061.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-01-01T17:41:10.854 INFO:tasks.workunit.client.0.smithi061.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-01-01T17:41:10.854 INFO:tasks.workunit.client.0.smithi061.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-01-01T17:41:10.891 INFO:tasks.workunit.client.0.smithi061.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-01-01T17:41:10.894 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2023-01-01T17:41:10.895 DEBUG:teuthology.orchestra.run.smithi061:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-01-01T17:41:10.952 INFO:tasks.workunit:Running workunits matching suites/iozone.sh on client.0... 2023-01-01T17:41:10.954 INFO:tasks.workunit:Running workunit suites/iozone.sh... 2023-01-01T17:41:10.954 DEBUG:teuthology.orchestra.run.smithi061:workunit test suites/iozone.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh 2023-01-01T17:41:16.131 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:16.131+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:16.132 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:16.131+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:16.132 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:16.131+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:16.132 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:16.131+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:16.662 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:16.662+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:16.662 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:16.662+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:16.662 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:16.662+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:16.662 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:16.662+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:17.148 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:17.148+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:17.148 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:17.148+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:17.148 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:17.148+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:17.148 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:17.148+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:17.533 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:17.533+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:17.533 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:17.533+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:17.533 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:17.533+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:17.534 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:17.533+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:17.645 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:17.644+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:17.646 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:17.644+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:17.646 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:17.644+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:17.646 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:17.644+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:18.177 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:18.177+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:18.177 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:18.177+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:18.178 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:18.177+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:18.178 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:18.177+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:18.538 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:18.538+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:18.538 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:18.538+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:18.538 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:18.538+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:18.539 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:18.538+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:18.675 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:18.674+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:18.675 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:18.674+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:18.675 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:18.674+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:18.676 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:18.674+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:19.201 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:19.200+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:19.201 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:19.200+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:19.201 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:19.200+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:19.201 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:19.200+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:19.554 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:19.554+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:19.554 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:19.554+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:19.555 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:19.554+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:19.555 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:19.554+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:19.633 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:19.633+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:19.633 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:19.633+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:19.633 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:19.633+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:19.634 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:19.633+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:20.161 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:20.161+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:20.161 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:20.161+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:20.161 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:20.161+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:20.162 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:20.161+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:20.507 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:20.507+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:20.507 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:20.507+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:20.507 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:20.507+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:20.507 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:20.507+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:20.546 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:20.546+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:20.547 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:20.546+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:20.547 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:20.546+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:20.547 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:20.546+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:20.592 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:20.591+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:20.592 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:20.591+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:20.592 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:20.591+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:20.592 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:20.591+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:21.211 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:21.211+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:21.212 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:21.211+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:21.212 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:21.211+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:21.212 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:21.211+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:21.493 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:21.493+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:21.493 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:21.493+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:21.494 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:21.493+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:21.494 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:21.493+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:21.589 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:21.589+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:21.589 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:21.589+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:21.590 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:21.589+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:21.590 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:21.589+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:21.641 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:21.641+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:21.641 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:21.641+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:21.642 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:21.641+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:21.642 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:21.641+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:22.246 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:22.247+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:22.247 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:22.247+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:22.247 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:22.247+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:22.247 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:22.247+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:22.446 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:22.446+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:22.446 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:22.446+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:22.446 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:22.446+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:22.446 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:22.446+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:22.558 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:22.558+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:22.558 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:22.558+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:22.558 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:22.558+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:22.558 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:22.558+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:22.598 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:22.598+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:22.598 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:22.598+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:22.598 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:22.598+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:22.598 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:22.598+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:23.218 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:23.217+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:23.218 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:23.217+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:23.218 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:23.217+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:23.218 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:23.217+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:23.442 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:23.442+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:23.442 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:23.442+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:23.442 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:23.442+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:23.442 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:23.442+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:23.536 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:23.536+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:23.536 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:23.536+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:23.536 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:23.536+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:23.536 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:23.536+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:23.617 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:23.617+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:23.617 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:23.617+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:23.618 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:23.617+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:23.618 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:23.617+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:24.209 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:24.209+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:24.209 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:24.209+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:24.209 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:24.209+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:24.209 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:24.209+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:24.456 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:24.456+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:24.456 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:24.456+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:24.457 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:24.456+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:24.457 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:24.456+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:24.502 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:24.501+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:24.502 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:24.501+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:24.502 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:24.501+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:24.502 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:24.501+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:24.580 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:24.580+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:24.580 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:24.580+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:24.580 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:24.580+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:24.580 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:24.580+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:25.189 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:25.190+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:25.190 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:25.190+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:25.190 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:25.190+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:25.190 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:25.190+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:25.461 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:25.460+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:25.461 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:25.460+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:25.461 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:25.460+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:25.461 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:25.460+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:25.470 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:25.470+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:25.470 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:25.470+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:25.470 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:25.470+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:25.470 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:25.470+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:25.603 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:25.604+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:25.604 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:25.604+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:25.604 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:25.604+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:25.604 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:25.604+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:26.153 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:26.153+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:26.153 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:26.153+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:26.154 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:26.153+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:26.154 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:26.153+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:26.427 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:26.426+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:26.427 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:26.426+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:26.427 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:26.426+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:26.427 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:26.426+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:26.479 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:26.478+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:26.479 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:26.478+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:26.479 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:26.478+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:26.479 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:26.478+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:26.605 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:26.605+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:26.605 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:26.605+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:26.606 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:26.605+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:26.606 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:26.605+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:27.148 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:27.148+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:27.148 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:27.148+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:27.148 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:27.148+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:27.149 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:27.148+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:27.413 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:27.413+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:27.413 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:27.413+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:27.413 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:27.413+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:27.414 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:27.413+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:27.514 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:27.513+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:27.514 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:27.513+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:27.514 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:27.513+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:27.514 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:27.513+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:27.597 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:27.598+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:27.598 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:27.598+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:27.598 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:27.598+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:27.598 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:27.598+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:28.180 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:28.179+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:28.180 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:28.179+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:28.180 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:28.179+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:28.180 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:28.179+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:28.435 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:28.435+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:28.436 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:28.435+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:28.436 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:28.435+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:28.436 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:28.435+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:28.525 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:28.524+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:28.525 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:28.524+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:28.525 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:28.524+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:28.525 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:28.524+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:28.583 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:28.583+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:28.583 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:28.583+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:28.583 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:28.583+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:28.583 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:28.583+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:29.156 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:29.155+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:29.156 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:29.155+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:29.156 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:29.155+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:29.156 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:29.155+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:29.432 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:29.432+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:29.432 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:29.432+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:29.432 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:29.432+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:29.432 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:29.432+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:29.548 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:29.548+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:29.549 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:29.548+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:29.549 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:29.548+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:29.549 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:29.548+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:29.611 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:29.611+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:29.611 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:29.611+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:29.611 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:29.611+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:29.611 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:29.611+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:30.113 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:30.113+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:30.113 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:30.113+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:30.113 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:30.113+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:30.113 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:30.113+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:30.418 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:30.418+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:30.418 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:30.418+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:30.418 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:30.418+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:30.418 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:30.418+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:30.510 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:30.511+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:30.511 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:30.511+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:30.511 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:30.511+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:30.511 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:30.511+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:30.631 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:30.631+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:30.631 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:30.631+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:30.631 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:30.631+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:30.631 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:30.631+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:31.129 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:31.129+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:31.129 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:31.129+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:31.129 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:31.129+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:31.130 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:31.129+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:31.380 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:31.379+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:31.380 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:31.379+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:31.380 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:31.379+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:31.380 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:31.379+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:31.551 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:31.551+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:31.551 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:31.551+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:31.551 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:31.551+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:31.551 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:31.551+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:31.646 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:31.646+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:31.646 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:31.646+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:31.646 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:31.646+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:31.646 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:31.646+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:32.148 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:32.148+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:32.149 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:32.148+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:32.149 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:32.148+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:32.149 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:32.148+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:32.409 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:32.409+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:32.409 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:32.409+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:32.409 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:32.409+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:32.409 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:32.409+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:32.531 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:32.531+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:32.531 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:32.531+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:32.532 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:32.531+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:32.532 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:32.531+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:32.612 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:32.612+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:32.613 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:32.612+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:32.613 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:32.612+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:32.613 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:32.612+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:33.137 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:33.137+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:33.137 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:33.137+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:33.137 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:33.137+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:33.137 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:33.137+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:33.429 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:33.429+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:33.429 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:33.429+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:33.429 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:33.429+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:33.429 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:33.429+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:33.560 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:33.561+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:33.561 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:33.561+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:33.561 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:33.561+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:33.561 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:33.561+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:33.641 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:33.638+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:33.642 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:33.638+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:33.642 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:33.638+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:33.642 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:33.638+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:34.154 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:34.154+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:34.154 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:34.154+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:34.154 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:34.154+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:34.154 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:34.154+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:34.421 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:34.421+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:34.421 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:34.421+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:34.421 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:34.421+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:34.422 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:34.421+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:34.581 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:34.581+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:34.581 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:34.581+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:34.581 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:34.581+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:34.581 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:34.581+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:34.672 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:34.671+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:34.672 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:34.671+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:34.672 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:34.671+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:34.672 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:34.671+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:35.137 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:35.137+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:35.138 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:35.137+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:35.138 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:35.137+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:35.138 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:35.137+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:35.460 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:35.460+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:35.460 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:35.460+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:35.460 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:35.460+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:35.460 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:35.460+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:35.531 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:35.532+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:35.532 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:35.532+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:35.532 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:35.532+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:35.532 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:35.532+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:35.718 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:35.718+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:35.718 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:35.718+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:35.718 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:35.718+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:35.718 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:35.718+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:36.123 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:36.123+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:36.123 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:36.123+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:36.123 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:36.123+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:36.123 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:36.123+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:36.501 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:36.500+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:36.501 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:36.500+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:36.501 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:36.500+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:36.501 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:36.500+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:36.569 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:36.570+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:36.570 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:36.570+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:36.570 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:36.570+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:36.570 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:36.570+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:36.685 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:36.686+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:36.686 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:36.686+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:36.686 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:36.686+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:36.686 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:36.686+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:37.097 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:37.097+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:37.097 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:37.097+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:37.097 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:37.097+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:37.097 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:37.097+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:37.549 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:37.548+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:37.549 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:37.548+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:37.549 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:37.548+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:37.549 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:37.548+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:37.612 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:37.612+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:37.612 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:37.612+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:37.612 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:37.612+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:37.612 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:37.612+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:37.643 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:37.643+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:37.643 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:37.643+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:37.643 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:37.643+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:37.643 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:37.643+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:38.050 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:38.050+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:38.050 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:38.050+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:38.050 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:38.050+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:38.050 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:38.050+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:38.542 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:38.542+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:38.542 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:38.542+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:38.542 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:38.542+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:38.542 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:38.542+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:38.568 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:38.568+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:38.568 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:38.568+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:38.568 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:38.568+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:38.569 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:38.568+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:38.687 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:38.687+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:38.687 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:38.687+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:38.687 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:38.687+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:38.687 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:38.687+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:39.051 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:39.050+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:39.052 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:39.050+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:39.052 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:39.050+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:39.052 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:39.050+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:39.508 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:39.508+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:39.508 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:39.508+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:39.508 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:39.508+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:39.508 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:39.508+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:39.534 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:39.532+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:39.534 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:39.532+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:39.534 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:39.532+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:39.534 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:39.532+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:39.685 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:39.684+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:39.685 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:39.684+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:39.687 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:39.684+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:39.687 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:39.684+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:40.030 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:40.030+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:40.030 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:40.030+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:40.030 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:40.030+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:40.030 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:40.030+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:40.528 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:40.528+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:40.528 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:40.528+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:40.529 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:40.528+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:40.529 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:40.528+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:40.554 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:40.554+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:40.555 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:40.554+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:40.555 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:40.554+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:40.555 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:40.554+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:40.732 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:40.732+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:40.732 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:40.732+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:40.732 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:40.732+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:40.732 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:40.732+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:41.071 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:41.071+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:41.071 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:41.071+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:41.071 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:41.071+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:41.071 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:41.071+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:41.510 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:41.510+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:41.510 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:41.510+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:41.510 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:41.510+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:41.510 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:41.510+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:41.563 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:41.563+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:41.563 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:41.563+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:41.563 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:41.563+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:41.563 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:41.563+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:41.712 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:41.712+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:41.712 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:41.712+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:41.712 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:41.712+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:41.712 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:41.712+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:42.053 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:42.053+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:42.053 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:42.053+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:42.053 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:42.053+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:42.053 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:42.053+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:42.533 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:42.533+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:42.533 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:42.533+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:42.533 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:42.533+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:42.533 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:42.533+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:42.549 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:42.549+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:42.549 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:42.549+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:42.549 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:42.549+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:42.549 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:42.549+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:42.665 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:42.665+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:42.665 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:42.665+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:42.666 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:42.665+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:42.666 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:42.665+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:43.051 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:43.052+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:43.052 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:43.052+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:43.052 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:43.052+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:43.052 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:43.052+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:43.534 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:43.534+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:43.534 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:43.534+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:43.534 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:43.534+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:43.534 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:43.534+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:43.581 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:43.579+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:43.581 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:43.579+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:43.582 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:43.579+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:43.582 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:43.579+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:43.652 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:43.652+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:43.652 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:43.652+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:43.652 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:43.652+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:43.652 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:43.652+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:44.067 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:44.066+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:44.067 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:44.066+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:44.067 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:44.066+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:44.067 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:44.066+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:44.502 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:44.502+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:44.502 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:44.502+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:44.502 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:44.502+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:44.502 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:44.502+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:44.557 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:44.556+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:44.557 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:44.556+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:44.557 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:44.556+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:44.557 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:44.556+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:44.651 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:44.650+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:44.651 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:44.650+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:44.651 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:44.650+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:44.651 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:44.651+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:45.044 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:45.044+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:45.044 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:45.044+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:45.044 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:45.044+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:45.044 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:45.044+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:45.539 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:45.538+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:45.539 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:45.538+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:45.539 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:45.538+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:45.539 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:45.538+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:45.586 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:45.587+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:45.586 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:45.587+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:45.587 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:45.587+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:45.587 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:45.587+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:45.641 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:45.640+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:45.642 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:45.640+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:45.642 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:45.640+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:45.642 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:45.640+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:46.086 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:46.086+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:46.086 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:46.086+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:46.087 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:46.086+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:46.087 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:46.086+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:46.515 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:46.516+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:46.515 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:46.516+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:46.516 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:46.516+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:46.516 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:46.516+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:46.549 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:46.546+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:46.549 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:46.546+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:46.549 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:46.546+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:46.549 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:46.546+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:46.646 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:46.646+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:46.646 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:46.646+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:46.646 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:46.646+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:46.646 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:46.646+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:47.116 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:47.117+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:47.117 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:47.117+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:47.117 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:47.117+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:47.117 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:47.117+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:47.509 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:47.509+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:47.509 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:47.509+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:47.509 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:47.509+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:47.509 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:47.509+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:47.565 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:47.564+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:47.565 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:47.564+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:47.565 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:47.564+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:47.565 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:47.564+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:47.630 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:47.629+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:47.630 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:47.630+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:47.630 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:47.630+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:47.630 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:47.630+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:48.137 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:48.137+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:48.137 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:48.137+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:48.137 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:48.137+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:48.137 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:48.137+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:48.515 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:48.515+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:48.515 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:48.515+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:48.515 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:48.515+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:48.515 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:48.515+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:48.581 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:48.578+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:48.582 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:48.578+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:48.582 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:48.578+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:48.582 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:48.578+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:48.604 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:48.604+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:48.604 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:48.604+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:48.604 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:48.604+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:48.604 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:48.604+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:49.180 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:49.179+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:49.180 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:49.179+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:49.180 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:49.179+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:49.181 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:49.179+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:49.534 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:49.532+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:49.534 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:49.532+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:49.535 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:49.532+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:49.535 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:49.532+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:49.540 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:49.541+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:49.540 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:49.541+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:49.540 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:49.541+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:49.540 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:49.541+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:49.562 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:49.562+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:49.562 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:49.562+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:49.562 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:49.562+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:49.563 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:49.562+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:50.211 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:50.211+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:50.211 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:50.211+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:50.211 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:50.211+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:50.211 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:50.211+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:50.524 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:50.525+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:50.524 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:50.525+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:50.524 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:50.525+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:50.525 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:50.525+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:50.564 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:50.564+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:50.564 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:50.564+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:50.564 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:50.564+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:50.564 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:50.564+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:50.582 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:50.582+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:50.583 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:50.582+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:50.583 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:50.582+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:50.583 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:50.582+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:51.182 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:51.182+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:51.182 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:51.182+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:51.182 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:51.182+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:51.182 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:51.182+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:51.513 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:51.513+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:51.513 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:51.513+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:51.513 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:51.513+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:51.513 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:51.513+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:51.553 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:51.554+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:51.553 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:51.554+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:51.553 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:51.554+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:51.553 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:51.554+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:51.565 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:51.566+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:51.565 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:51.566+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:51.566 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:51.566+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:51.566 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:51.566+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:52.230 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:52.230+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:52.230 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:52.230+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:52.230 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:52.230+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:52.230 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:52.230+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:52.467 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:52.467+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:52.467 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:52.467+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:52.467 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:52.467+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:52.467 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:52.467+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:52.545 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:52.544+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:52.545 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:52.544+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:52.545 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:52.544+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:52.545 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:52.544+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:52.604 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:52.605+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:52.605 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:52.605+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:52.605 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:52.605+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:52.605 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:52.605+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:53.206 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:53.205+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:53.206 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:53.205+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:53.206 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:53.205+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:53.206 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:53.205+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:53.513 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:53.513+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:53.513 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:53.513+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:53.513 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:53.513+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:53.513 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:53.513+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:53.557 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:53.557+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:53.557 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:53.557+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:53.557 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:53.557+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:53.557 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:53.557+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:53.599 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:53.600+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:53.599 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:53.600+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:53.599 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:53.600+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:53.600 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:53.600+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:54.247 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:54.247+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:54.247 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:54.247+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:54.247 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:54.247+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:54.247 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:54.247+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:54.547 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:54.548+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:54.547 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:54.548+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:54.547 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:54.548+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:54.548 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:54.548+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:54.561 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:54.562+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:54.562 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:54.562+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:54.562 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:54.562+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:54.562 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:54.562+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:54.578 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:54.577+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:54.578 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:54.577+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:54.578 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:54.577+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:54.578 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:54.577+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:55.273 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:55.273+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:55.274 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:55.273+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:55.274 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:55.273+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:55.274 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:55.273+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:55.541 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:55.541+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:55.541 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:55.541+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:55.541 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:55.541+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:55.541 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:55.541+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:55.544 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:55.544+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:55.544 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:55.544+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:55.544 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:55.544+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:55.544 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:55.544+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:55.622 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:55.623+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:55.623 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:55.623+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:55.623 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:55.623+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:55.623 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:55.623+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:56.281 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:56.282+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:56.282 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:56.282+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:56.282 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:56.282+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:56.282 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:56.282+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:56.495 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:56.495+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:56.495 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:56.495+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:56.495 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:56.496+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:56.495 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:56.496+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:56.571 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:56.571+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:56.571 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:56.571+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:56.571 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:56.571+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:56.571 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:56.571+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:56.611 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:56.610+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:56.611 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:56.610+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:56.611 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:56.610+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:56.611 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:56.610+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:57.298 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:57.299+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:57.432 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:57.299+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:57.432 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:57.299+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:57.432 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:57.299+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:57.533 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:57.534+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:57.533 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:57.534+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:57.533 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:57.534+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:57.533 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:57.534+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:57.594 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:57.595+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:57.594 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:57.595+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:57.594 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:57.595+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:57.594 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:57.595+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:57.615 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:57.616+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:57.615 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:57.616+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:57.615 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:57.616+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:57.615 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:57.616+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:58.290 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:58.291+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:58.290 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:58.291+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:58.290 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:58.291+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:58.290 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:58.291+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:58.547 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:58.547+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:58.547 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:58.547+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:58.547 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:58.547+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:58.547 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:58.547+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:58.631 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:58.631+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:58.631 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:58.631+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:58.631 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:58.631+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:58.631 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:58.631+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:58.661 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:58.659+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:58.662 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:58.659+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:58.662 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:58.659+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:58.662 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:58.659+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:59.256 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:59.257+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:59.256 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:59.257+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:59.256 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:59.257+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:59.257 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:41:59.257+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:41:59.591 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:59.592+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:59.591 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:59.592+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:59.591 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:59.592+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:59.592 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:41:59.592+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:41:59.621 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:59.622+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:59.622 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:59.622+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:59.622 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:59.622+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:59.622 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:41:59.622+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:41:59.630 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:59.631+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:59.631 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:59.631+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:59.631 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:59.631+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:41:59.631 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:41:59.631+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:00.247 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:00.248+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:00.247 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:00.248+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:00.247 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:00.248+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:00.247 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:00.248+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:00.581 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:00.582+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:00.581 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:00.582+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:00.581 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:00.582+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:00.581 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:00.582+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:00.600 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:00.601+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:00.600 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:00.601+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:00.600 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:00.601+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:00.601 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:00.601+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:00.631 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:00.632+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:00.632 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:00.632+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:00.632 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:00.632+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:00.632 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:00.632+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:01.281 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:01.282+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:01.281 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:01.282+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:01.281 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:01.282+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:01.281 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:01.282+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:01.565 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:01.565+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:01.565 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:01.565+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:01.565 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:01.565+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:01.565 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:01.565+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:01.599 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:01.599+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:01.601 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:01.599+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:01.601 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:01.599+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:01.601 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:01.599+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:01.663 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:01.663+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:01.663 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:01.663+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:01.663 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:01.663+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:01.663 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:01.663+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:02.321 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:02.322+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:02.321 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:02.322+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:02.321 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:02.322+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:02.322 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:02.322+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:02.578 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:02.579+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:02.578 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:02.579+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:02.579 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:02.579+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:02.579 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:02.579+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:02.582 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:02.582+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:02.582 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:02.582+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:02.583 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:02.582+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:02.583 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:02.582+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:02.686 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:02.685+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:02.686 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:02.685+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:02.686 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:02.685+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:02.686 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:02.685+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:03.336 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:03.337+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:03.336 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:03.337+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:03.337 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:03.337+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:03.337 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:03.337+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:03.584 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:03.585+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:03.584 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:03.585+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:03.584 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:03.585+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:03.585 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:03.585+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:03.593 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:03.593+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:03.593 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:03.593+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:03.593 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:03.593+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:03.593 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:03.593+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:03.694 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:03.693+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:03.694 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:03.693+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:03.694 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:03.693+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:03.694 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:03.693+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:04.354 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:04.355+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:04.355 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:04.355+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:04.355 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:04.355+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:04.355 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:04.355+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:04.565 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:04.561+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:04.565 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:04.561+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:04.566 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:04.561+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:04.566 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:04.561+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:04.594 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:04.594+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:04.594 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:04.594+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:04.594 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:04.594+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:04.594 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:04.594+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:04.737 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:04.738+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:04.737 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:04.738+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:04.737 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:04.738+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:04.738 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:04.738+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:05.327 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:05.327+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:05.327 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:05.327+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:05.327 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:05.327+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:05.327 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:05.327+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:05.531 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:05.531+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:05.531 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:05.531+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:05.531 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:05.531+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:05.531 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:05.531+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:05.631 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:05.632+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:05.631 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:05.632+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:05.631 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:05.632+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:05.631 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:05.632+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:05.739 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:05.740+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:05.740 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:05.740+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:05.740 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:05.740+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:05.740 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:05.740+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:06.292 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:06.292+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:06.292 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:06.292+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:06.292 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:06.292+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:06.292 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:06.292+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:06.568 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:06.566+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:06.568 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:06.566+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:06.569 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:06.566+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:06.569 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:06.566+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:06.638 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:06.633+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:06.638 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:06.633+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:06.638 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:06.633+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:06.638 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:06.633+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:06.697 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:06.698+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:06.698 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:06.698+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:06.698 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:06.698+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:06.698 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:06.698+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:07.326 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:07.327+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:07.326 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:07.327+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:07.326 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:07.327+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:07.326 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:07.327+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:07.591 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:07.591+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:07.591 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:07.591+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:07.592 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:07.591+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:07.592 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:07.591+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:07.672 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:07.673+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:07.672 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:07.673+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:07.672 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:07.673+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:07.673 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:07.673+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:07.692 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:07.692+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:07.692 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:07.692+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:07.692 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:07.692+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:07.692 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:07.692+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:08.342 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:08.342+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:08.342 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:08.342+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:08.343 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:08.343+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:08.343 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:08.343+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:08.581 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:08.582+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:08.581 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:08.582+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:08.581 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:08.582+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:08.581 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:08.582+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:08.628 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:08.629+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:08.628 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:08.629+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:08.628 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:08.629+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:08.628 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:08.629+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:08.710 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:08.708+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:08.710 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:08.708+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:08.710 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:08.708+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:08.710 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:08.708+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:09.294 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:09.295+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:09.294 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:09.295+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:09.294 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:09.295+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:09.295 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:09.295+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:09.535 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:09.536+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:09.536 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:09.536+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:09.536 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:09.536+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:09.536 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:09.536+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:09.661 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:09.662+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:09.662 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:09.662+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:09.662 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:09.662+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:09.662 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:09.662+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:09.727 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:09.727+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:09.727 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:09.727+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:09.727 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:09.727+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:09.727 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:09.727+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:10.260 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:10.261+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:10.260 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:10.261+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:10.260 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:10.261+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:10.260 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:10.261+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:10.522 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:10.523+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:10.522 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:10.523+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:10.522 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:10.523+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:10.522 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:10.523+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:10.640 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:10.641+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:10.640 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:10.641+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:10.641 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:10.641+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:10.641 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:10.641+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:10.768 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:10.768+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:10.768 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:10.768+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:10.768 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:10.768+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:10.768 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:10.768+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:11.238 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:11.239+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:11.238 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:11.239+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:11.239 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:11.239+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:11.239 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:11.239+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:11.557 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:11.558+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:11.557 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:11.558+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:11.557 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:11.558+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:11.557 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:11.558+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:11.596 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:11.597+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:11.597 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:11.597+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:11.597 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:11.597+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:11.597 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:11.597+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:11.738 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:11.739+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:11.738 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:11.739+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:11.738 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:11.739+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:11.738 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:11.739+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:12.250 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:12.250+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:12.250 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:12.250+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:12.250 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:12.250+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:12.250 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:12.250+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:12.514 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:12.515+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:12.514 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:12.515+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:12.514 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:12.515+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:12.514 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:12.515+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:12.597 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:12.598+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:12.598 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:12.598+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:12.598 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:12.598+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:12.598 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:12.598+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:12.741 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:12.742+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:12.741 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:12.742+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:12.742 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:12.742+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:12.742 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:12.742+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:13.282 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:13.281+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:13.282 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:13.281+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:13.282 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:13.281+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:13.282 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:13.281+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:13.482 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:13.481+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:13.482 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:13.481+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:13.482 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:13.481+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:13.482 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:13.481+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:13.590 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:13.589+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:13.590 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:13.589+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:13.590 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:13.589+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:13.590 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:13.589+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:13.745 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:13.745+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:13.746 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:13.745+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:13.746 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:13.745+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:13.746 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:13.745+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:14.306 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:14.306+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:14.306 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:14.306+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:14.307 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:14.306+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:14.307 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:14.306+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:14.436 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:14.436+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:14.437 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:14.436+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:14.437 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:14.436+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:14.437 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:14.436+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:14.556 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:14.556+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:14.556 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:14.556+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:14.556 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:14.556+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:14.556 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:14.556+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:14.783 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:14.783+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:14.783 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:14.783+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:14.783 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:14.783+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:14.783 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:14.783+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:15.307 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:15.306+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:15.307 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:15.306+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:15.307 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:15.306+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:15.307 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:15.306+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:15.469 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:15.469+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:15.470 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:15.469+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:15.470 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:15.469+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:15.470 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:15.469+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:15.593 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:15.591+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:15.593 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:15.591+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:15.594 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:15.591+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:15.594 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:15.591+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:15.763 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:15.762+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:15.763 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:15.762+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:15.763 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:15.762+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:15.763 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:15.762+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:16.344 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:16.343+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:16.344 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:16.343+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:16.344 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:16.343+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:16.344 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:16.344+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:16.502 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:16.502+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:16.502 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:16.502+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:16.502 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:16.502+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:16.502 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:16.502+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:16.605 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:16.605+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:16.605 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:16.605+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:16.605 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:16.605+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:16.605 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:16.605+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:16.802 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:16.802+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:16.802 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:16.802+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:16.802 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:16.802+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:16.802 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:16.802+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:17.358 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:17.357+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:17.358 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:17.357+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:17.358 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:17.357+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:17.358 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:17.357+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:17.507 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:17.507+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:17.509 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:17.507+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:17.509 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:17.507+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:17.509 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:17.507+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:17.558 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:17.558+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:17.558 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:17.558+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:17.558 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:17.558+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:17.558 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:17.558+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:17.821 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:17.821+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:17.822 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:17.821+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:17.822 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:17.821+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:17.822 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:17.821+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:18.317 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:18.317+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:18.317 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:18.317+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:18.317 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:18.317+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:18.317 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:18.317+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:18.470 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:18.470+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:18.470 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:18.470+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:18.471 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:18.470+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:18.471 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:18.470+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:18.561 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:18.561+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:18.562 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:18.561+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:18.562 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:18.561+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:18.562 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:18.561+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:18.792 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:18.792+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:18.792 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:18.792+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:18.792 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:18.792+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:18.792 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:18.792+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:19.270 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:19.269+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:19.270 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:19.269+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:19.270 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:19.269+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:19.270 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:19.269+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:19.489 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:19.488+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:19.489 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:19.488+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:19.489 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:19.488+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:19.489 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:19.488+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:19.528 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:19.528+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:19.529 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:19.528+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:19.529 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:19.528+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:19.529 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:19.528+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:19.811 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:19.810+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:19.811 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:19.810+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:19.811 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:19.810+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:19.811 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:19.810+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:20.259 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:20.259+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:20.259 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:20.259+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:20.259 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:20.259+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:20.259 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:20.259+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:20.503 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:20.502+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:20.503 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:20.502+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:20.503 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:20.502+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:20.504 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:20.502+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:20.564 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:20.563+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:20.564 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:20.563+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:20.564 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:20.563+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:20.564 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:20.563+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:20.793 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:20.793+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:20.793 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:20.793+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:20.793 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:20.793+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:20.793 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:20.793+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:21.229 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:21.227+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:21.229 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:21.227+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:21.229 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:21.227+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:21.229 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:21.227+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:21.527 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:21.528+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:21.528 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:21.528+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:21.528 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:21.528+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:21.528 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:21.528+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:21.537 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:21.536+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:21.537 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:21.536+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:21.537 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:21.536+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:21.537 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:21.536+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:21.750 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:21.750+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:21.751 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:21.750+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:21.751 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:21.750+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:21.751 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:21.750+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:22.240 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:22.240+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:22.240 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:22.240+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:22.240 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:22.240+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:22.240 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:22.240+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:22.513 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:22.513+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:22.513 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:22.513+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:22.514 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:22.513+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:22.514 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:22.513+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:22.514 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:22.513+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:22.514 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:22.513+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:22.514 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:22.513+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:22.514 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:22.513+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:22.745 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:22.743+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:22.746 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:22.743+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:22.746 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:22.743+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:22.746 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:22.743+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:23.238 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:23.237+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:23.238 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:23.237+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:23.238 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:23.237+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:23.238 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:23.237+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:23.558 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:23.558+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:23.558 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:23.558+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:23.558 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:23.558+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:23.558 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:23.558+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:23.560 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:23.560+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:23.560 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:23.560+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:23.560 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:23.560+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:23.560 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:23.560+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:23.744 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:23.743+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:23.745 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:23.743+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:23.745 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:23.743+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:23.745 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:23.743+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:24.243 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:24.243+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:24.244 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:24.243+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:24.244 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:24.243+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:24.244 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:24.243+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:24.533 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:24.532+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:24.533 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:24.532+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:24.533 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:24.532+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:24.533 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:24.532+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:24.541 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:24.541+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:24.542 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:24.541+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:24.542 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:24.541+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:24.542 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:24.541+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:24.766 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:24.765+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:24.778 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:24.765+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:24.778 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:24.765+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:24.778 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:24.765+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:25.195 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:25.194+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:25.195 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:25.194+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:25.195 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:25.195+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:25.195 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:25.195+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:25.531 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:25.531+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:25.532 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:25.531+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:25.532 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:25.531+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:25.532 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:25.531+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:25.574 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:25.574+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:25.575 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:25.574+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:25.575 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:25.574+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:25.575 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:25.574+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:25.744 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:25.744+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:25.744 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:25.744+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:25.744 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:25.744+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:25.745 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:25.744+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:26.184 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:26.184+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:26.185 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:26.184+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:26.185 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:26.184+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:26.185 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:26.184+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:26.504 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:26.504+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:26.504 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:26.504+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:26.504 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:26.504+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:26.504 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:26.504+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:26.566 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:26.566+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:26.566 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:26.566+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:26.566 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:26.566+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:26.566 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:26.566+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:26.787 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:26.787+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:26.787 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:26.787+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:26.787 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:26.787+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:26.787 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:26.787+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:27.194 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:27.194+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:27.194 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:27.194+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:27.194 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:27.194+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:27.194 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:27.194+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:27.524 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:27.523+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:27.524 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:27.523+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:27.524 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:27.523+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:27.524 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:27.523+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:27.568 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:27.568+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:27.568 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:27.568+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:27.569 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:27.568+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:27.569 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:27.568+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:27.824 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:27.823+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:27.824 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:27.823+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:27.824 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:27.823+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:27.824 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:27.823+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:28.149 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:28.149+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:28.149 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:28.149+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:28.150 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:28.149+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:28.150 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:28.149+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:28.525 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:28.524+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:28.525 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:28.524+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:28.525 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:28.524+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:28.525 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:28.524+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:28.533 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:28.532+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:28.533 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:28.532+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:28.533 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:28.532+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:28.533 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:28.532+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:28.778 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:28.779+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:28.778 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:28.779+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:28.779 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:28.779+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:28.779 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:28.779+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:29.182 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:29.182+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:29.182 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:29.182+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:29.182 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:29.182+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:29.182 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:29.182+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:29.533 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:29.533+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:29.534 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:29.533+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:29.534 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:29.533+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:29.534 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:29.533+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:29.574 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:29.574+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:29.574 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:29.574+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:29.575 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:29.574+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:29.575 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:29.574+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:29.794 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:29.794+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:29.794 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:29.794+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:29.794 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:29.794+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:29.794 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:29.794+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:30.202 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:30.202+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:30.205 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:30.202+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:30.205 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:30.202+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:30.205 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:30.202+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:30.489 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:30.489+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:30.490 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:30.489+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:30.490 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:30.489+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:30.490 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:30.489+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:30.588 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:30.588+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:30.588 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:30.588+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:30.588 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:30.588+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:30.588 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:30.588+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:30.781 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:30.781+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:30.781 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:30.781+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:30.781 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:30.781+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:30.781 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:30.781+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:31.178 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:31.177+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:31.178 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:31.177+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:31.178 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:31.177+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:31.178 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:31.177+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:31.463 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:31.463+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:31.463 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:31.463+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:31.463 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:31.463+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:31.463 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:31.463+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:31.552 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:31.552+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:31.552 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:31.552+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:31.553 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:31.552+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:31.553 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:31.552+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:31.784 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:31.784+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:31.784 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:31.784+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:31.784 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:31.784+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:31.784 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:31.784+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:32.129 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:32.128+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:32.129 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:32.128+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:32.129 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:32.128+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:32.129 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:32.128+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:32.457 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:32.457+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:32.457 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:32.457+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:32.457 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:32.457+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:32.457 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:32.457+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:32.542 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:32.541+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:32.542 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:32.541+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:32.542 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:32.541+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:32.543 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:32.541+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:32.762 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:32.762+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:32.763 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:32.762+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:32.763 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:32.762+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:32.763 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:32.762+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:33.143 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:33.143+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:33.143 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:33.143+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:33.143 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:33.143+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:33.143 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:33.143+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:33.463 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:33.463+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:33.463 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:33.463+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:33.463 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:33.463+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:33.464 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:33.463+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:33.535 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:33.535+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:33.535 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:33.535+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:33.535 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:33.535+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:33.535 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:33.535+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:33.787 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:33.787+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:33.787 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:33.787+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:33.787 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:33.787+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:33.787 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:33.787+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:34.130 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:34.127+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:34.130 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:34.127+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:34.130 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:34.127+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:34.130 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:34.127+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:34.415 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:34.415+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:34.415 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:34.415+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:34.416 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:34.415+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:34.416 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:34.415+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:34.501 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:34.501+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:34.501 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:34.501+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:34.501 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:34.501+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:34.501 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:34.501+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:34.789 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:34.788+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:34.789 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:34.788+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:34.789 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:34.788+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:34.789 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:34.788+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:35.116 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:35.116+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:35.117 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:35.116+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:35.117 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:35.116+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:35.117 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:35.116+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:35.381 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:35.379+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:35.381 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:35.379+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:35.381 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:35.379+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:35.381 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:35.379+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:35.455 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:35.455+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:35.455 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:35.455+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:35.455 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:35.455+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:35.455 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:35.455+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:35.794 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:35.794+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:35.794 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:35.794+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:35.794 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:35.794+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:35.794 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:35.794+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:36.128 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:36.128+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:36.128 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:36.128+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:36.128 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:36.128+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:36.128 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:36.128+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:36.383 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:36.384+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:36.384 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:36.384+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:36.384 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:36.384+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:36.384 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:36.384+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:36.414 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:36.414+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:36.414 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:36.414+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:36.414 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:36.414+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:36.414 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:36.414+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:36.795 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:36.796+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:36.796 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:36.796+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:36.796 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:36.796+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:36.796 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:36.796+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:37.153 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:37.152+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:37.153 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:37.152+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:37.153 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:37.152+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:37.153 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:37.152+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:37.354 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:37.354+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:37.355 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:37.354+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:37.355 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:37.354+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:37.355 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:37.354+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:37.420 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:37.420+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:37.420 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:37.420+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:37.421 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:37.420+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:37.421 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:37.420+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:37.801 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:37.801+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:37.801 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:37.801+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:37.801 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:37.801+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:37.801 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:37.801+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:38.175 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:38.174+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:38.175 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:38.175+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:38.175 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:38.175+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:38.175 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:38.175+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:38.337 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:38.338+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:38.338 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:38.338+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:38.338 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:38.338+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:38.338 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:38.338+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:38.409 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:38.408+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:38.409 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:38.408+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:38.409 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:38.408+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:38.409 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:38.408+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:38.842 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:38.842+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:38.842 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:38.842+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:38.842 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:38.842+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:38.842 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:38.842+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:39.180 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:39.180+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:39.180 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:39.180+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:39.180 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:39.180+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:39.180 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:39.180+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:39.384 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:39.384+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:39.384 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:39.384+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:39.385 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:39.384+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:39.385 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:39.384+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:39.428 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:39.429+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:39.429 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:39.429+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:39.429 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:39.429+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:39.429 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:39.429+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:39.857 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:39.855+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:39.858 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:39.855+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:39.858 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:39.855+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:39.858 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:39.855+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:40.177 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:40.177+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:40.177 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:40.177+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:40.177 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:40.177+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:40.177 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:40.177+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:40.345 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:40.345+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:40.345 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:40.345+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:40.345 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:40.345+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:40.346 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:40.345+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:40.399 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:40.400+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:40.400 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:40.400+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:40.400 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:40.400+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:40.400 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:40.400+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:40.904 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:40.904+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:40.904 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:40.904+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:40.904 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:40.904+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:40.904 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:40.904+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:41.223 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:41.224+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:41.224 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:41.224+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:41.224 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:41.224+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:41.224 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:41.224+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:41.366 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:41.366+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:41.366 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:41.366+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:41.366 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:41.366+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:41.367 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:41.366+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:41.390 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:41.388+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:41.390 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:41.388+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:41.390 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:41.388+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:41.390 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:41.388+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:41.861 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:41.862+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:41.862 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:41.862+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:41.862 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:41.862+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:41.862 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:41.862+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:42.206 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:42.206+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:42.206 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:42.206+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:42.209 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:42.206+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:42.210 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:42.206+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:42.353 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:42.351+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:42.354 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:42.351+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:42.354 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:42.351+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:42.354 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:42.351+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:42.395 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:42.396+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:42.396 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:42.396+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:42.396 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:42.396+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:42.396 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:42.396+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:42.812 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:42.812+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:42.812 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:42.812+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:42.812 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:42.812+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:42.813 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:42.812+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:43.189 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:43.189+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:43.189 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:43.189+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:43.189 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:43.189+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:43.189 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:43.189+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:43.366 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:43.366+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:43.366 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:43.366+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:43.366 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:43.366+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:43.367 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:43.366+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:43.407 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:43.407+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:43.407 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:43.407+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:43.407 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:43.407+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:43.407 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:43.407+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:43.822 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:43.823+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:43.823 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:43.823+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:43.823 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:43.823+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:43.823 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:43.823+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:44.209 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:44.209+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:44.209 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:44.209+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:44.209 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:44.209+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:44.209 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:44.209+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:44.372 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:44.372+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:44.373 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:44.372+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:44.373 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:44.372+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:44.373 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:44.372+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:44.383 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:44.383+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:44.384 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:44.383+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:44.384 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:44.383+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:44.384 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:44.383+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:44.775 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:44.776+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:44.775 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:44.776+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:44.776 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:44.776+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:44.776 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:44.776+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:45.203 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:45.203+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:45.203 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:45.203+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:45.203 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:45.203+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:45.203 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:45.203+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:45.333 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:45.333+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:45.333 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:45.333+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:45.333 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:45.333+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:45.333 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:45.333+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:45.415 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:45.416+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:45.415 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:45.416+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:45.415 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:45.416+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:45.415 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:45.416+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:45.792 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:45.792+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:45.792 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:45.792+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:45.792 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:45.792+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:45.792 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:45.792+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:46.229 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:46.229+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:46.229 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:46.229+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:46.229 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:46.229+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:46.229 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:46.229+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:46.334 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:46.333+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:46.334 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:46.333+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:46.334 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:46.333+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:46.334 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:46.333+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:46.389 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:46.389+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:46.389 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:46.389+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:46.389 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:46.389+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:46.389 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:46.389+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:46.825 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:46.825+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:46.825 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:46.825+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:46.825 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:46.825+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:46.826 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:46.825+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:47.266 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:47.266+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:47.267 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:47.266+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:47.267 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:47.266+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:47.267 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:47.266+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:47.356 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:47.357+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:47.356 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:47.357+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:47.357 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:47.357+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:47.357 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:47.357+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:47.385 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:47.383+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:47.386 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:47.383+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:47.386 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:47.383+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:47.386 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:47.383+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:47.804 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:47.804+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:47.804 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:47.804+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:47.804 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:47.804+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:47.805 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:47.804+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:48.304 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:48.304+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:48.304 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:48.304+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:48.304 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:48.304+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:48.304 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:48.304+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:48.358 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:48.358+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:48.358 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:48.358+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:48.358 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:48.358+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:48.358 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:48.358+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:48.376 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:48.376+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:48.376 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:48.376+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:48.376 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:48.376+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:48.376 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:48.376+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:48.819 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:48.819+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:48.819 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:48.819+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:48.819 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:48.819+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:48.820 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:48.819+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:49.305 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:49.306+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:49.306 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:49.306+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:49.306 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:49.306+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:49.306 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:49.306+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:49.342 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:49.341+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:49.342 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:49.341+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:49.342 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:49.341+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:49.344 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:49.341+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:49.391 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:49.391+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:49.391 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:49.391+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:49.392 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:49.391+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:49.392 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:49.391+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:49.861 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:49.861+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:49.861 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:49.861+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:49.861 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:49.861+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:49.862 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:49.861+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:50.298 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:50.298+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:50.298 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:50.298+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:50.299 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:50.298+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:50.299 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:50.298+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:50.339 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:50.339+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:50.339 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:50.339+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:50.339 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:50.339+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:50.340 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:50.339+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:50.440 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:50.441+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:50.440 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:50.441+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:50.440 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:50.441+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:50.441 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:50.441+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:50.885 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:50.884+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:50.885 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:50.884+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:50.885 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:50.884+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:50.885 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:50.884+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:51.345 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:51.344+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:51.345 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:51.344+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:51.345 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:51.344+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:51.345 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:51.344+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:51.353 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:51.353+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:51.354 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:51.353+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:51.354 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:51.353+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:51.354 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:51.353+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:51.419 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:51.420+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:51.419 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:51.420+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:51.420 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:51.420+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:51.420 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:51.420+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:51.849 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:51.846+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:51.849 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:51.846+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:51.850 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:51.846+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:51.850 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:51.846+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:52.336 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:52.336+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:52.336 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:52.336+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:52.336 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:52.336+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:52.337 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:52.336+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:52.340 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:52.340+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:52.340 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:52.340+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:52.340 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:52.340+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:52.340 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:52.340+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:52.383 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:52.384+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:52.383 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:52.384+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:52.383 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:52.384+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:52.383 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:52.384+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:52.835 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:52.836+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:52.835 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:52.836+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:52.835 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:52.836+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:52.835 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:52.836+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:53.325 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:53.326+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:53.325 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:53.326+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:53.325 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:53.326+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:53.325 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:53.326+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:53.344 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:53.345+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:53.344 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:53.345+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:53.344 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:53.345+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:53.344 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:53.345+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:53.367 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:53.367+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:53.367 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:53.367+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:53.367 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:53.367+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:53.367 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:53.367+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:53.799 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:53.800+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:53.799 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:53.800+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:53.799 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:53.800+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:53.800 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:53.800+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:54.292 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:54.291+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:54.292 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:54.291+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:54.292 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:54.291+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:54.292 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:54.291+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:54.355 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:54.355+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:54.355 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:54.355+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:54.355 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:54.355+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:54.356 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:54.355+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:54.416 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:54.416+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:54.416 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:54.416+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:54.416 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:54.416+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:54.417 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:54.416+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:54.840 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:54.840+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:54.840 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:54.840+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:54.840 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:54.840+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:54.840 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:54.840+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:55.289 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:55.289+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:55.289 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:55.289+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:55.289 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:55.289+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:55.290 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:55.289+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:55.371 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:55.369+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:55.371 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:55.369+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:55.371 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:55.369+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:55.371 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:55.369+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:55.392 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:55.393+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:55.393 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:55.393+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:55.393 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:55.393+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:55.393 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:55.393+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:55.886 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:55.884+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:55.886 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:55.884+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:55.886 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:55.884+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:55.886 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:55.884+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:56.267 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:56.267+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:56.268 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:56.267+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:56.268 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:56.267+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:56.268 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:56.267+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:56.352 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:56.352+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:56.352 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:56.352+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:56.353 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:56.352+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:56.353 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:56.352+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:56.418 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:56.414+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:56.418 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:56.414+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:56.418 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:56.414+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:56.418 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:56.414+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:56.878 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:56.877+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:56.878 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:56.877+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:56.878 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:56.877+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:56.878 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:56.877+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:57.283 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:57.275+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:57.284 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:57.275+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:57.284 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:57.275+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:57.284 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:57.275+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:57.376 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:57.375+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:57.394 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:57.375+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:57.394 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:57.375+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:57.394 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:57.375+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:57.408 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:57.406+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:57.408 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:57.406+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:57.408 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:57.406+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:57.409 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:57.406+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:57.896 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:57.897+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:57.897 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:57.897+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:57.897 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:57.897+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:57.897 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:57.897+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:58.293 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:58.291+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:58.293 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:58.291+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:58.293 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:58.291+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:58.293 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:58.291+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:58.374 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:58.374+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:58.374 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:58.374+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:58.374 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:58.374+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:58.374 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:58.374+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:58.407 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:58.408+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:58.407 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:58.408+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:58.407 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:58.408+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:58.414 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:58.408+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:58.940 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:58.940+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:58.940 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:58.940+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:58.940 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:58.940+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:58.940 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:58.940+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:59.291 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:59.291+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:59.291 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:59.291+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:59.291 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:59.291+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:59.291 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:42:59.291+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:42:59.378 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:59.369+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:59.378 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:59.369+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:59.378 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:59.369+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:59.378 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:42:59.369+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:42:59.450 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:59.451+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:59.450 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:59.451+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:59.450 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:59.451+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:59.451 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:42:59.451+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:42:59.532 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-01-01T17:42:59.532+0000 7fc7b8fdb700 -1 mon.a@0(probing) e1 get_health_metrics reporting 3 slow ops, oldest is log(1 entries from seq 42 at 2023-01-01T17:40:56.238062+0000) 2023-01-01T17:42:59.933 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:59.933+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:59.933 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:59.933+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:59.933 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:59.933+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:42:59.933 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:42:59.933+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:00.261 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:00.262+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:00.262 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:00.262+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:00.262 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:00.262+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:00.262 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:00.262+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:00.414 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:00.415+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:00.414 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:00.415+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:00.414 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:00.415+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:00.414 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:00.415+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:00.426 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:00.427+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:00.426 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:00.427+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:00.426 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:00.427+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:00.427 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:00.427+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:00.917 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:00.918+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:00.918 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:00.918+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:00.918 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:00.918+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:00.918 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:00.918+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:01.276 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:01.277+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:01.277 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:01.277+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:01.277 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:01.277+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:01.277 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:01.277+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:01.423 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:01.423+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:01.423 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:01.423+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:01.423 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:01.423+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:01.423 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:01.423+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:01.430 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:01.431+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:01.430 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:01.431+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:01.430 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:01.431+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:01.430 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:01.431+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:01.896 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:01.897+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:01.896 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:01.897+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:01.896 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:01.897+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:01.896 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:01.897+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:02.261 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:02.262+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:02.262 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:02.262+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:02.262 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:02.262+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:02.262 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:02.262+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:02.377 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:02.378+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:02.455 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:02.378+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:02.455 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:02.378+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:02.455 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:02.378+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:02.477 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:02.477+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:02.612 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:02.477+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:02.612 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:02.477+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:02.612 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:02.477+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:02.847 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:02.848+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:02.847 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:02.848+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:02.847 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:02.848+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:02.847 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:02.848+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:03.269 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:03.270+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:03.269 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:03.270+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:03.270 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:03.270+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:03.270 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:03.270+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:03.424 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:03.424+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:03.424 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:03.424+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:03.425 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:03.424+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:03.425 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:03.424+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:03.517 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:03.517+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:03.517 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:03.517+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:03.517 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:03.517+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:03.517 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:03.517+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:03.839 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:03.840+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:03.839 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:03.840+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:03.839 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:03.840+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:03.839 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:03.840+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:04.297 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:04.297+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:04.297 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:04.297+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:04.297 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:04.297+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:04.297 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:04.297+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:04.408 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:04.409+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:04.408 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:04.409+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:04.408 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:04.409+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:04.408 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:04.409+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:04.475 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:04.476+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:04.476 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:04.476+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:04.476 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:04.476+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:04.476 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:04.476+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:04.532 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-01-01T17:43:04.533+0000 7fc7b8fdb700 -1 mon.a@0(probing) e1 get_health_metrics reporting 10 slow ops, oldest is log(1 entries from seq 42 at 2023-01-01T17:40:56.238062+0000) 2023-01-01T17:43:04.851 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:04.851+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:04.851 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:04.851+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:04.851 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:04.851+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:04.851 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:04.851+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:05.310 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:05.311+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:05.310 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:05.311+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:05.310 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:05.311+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:05.311 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:05.311+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:05.442 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:05.443+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:05.442 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:05.443+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:05.442 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:05.443+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:05.442 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:05.443+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:05.524 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:05.525+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:05.524 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:05.525+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:05.524 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:05.525+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:05.524 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:05.525+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:05.808 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:05.808+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:05.808 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:05.808+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:05.808 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:05.808+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:05.808 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:05.808+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:06.347 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:06.348+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:06.347 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:06.348+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:06.347 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:06.348+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:06.347 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:06.348+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:06.418 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:06.418+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:06.418 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:06.418+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:06.418 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:06.418+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:06.418 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:06.418+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:06.515 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:06.515+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:06.515 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:06.515+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:06.515 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:06.515+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:06.515 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:06.515+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:06.841 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:06.841+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:06.841 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:06.842+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:06.841 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:06.842+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:06.841 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:06.842+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:07.361 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:07.362+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:07.362 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:07.362+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:07.377 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:07.376+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:07.377 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:07.376+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:07.377 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:07.376+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:07.377 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:07.376+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:07.520 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:07.520+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:07.520 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:07.520+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:07.520 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:07.520+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:07.521 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:07.520+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:07.835 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:07.836+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:07.835 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:07.836+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:07.835 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:07.836+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:07.836 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:07.836+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:08.353 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:08.354+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:08.354 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:08.354+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:08.414 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:08.414+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:08.414 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:08.414+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:08.415 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:08.414+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:08.415 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:08.414+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:08.512 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:08.513+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:08.512 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:08.513+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:08.512 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:08.513+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:08.512 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:08.513+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:08.791 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:08.792+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:08.791 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:08.792+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:08.792 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:08.792+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:08.792 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:08.792+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:09.367 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:09.367+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:09.367 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:09.367+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:09.392 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:09.392+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:09.392 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:09.392+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:09.392 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:09.392+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:09.392 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:09.392+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:09.474 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:09.475+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:09.475 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:09.475+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:09.475 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:09.475+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:09.475 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:09.475+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:09.533 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-01-01T17:43:09.533+0000 7fc7b8fdb700 -1 mon.a@0(probing) e1 get_health_metrics reporting 18 slow ops, oldest is log(1 entries from seq 42 at 2023-01-01T17:40:56.238062+0000) 2023-01-01T17:43:09.793 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:09.794+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:09.794 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:09.794+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:09.794 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:09.794+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:09.794 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:09.794+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:10.330 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:10.330+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:10.330 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:10.330+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:10.361 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:10.362+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:10.361 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:10.362+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:10.361 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:10.362+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:10.361 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:10.362+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:41:20.019520+0000) 2023-01-01T17:43:10.510 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:10.510+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:10.510 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:10.510+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:10.510 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:10.510+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:10.510 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:10.510+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:10.791 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:10.791+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:10.791 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:10.791+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:10.791 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:10.791+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:10.791 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:10.791+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:11.350 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:11.350+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:11.350 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:11.350+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:11.502 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:11.502+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:11.502 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:11.502+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:11.503 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:11.502+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:11.503 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:11.502+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:11.801 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:11.802+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:11.801 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:11.802+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:11.801 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:11.802+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:11.801 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:11.802+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:12.348 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:12.349+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:12.349 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:12.349+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:12.545 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:12.545+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:12.545 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:12.545+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:12.545 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:12.545+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:12.545 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:12.545+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:12.835 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:12.835+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:12.835 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:12.835+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:12.835 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:12.835+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:12.835 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:12.835+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:13.389 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:13.390+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:13.389 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:13.390+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:13.525 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:13.526+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:13.525 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:13.526+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:13.525 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:13.526+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:13.525 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:13.526+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:13.824 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:13.825+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:13.824 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:13.825+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:13.824 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:13.825+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:13.825 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:13.825+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:14.371 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:14.371+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:14.371 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:14.371+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:14.506 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:14.506+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:14.506 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:14.506+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:14.506 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:14.506+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:14.506 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:14.506+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:14.533 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-01-01T17:43:14.533+0000 7fc7b8fdb700 -1 mon.a@0(probing) e1 get_health_metrics reporting 25 slow ops, oldest is log(1 entries from seq 42 at 2023-01-01T17:40:56.238062+0000) 2023-01-01T17:43:14.778 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:14.778+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:14.778 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:14.778+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:14.778 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:14.778+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:14.778 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:14.778+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:15.406 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:15.405+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:15.406 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:15.405+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:15.494 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:15.493+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:15.494 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:15.493+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:15.494 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:15.494+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:15.494 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:15.494+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:15.779 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:15.778+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:15.779 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:15.778+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:15.779 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:15.778+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:15.779 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:15.778+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:16.385 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:16.383+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:16.385 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:16.383+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:16.515 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:16.515+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:16.515 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:16.515+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:16.515 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:16.515+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:16.515 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:16.515+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:16.751 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:16.746+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:16.751 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:16.746+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:16.751 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:16.746+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:16.751 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:16.746+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:17.418 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:17.418+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:17.418 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:17.418+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:17.498 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:17.497+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:17.498 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:17.497+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:17.498 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:17.498+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:17.498 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:17.498+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:17.733 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:17.733+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:17.733 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:17.733+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:17.733 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:17.733+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:17.733 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:17.733+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:18.385 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:18.385+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:18.385 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:18.385+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:18.527 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:18.526+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:18.527 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:18.526+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:18.527 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:18.526+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:18.527 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:18.526+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:18.745 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:18.742+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:18.745 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:18.742+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:18.745 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:18.742+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:18.746 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:18.742+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:19.410 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:19.410+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:19.410 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:19.410+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:19.534 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-01-01T17:43:19.533+0000 7fc7b8fdb700 -1 mon.a@0(probing) e1 get_health_metrics reporting 43 slow ops, oldest is log(1 entries from seq 42 at 2023-01-01T17:40:56.238062+0000) 2023-01-01T17:43:19.577 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:19.576+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:19.577 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:19.576+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:19.577 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:19.576+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:19.577 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:19.576+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:19.731 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:19.731+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:19.731 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:19.731+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:19.731 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:19.731+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:19.731 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:19.731+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:20.419 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:20.419+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:20.419 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:20.419+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:20.577 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:20.576+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:20.578 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:20.576+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:20.578 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:20.576+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:20.578 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:20.576+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:20.746 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:20.743+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:20.746 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:20.743+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:20.746 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:20.743+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:20.746 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:20.743+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:21.409 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:21.409+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:21.409 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:21.409+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:21.599 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:21.599+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:21.599 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:21.599+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:21.600 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:21.599+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:21.600 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:21.599+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:21.730 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:21.730+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:21.730 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:21.730+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:21.730 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:21.730+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:21.731 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:21.730+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:22.376 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:22.377+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:22.377 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:22.377+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:22.566 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:22.566+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:22.566 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:22.566+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:22.567 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:22.566+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:22.567 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:22.566+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:22.685 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:22.683+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:22.686 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:22.683+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:22.686 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:22.683+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:22.686 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:22.683+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:23.332 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:23.331+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:23.332 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:23.331+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:23.542 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:23.542+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:23.542 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:23.542+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:23.543 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:23.542+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:23.543 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:23.542+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:23.676 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:23.676+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:23.676 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:23.676+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:23.676 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:23.676+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:23.676 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:23.676+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:24.330 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:24.330+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:24.330 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:24.330+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:24.534 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-01-01T17:43:24.534+0000 7fc7b8fdb700 -1 mon.a@0(probing) e1 get_health_metrics reporting 86 slow ops, oldest is log(1 entries from seq 42 at 2023-01-01T17:40:56.238062+0000) 2023-01-01T17:43:24.577 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:24.577+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:24.577 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:24.577+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:24.577 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:24.577+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:24.577 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:24.577+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:24.628 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:24.627+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:24.628 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:24.627+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:24.628 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:24.627+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:24.628 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:24.627+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:25.291 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:25.291+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:25.291 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:25.291+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:25.606 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:25.606+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:25.606 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:25.606+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:25.607 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:25.606+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:25.607 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:25.606+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:25.642 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:25.641+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:25.642 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:25.641+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:25.642 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:25.641+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:25.642 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:25.641+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:26.288 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:26.288+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:26.288 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:26.288+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:26.625 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:26.623+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:26.625 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:26.623+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:26.625 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:26.623+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:26.625 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:26.623+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:26.654 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:26.653+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:26.654 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:26.653+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:26.654 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:26.653+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:26.654 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:26.653+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:27.273 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:27.272+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:27.273 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:27.272+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:27.273 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:27.272+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:27.273 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:27.272+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:27.593 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:27.593+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:27.594 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:27.593+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:27.594 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:27.593+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:27.594 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:27.593+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:27.649 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:27.649+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:27.649 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:27.649+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:27.649 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:27.649+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:27.650 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:27.649+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:28.293 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:28.293+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:28.293 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:28.293+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:28.293 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:28.293+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:28.293 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:28.293+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:28.564 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:28.563+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:28.564 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:28.563+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:28.564 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:28.563+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:28.564 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:28.563+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:28.670 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:28.670+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:28.670 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:28.670+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:28.670 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:28.670+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:28.670 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:28.670+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:29.274 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:29.274+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:29.274 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:29.274+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:29.274 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:29.274+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:29.274 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:29.274+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:29.535 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-01-01T17:43:29.535+0000 7fc7b8fdb700 -1 mon.a@0(probing) e1 get_health_metrics reporting 120 slow ops, oldest is log(1 entries from seq 42 at 2023-01-01T17:40:56.238062+0000) 2023-01-01T17:43:29.587 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:29.585+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:29.588 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:29.585+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:29.588 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:29.585+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:29.588 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:29.585+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:29.653 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:29.652+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:29.653 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:29.652+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:29.653 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:29.652+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:29.654 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:29.652+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:30.230 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:30.230+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:30.230 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:30.230+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:30.230 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:30.230+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:30.230 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:30.230+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:30.589 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:30.588+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:30.590 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:30.588+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:30.590 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:30.588+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:30.590 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:30.588+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:30.667 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:30.665+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:30.667 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:30.665+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:30.667 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:30.665+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:30.667 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:30.665+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:31.256 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:31.256+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:31.256 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:31.256+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:31.256 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:31.256+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:31.256 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:31.256+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:31.541 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:31.540+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:31.542 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:31.540+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:31.542 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:31.540+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:31.542 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:31.540+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:31.620 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:31.620+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:31.620 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:31.620+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:31.620 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:31.620+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:31.620 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:31.620+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:31.712 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:31.712+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:31.715 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:31.712+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:31.716 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:31.712+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:31.716 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:31.712+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:32.293 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:32.293+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:32.293 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:32.293+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:32.294 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:32.293+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:32.294 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:32.293+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:32.495 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:32.495+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:32.497 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:32.495+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:32.497 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:32.495+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:32.497 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:32.495+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:32.584 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:32.583+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:32.584 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:32.583+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:32.584 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:32.583+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:32.584 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:32.583+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:32.703 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:32.703+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:32.703 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:32.703+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:32.703 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:32.703+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:32.703 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:32.703+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:33.248 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:33.247+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:33.284 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:33.247+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:33.284 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:33.247+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:33.284 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:33.247+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:33.487 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:33.487+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:33.487 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:33.487+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:33.487 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:33.487+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:33.487 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:33.487+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:33.620 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:33.620+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:33.620 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:33.620+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:33.620 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:33.620+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:33.620 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:33.620+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:33.685 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:33.682+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:33.686 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:33.682+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:33.686 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:33.682+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:33.686 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:33.682+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:34.228 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:34.228+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:34.228 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:34.228+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:41:15.900504+0000) 2023-01-01T17:43:34.228 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:34.228+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:34.228 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:34.228+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:34.495 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:34.495+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:34.495 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:34.495+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:34.496 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:34.495+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:34.496 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:34.495+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:34.536 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-01-01T17:43:34.536+0000 7fc7b8fdb700 -1 mon.a@0(probing) e1 get_health_metrics reporting 153 slow ops, oldest is log(1 entries from seq 42 at 2023-01-01T17:40:56.238062+0000) 2023-01-01T17:43:34.625 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:34.626+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:34.626 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:34.626+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:34.626 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:34.626+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:34.626 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:34.626+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:41:16.469139+0000) 2023-01-01T17:43:34.644 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:34.643+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:34.644 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:34.643+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:34.644 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:34.643+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:34.645 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:34.643+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:41:16.698831+0000) 2023-01-01T17:43:35.196 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:35.197+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:35.196 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:35.197+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:35.478 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:35.478+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:35.478 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:35.478+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:35.478 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:35.478+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:35.478 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:35.478+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:36.191 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:36.190+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:36.191 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:36.190+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:36.526 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:36.525+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:36.526 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:36.525+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:36.526 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:36.525+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:36.526 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:36.525+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:37.221 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:37.219+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:37.221 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:37.219+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:37.482 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:37.481+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:37.482 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:37.481+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:37.482 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:37.481+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:37.482 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:37.481+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:38.205 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:38.205+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:38.205 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:38.205+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:38.494 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:38.489+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:38.494 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:38.489+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:38.494 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:38.489+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:38.494 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:38.489+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:39.219 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:39.219+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:39.219 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:39.219+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:39.496 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:39.496+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:39.496 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:39.496+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:39.496 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:39.496+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:39.496 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:39.496+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:39.538 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-01-01T17:43:39.536+0000 7fc7b8fdb700 -1 mon.a@0(probing) e1 get_health_metrics reporting 187 slow ops, oldest is log(1 entries from seq 42 at 2023-01-01T17:40:56.238062+0000) 2023-01-01T17:43:40.238 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:40.237+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:40.238 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:40.237+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:40.469 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:40.469+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:40.469 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:40.469+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:40.469 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:40.469+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:40.469 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:40.469+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:41.262 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:41.262+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:41.262 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:41.262+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:41.428 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:41.428+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:41.428 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:41.428+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:41.428 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:41.428+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:41.428 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:41.428+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:42.288 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:42.287+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:42.288 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:42.287+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:42.461 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:42.461+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:42.462 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:42.461+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:42.462 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:42.461+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:42.462 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:42.461+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:43.271 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:43.270+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:43.271 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:43.270+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:43.465 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:43.465+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:43.465 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:43.465+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:43.465 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:43.465+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:43.465 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:43.465+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:44.255 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:44.254+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:44.255 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:44.254+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:44.455 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:44.456+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:44.456 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:44.456+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:44.456 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:44.456+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:44.456 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:44.456+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:44.538 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-01-01T17:43:44.537+0000 7fc7b8fdb700 -1 mon.a@0(probing) e1 get_health_metrics reporting 228 slow ops, oldest is log(1 entries from seq 42 at 2023-01-01T17:40:56.238062+0000) 2023-01-01T17:43:45.217 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:45.212+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:45.217 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:45.212+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:45.408 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:45.408+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:45.409 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:45.408+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:45.409 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:45.408+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:45.409 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:45.408+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:46.170 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:46.170+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:46.170 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:46.170+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:46.418 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:46.419+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:46.418 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:46.419+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:46.419 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:46.419+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:46.419 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:46.419+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:47.128 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:47.129+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:47.128 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:47.129+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:47.428 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:47.428+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:47.428 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:47.428+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:47.428 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:47.428+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:47.428 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:47.428+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:48.135 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:48.136+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:48.135 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:48.136+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:48.414 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:48.415+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:48.415 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:48.415+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:48.415 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:48.415+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:48.415 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:48.415+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:49.104 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:49.104+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:49.104 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:49.104+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:49.454 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:49.451+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:49.454 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:49.451+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:49.454 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:49.451+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:49.454 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:49.451+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:49.539 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-01-01T17:43:49.538+0000 7fc7b8fdb700 -1 mon.a@0(probing) e1 get_health_metrics reporting 266 slow ops, oldest is log(1 entries from seq 42 at 2023-01-01T17:40:56.238062+0000) 2023-01-01T17:43:50.067 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:50.067+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:50.067 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:50.067+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:50.455 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:50.454+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:50.455 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:50.454+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:50.455 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:50.454+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:50.455 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:50.454+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:51.115 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:51.115+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:51.115 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:51.115+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:51.161 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-01-01T17:43:51.162 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-01-01T17:43:51.163 INFO:tasks.kclient:Unmounting kernel clients... 2023-01-01T17:43:51.163 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-01-01T17:43:51.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-01T17:43:51.166 DEBUG:tasks.ceph:Missed logrotate, host unreachable 2023-01-01T17:43:51.417 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:51.417+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:51.417 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:51.417+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:51.417 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:51.417+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:51.417 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:51.417+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:51.532 DEBUG:teuthology.orchestra.run.smithi149:> true 2023-01-01T17:43:51.785 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-01T17:43:51.785 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-01-01T17:43:51.844 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=8026740k,nr_inodes=2006685,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18119 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1609048k,mode=700,uid=1000,gid=1265 0 0 2023-01-01T17:43:51.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:43:51.844 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2023-01-01T17:43:51.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:43:51.903 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link delete ceph-brx 2023-01-01T17:43:52.022 INFO:teuthology.orchestra.run.smithi149.stderr:Cannot find device "ceph-brx" 2023-01-01T17:43:52.023 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-01T17:43:52.024 INFO:tasks.kclient:Unmounting kernel clients... 2023-01-01T17:43:52.024 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-01T17:43:52.024 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-01-01T17:43:52.042 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=8026740k,nr_inodes=2006685,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18119 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1609048k,mode=700,uid=1000,gid=1265 0 0 2023-01-01T17:43:52.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:43:52.043 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2023-01-01T17:43:52.087 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:52.088+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:52.087 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:52.088+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:52.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:43:52.101 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link delete ceph-brx 2023-01-01T17:43:52.169 INFO:teuthology.orchestra.run.smithi149.stderr:Cannot find device "ceph-brx" 2023-01-01T17:43:52.170 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-01T17:43:52.171 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/run_tasks.py", line 103, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/run_tasks.py", line 82, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/run_tasks.py", line 82, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/run_tasks.py", line 82, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/workunit.py", line 345, in _run_tests remote.run(logger=log.getChild(role), File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 179, in _raise_for_status raise CommandCrashedError(command=self.command) teuthology.exceptions.CommandCrashedError: Command crashed: 'rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a' 2023-01-01T17:43:52.242 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=2e7e914c77dd4535bc9f8ad1091d9add Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/run_tasks.py", line 103, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/run_tasks.py", line 82, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/run_tasks.py", line 82, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/run_tasks.py", line 82, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/workunit.py", line 345, in _run_tests remote.run(logger=log.getChild(role), File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 179, in _raise_for_status raise CommandCrashedError(command=self.command) teuthology.exceptions.CommandCrashedError: Command crashed: 'rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a' 2023-01-01T17:43:52.245 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-01-01T17:43:52.254 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-01-01T17:43:52.254 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-01T17:43:52.399 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:52.399+0000 7f87c6648700 1 Processor -- start 2023-01-01T17:43:52.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:52.399+0000 7f87c6648700 1 -- start start 2023-01-01T17:43:52.400 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:52.400+0000 7f87c6648700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f87c00a4140 0x7f87c0155080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:43:52.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:52.400+0000 7f87c6648700 1 --2- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 0x7f87c0070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:43:52.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:52.400+0000 7f87c6648700 1 -- --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c0154630 con 0x7f87c00c2b80 2023-01-01T17:43:52.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:52.400+0000 7f87c6648700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87c00a4140 2023-01-01T17:43:52.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:52.400+0000 7f87c6648700 1 -- --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00c08a0 con 0x7f87c00c1560 2023-01-01T17:43:52.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:52.400+0000 7f87bffff700 1 -- >> v2:172.21.15.149:3300/0 conn(0x7f87c00a4140 msgr2=0x7f87c0155080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:43:52.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:52.400+0000 7f87c4be5700 1 -- >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 msgr2=0x7f87c0070bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:43:52.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:52.400+0000 7f87bf7fe700 1 --1- >> v1:172.21.15.61:6789/0 conn(0x7f87c00c2b80 0x7f87c00bffe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.61:6789/0 says I am v1:172.21.15.61:43980/0 (socket says 172.21.15.61:43980) 2023-01-01T17:43:52.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:52.400+0000 7f87bffff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f87c00a4140 0x7f87c0155080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:43:52.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:52.400+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 0x7f87c0070bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:43:52.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:52.400+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 learned_addr learned my addr 172.21.15.61:0/268967012 (peer_addr_for_me v1:172.21.15.61:0/0) 2023-01-01T17:43:52.445 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:52.445+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:52.445 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:52.445+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:52.445 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:52.445+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:52.446 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:52.445+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:52.600 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:52.601+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 msgr2=0x7f87c0070bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:43:52.601 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:52.601+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87c00a4140 msgr2=0x7f87c0155080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:43:52.601 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:52.601+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 0x7f87c0070bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:43:52.601 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:52.601+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87c00a4140 0x7f87c0155080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:43:53.001 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:53.002+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 msgr2=0x7f87c0070bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:43:53.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:53.002+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87c00a4140 msgr2=0x7f87c0155080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:43:53.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:53.002+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 0x7f87c0070bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:43:53.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:53.002+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87c00a4140 0x7f87c0155080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:43:53.130 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:53.130+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:53.130 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:53.130+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:53.413 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:53.413+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:53.414 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:53.413+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:53.414 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:53.413+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:53.414 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:53.413+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:53.473 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-01-01T17:43:53.474 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-01-01T17:43:53.474 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-01-01T17:43:53.474 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-01-01T17:43:53.474 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-01-01T17:43:53.474 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-01-01T17:43:53.474 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-01-01T17:43:53.475 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-01-01T17:43:53.475 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2023-01-01T17:43:53.802 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:53.803+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87c00a4140 msgr2=0x7f87c0155080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:43:53.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:53.803+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 msgr2=0x7f87c0070bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:43:53.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:53.803+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87c00a4140 0x7f87c0155080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:43:53.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:53.803+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 0x7f87c0070bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:43:54.093 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:54.093+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:54.213 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:54.093+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:54.445 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:54.446+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:54.445 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:54.446+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:54.446 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:54.446+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:54.446 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:54.446+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:54.539 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-01-01T17:43:54.539+0000 7fc7b8fdb700 -1 mon.a@0(probing) e1 get_health_metrics reporting 303 slow ops, oldest is log(1 entries from seq 42 at 2023-01-01T17:40:56.238062+0000) 2023-01-01T17:43:54.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:54.539+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87c00c2b80 legacy=0x7f87c00bffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-01-01T17:43:54.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:54.539+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87c00c2b80 legacy=0x7f87c00bffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-01-01T17:43:54.550 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:54.539+0000 7f87bf7fe700 1 --1- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87c00c2b80 0x7f87c00bffe0 :-1 s=OPENED pgs=617 cs=1 l=1).handle_message read tag failed 2023-01-01T17:43:54.551 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:54.539+0000 7f87bf7fe700 1 --1- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87c00c2b80 0x7f87c00bffe0 :-1 s=OPENED pgs=617 cs=1 l=1).fault on lossy channel, failing 2023-01-01T17:43:55.135 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:55.135+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:55.142 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:55.135+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:55.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:55.401+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 msgr2=0x7f87c0070bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:43:55.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:55.401+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 0x7f87c0070bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:43:55.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:55.401+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87c00a4140 msgr2=0x7f87c0155080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:43:55.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:55.401+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87c00a4140 0x7f87c0155080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:43:55.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:55.401+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87c00c2b80 legacy=0x7f87c00bffe0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-01-01T17:43:55.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:55.401+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0007340 0x7f87a00097f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:43:55.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:55.401+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c00c0b80 con 0x7f87a00036a0 2023-01-01T17:43:55.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:55.401+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a0007340 2023-01-01T17:43:55.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:55.401+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a00036a0 legacy=0x7f87a0005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:43:55.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:55.401+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0007340 0x7f87a00097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:43:55.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:55.401+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0007340 msgr2=0x7f87a00097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-01-01T17:43:55.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:55.401+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0007340 msgr2=0x7f87a00097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:43:55.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:55.401+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0007340 0x7f87a00097f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:43:55.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:55.401+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0007340 0x7f87a00097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:43:55.435 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:55.435+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:43:55.435 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:55.435+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:43:55.435 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:55.435+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:43:55.435 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:55.435+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:43:55.495 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:55.495+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:55.495 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:55.495+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:55.495 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:55.495+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:55.495 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:55.495+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:55.603 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:55.602+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0007340 0x7f87a00097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:43:55.604 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:55.602+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a00036a0 legacy=0x7f87a0005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:43:55.604 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:55.602+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0007340 msgr2=0x7f87a00097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-01-01T17:43:55.604 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:55.602+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0007340 msgr2=0x7f87a00097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:43:55.604 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:55.602+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0007340 0x7f87a00097f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:43:55.605 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:55.602+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0007340 0x7f87a00097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:43:56.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:56.003+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a00036a0 legacy=0x7f87a0005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:43:56.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:56.003+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0007340 0x7f87a00097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:43:56.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:56.003+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0007340 msgr2=0x7f87a00097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-01-01T17:43:56.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:56.003+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0007340 msgr2=0x7f87a00097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:43:56.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:56.003+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0007340 0x7f87a00097f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:43:56.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:56.003+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0007340 0x7f87a00097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:43:56.095 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:56.095+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:43:56.095 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:56.095+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:43:56.095 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:56.095+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:56.095 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:56.095+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:56.407 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:56.406+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:43:56.407 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:56.406+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:43:56.407 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:56.406+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:43:56.407 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:56.406+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:43:56.532 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:56.532+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:56.532 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:56.532+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:56.532 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:56.532+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:56.532 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:56.532+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:56.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:56.804+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a00036a0 legacy=0x7f87a0005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:43:56.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:56.804+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0007340 0x7f87a00097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:43:56.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:56.804+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0007340 msgr2=0x7f87a00097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:43:56.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:56.804+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0007340 msgr2=0x7f87a00097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:43:56.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:56.804+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0007340 0x7f87a00097f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:43:56.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:56.804+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0007340 0x7f87a00097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:43:57.062 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:57.062+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:43:57.062 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:57.062+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:43:57.063 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:57.062+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:57.064 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:57.062+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:57.435 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:57.436+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:43:57.436 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:57.436+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:43:57.436 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:57.436+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:43:57.436 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:57.436+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:43:57.534 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:57.534+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:57.534 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:57.534+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:57.534 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:57.534+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:57.534 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:57.534+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:57.723 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:57.719+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:43:57.723 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:57.719+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:43:57.723 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:57.719+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:43:57.723 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:57.719+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:43:58.048 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:58.049+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:43:58.049 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:58.049+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:43:58.049 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:58.049+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:58.049 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:58.049+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:58.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:58.401+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0007340 msgr2=0x7f87a00097f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:43:58.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:58.401+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0007340 0x7f87a00097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:43:58.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:58.401+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a00036a0 legacy=0x7f87a0005b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:43:58.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:58.401+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 reap_dead start 2023-01-01T17:43:58.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:58.401+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 0x7f87a0009ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:43:58.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:58.401+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00098b0 0x7f87a000a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:43:58.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:58.401+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a000af00 con 0x7f87a000a3e0 2023-01-01T17:43:58.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:58.401+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a00098b0 2023-01-01T17:43:58.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:58.401+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00c08a0 con 0x7f87c00c1560 2023-01-01T17:43:58.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:58.401+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00098b0 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:43:58.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:58.401+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 msgr2=0x7f87a0009ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:43:58.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:58.401+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a000a3e0 legacy=0x7f87a0006240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:43:58.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:58.401+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 0x7f87a0009ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:43:58.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:58.401+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00098b0 0x7f87a000a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:43:58.451 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:58.451+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:43:58.452 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:58.451+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:43:58.452 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:58.452+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:43:58.453 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:58.452+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:43:58.565 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:58.565+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:58.565 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:58.565+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:58.565 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:58.565+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:58.566 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:58.565+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:58.602 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:58.602+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a000a3e0 legacy=0x7f87a0006240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:43:58.602 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:58.602+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 msgr2=0x7f87a0009ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:43:58.602 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:58.602+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00098b0 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:43:58.602 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:58.602+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 0x7f87a0009ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:43:58.602 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:58.602+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00098b0 0x7f87a000a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:43:58.707 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:58.708+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:43:58.709 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:58.708+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:43:58.709 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:58.708+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:43:58.710 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:58.708+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:43:59.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:59.003+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00098b0 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:43:59.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:59.003+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a000a3e0 legacy=0x7f87a0006240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:43:59.002 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:59.003+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 msgr2=0x7f87a0009ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:43:59.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:59.003+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 0x7f87a0009ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:43:59.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:59.003+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00098b0 0x7f87a000a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:43:59.095 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:59.095+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:43:59.095 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:59.095+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:43:59.096 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:59.095+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:59.096 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:43:59.095+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:43:59.284 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~6s 2023-01-01T17:43:59.284 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~6s 2023-01-01T17:43:59.284 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~6s 2023-01-01T17:43:59.284 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~6s 2023-01-01T17:43:59.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~6s 2023-01-01T17:43:59.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~6s 2023-01-01T17:43:59.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~6s 2023-01-01T17:43:59.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~6s 2023-01-01T17:43:59.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~6s 2023-01-01T17:43:59.439 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:59.440+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:43:59.439 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:59.440+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:43:59.440 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:59.440+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:43:59.440 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:43:59.440+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:43:59.521 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:59.522+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:59.521 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:59.522+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:59.521 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:59.522+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:59.522 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:43:59.522+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:43:59.540 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-01-01T17:43:59.540+0000 7fc7b8fdb700 -1 mon.a@0(probing) e1 get_health_metrics reporting 341 slow ops, oldest is log(1 entries from seq 42 at 2023-01-01T17:40:56.238062+0000) 2023-01-01T17:43:59.699 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:59.700+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:43:59.699 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:59.700+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:43:59.699 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:59.700+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:43:59.700 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:43:59.700+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:43:59.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:59.804+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a000a3e0 legacy=0x7f87a0006240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:43:59.803 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:59.804+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 msgr2=0x7f87a0009ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:43:59.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:59.804+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00098b0 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:43:59.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:59.804+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 0x7f87a0009ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:43:59.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:43:59.804+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00098b0 0x7f87a000a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:44:00.143 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:00.144+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:00.143 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:00.144+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:00.143 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:00.144+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:00.144 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:00.144+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:00.422 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:00.423+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:00.423 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:00.423+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:00.423 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:00.423+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:00.423 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:00.423+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:00.537 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:00.538+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:00.537 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:00.538+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:00.538 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:00.538+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:00.538 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:00.538+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:00.654 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:00.655+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:00.654 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:00.655+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:00.654 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:00.655+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:00.655 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:00.655+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:01.148 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:01.149+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:01.149 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:01.149+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:01.149 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:01.149+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:01.149 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:01.149+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:01.401 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:01.401+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 msgr2=0x7f87a0009ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:01.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:01.401+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 0x7f87a0009ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:44:01.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:01.401+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00098b0 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:01.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:01.402+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00098b0 0x7f87a000a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:44:01.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:01.402+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a000a3e0 legacy=0x7f87a0006240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:01.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:01.402+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005be0 0x7f87a00069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:44:01.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:01.402+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c00c0b80 con 0x7f87a0004a80 2023-01-01T17:44:01.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:01.402+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a0005be0 2023-01-01T17:44:01.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:01.402+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005be0 0x7f87a00069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:01.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:01.402+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005be0 msgr2=0x7f87a00069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:44:01.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:01.402+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005be0 msgr2=0x7f87a00069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:01.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:01.402+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005be0 0x7f87a00069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:01.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:01.402+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005be0 0x7f87a00069e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:44:01.473 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:01.473+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:01.473 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:01.473+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:01.473 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:01.473+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:01.473 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:01.473+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:01.529 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:01.529+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:01.529 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:01.529+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:01.529 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:01.529+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:01.529 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:01.529+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:01.603 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:01.603+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005be0 0x7f87a00069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:01.603 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:01.603+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005be0 msgr2=0x7f87a00069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:44:01.604 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:01.603+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005be0 msgr2=0x7f87a00069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:01.604 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:01.603+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005be0 0x7f87a00069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:01.604 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:01.603+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005be0 0x7f87a00069e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:44:01.651 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:01.651+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:01.652 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:01.651+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:01.652 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:01.651+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:01.652 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:01.651+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:02.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:02.004+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005be0 0x7f87a00069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:02.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:02.004+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005be0 msgr2=0x7f87a00069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:44:02.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:02.004+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005be0 msgr2=0x7f87a00069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:02.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:02.004+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005be0 0x7f87a00069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:02.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:02.004+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005be0 0x7f87a00069e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:44:02.104 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:02.105+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:02.104 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:02.105+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:02.107 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:02.105+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:02.107 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:02.105+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:02.449 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:02.449+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:02.449 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:02.449+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:02.449 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:02.449+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:02.449 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:02.449+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:02.497 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:02.497+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:02.497 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:02.497+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:02.498 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:02.497+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:02.498 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:02.497+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:02.658 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:02.658+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:02.658 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:02.658+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:02.658 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:02.658+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:02.658 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:02.658+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:02.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:02.805+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005be0 0x7f87a00069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:02.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:02.805+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005be0 msgr2=0x7f87a00069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:44:02.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:02.805+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005be0 msgr2=0x7f87a00069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:02.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:02.805+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005be0 0x7f87a00069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:02.806 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:02.805+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005be0 0x7f87a00069e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:44:03.091 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:03.091+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:03.091 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:03.091+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:03.091 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:03.091+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:03.091 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:03.091+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:03.415 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:03.416+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:03.415 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:03.416+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:03.416 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:03.416+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:03.416 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:03.416+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:03.537 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:03.535+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:03.538 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:03.535+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:03.538 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:03.535+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:03.538 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:03.535+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:03.656 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:03.656+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:03.656 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:03.656+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:03.657 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:03.656+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:03.657 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:03.656+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:04.071 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:04.072+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:04.071 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:04.072+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:04.072 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:04.072+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:04.072 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:04.072+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:04.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:04.402+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005be0 msgr2=0x7f87a00069e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:04.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:04.402+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005be0 0x7f87a00069e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:44:04.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:04.402+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0004a80 legacy=0x7f87a0004e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:44:04.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:04.402+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 0x7f87a0009e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:44:04.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:04.402+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 reap_dead start 2023-01-01T17:44:04.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:04.402+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00069e0 0x7f87a000a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:44:04.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:04.402+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a000af00 con 0x7f87a0005590 2023-01-01T17:44:04.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:04.402+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a00069e0 2023-01-01T17:44:04.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:04.402+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00c08a0 con 0x7f87c00c1560 2023-01-01T17:44:04.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:04.402+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 msgr2=0x7f87a0009e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:44:04.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:04.402+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00069e0 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:04.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:04.402+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 0x7f87a0009e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:44:04.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:04.402+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00069e0 0x7f87a000a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:44:04.446 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:04.446+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:04.446 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:04.447+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:04.446 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:04.447+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:04.447 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:04.447+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:04.541 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-01-01T17:44:04.541+0000 7fc7b8fdb700 -1 mon.a@0(probing) e1 get_health_metrics reporting 378 slow ops, oldest is log(1 entries from seq 42 at 2023-01-01T17:40:56.238062+0000) 2023-01-01T17:44:04.541 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:04.541+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0005590 legacy=0x7f87a0006240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2023-01-01T17:44:04.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:04.541+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0005590 legacy=0x7f87a0006240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-01-01T17:44:04.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:04.541+0000 7f87bf7fe700 1 --1- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0005590 0x7f87a0006240 :-1 s=OPENED pgs=645 cs=1 l=1).handle_message read tag failed 2023-01-01T17:44:04.542 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:04.541+0000 7f87bf7fe700 1 --1- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0005590 0x7f87a0006240 :-1 s=OPENED pgs=645 cs=1 l=1).fault on lossy channel, failing 2023-01-01T17:44:04.550 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:04.550+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:04.550 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:04.550+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:04.550 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:04.550+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:04.550 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:04.550+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:04.603 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:04.603+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00069e0 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:04.603 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:04.603+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 msgr2=0x7f87a0009e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:44:04.603 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:04.603+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00069e0 0x7f87a000a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:44:04.603 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:04.603+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 0x7f87a0009e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:44:04.696 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:04.697+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:04.697 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:04.697+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:04.697 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:04.697+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:04.697 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:04.697+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:05.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:05.004+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 msgr2=0x7f87a0009e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:44:05.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:05.004+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00069e0 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:05.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:05.004+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00069e0 0x7f87a000a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:44:05.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:05.004+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 0x7f87a0009e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:44:05.079 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:05.080+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:05.080 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:05.080+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:05.080 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:05.080+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:05.080 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:05.080+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:05.094 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~12s 2023-01-01T17:44:05.095 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~12s 2023-01-01T17:44:05.095 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~12s 2023-01-01T17:44:05.095 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~12s 2023-01-01T17:44:05.095 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~12s 2023-01-01T17:44:05.095 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~12s 2023-01-01T17:44:05.095 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~12s 2023-01-01T17:44:05.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~12s 2023-01-01T17:44:05.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~12s 2023-01-01T17:44:05.460 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:05.460+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:05.460 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:05.460+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:05.460 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:05.460+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:05.460 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:05.460+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:05.544 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:05.544+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:05.544 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:05.544+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:05.544 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:05.544+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:05.544 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:05.544+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:05.672 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:05.673+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:05.672 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:05.673+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:05.672 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:05.673+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:05.673 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:05.673+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:05.804 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:05.805+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00069e0 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:05.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:05.805+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 msgr2=0x7f87a0009e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:44:05.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:05.805+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00069e0 0x7f87a000a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:44:05.805 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:05.805+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 0x7f87a0009e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:44:06.099 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:06.100+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:06.099 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:06.100+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:06.100 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:06.100+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:06.100 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:06.100+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:06.488 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:06.488+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:06.488 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:06.488+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:06.488 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:06.488+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:06.488 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:06.488+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:06.499 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:06.500+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:06.499 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:06.500+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:06.500 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:06.500+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:06.500 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:06.500+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:06.681 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:06.681+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:06.682 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:06.681+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:06.682 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:06.681+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:06.682 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:06.681+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:07.113 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:07.114+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:07.113 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:07.114+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:07.114 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:07.114+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:07.114 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:07.114+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:07.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:07.402+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 msgr2=0x7f87a0009e80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:07.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:07.402+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 0x7f87a0009e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:44:07.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:07.402+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00069e0 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:07.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:07.402+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00069e0 0x7f87a000a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:44:07.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:07.402+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0005590 legacy=0x7f87a0006240 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-01-01T17:44:07.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:07.402+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0011320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:44:07.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:07.402+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a00070e0 con 0x7f87a0011860 2023-01-01T17:44:07.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:07.402+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a0004e80 2023-01-01T17:44:07.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:07.402+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0011860 legacy=0x7f87a0013c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:07.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:07.402+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0011320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:07.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:07.403+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0011320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-01-01T17:44:07.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:07.403+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0011320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:07.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:07.403+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0011320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:07.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:07.403+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0011320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:44:07.471 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:07.471+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:07.471 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:07.471+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:07.471 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:07.471+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:07.471 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:07.471+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:07.534 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:07.533+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:07.534 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:07.533+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:07.534 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:07.533+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:07.534 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:07.533+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:07.602 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:07.603+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0011860 legacy=0x7f87a0013c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:07.603 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:07.604+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0011320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:07.603 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:07.604+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0011320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:44:07.603 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:07.604+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0011320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:07.604 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:07.604+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0011320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:07.604 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:07.604+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0011320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:44:07.726 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:07.726+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:07.726 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:07.726+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:07.726 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:07.726+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:07.726 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:07.726+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:08.003 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:08.004+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0011860 legacy=0x7f87a0013c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:08.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:08.005+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0011320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:08.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:08.005+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0011320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:44:08.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:08.005+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0011320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:08.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:08.005+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0011320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:08.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:08.005+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0011320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:44:08.085 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:08.086+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:08.085 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:08.086+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:08.086 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:08.086+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:08.086 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:08.086+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:08.441 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:08.442+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:08.441 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:08.442+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:08.441 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:08.442+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:08.441 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:08.442+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:08.553 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:08.554+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:08.554 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:08.554+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:08.554 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:08.554+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:08.554 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:08.554+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:08.748 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:08.749+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:08.749 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:08.749+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:08.749 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:08.749+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:08.749 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:08.749+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:08.806 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:08.805+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0011860 legacy=0x7f87a0013c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:08.806 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:08.806+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0011320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:08.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:08.806+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0011320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:44:08.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:08.806+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0011320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:08.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:08.806+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0011320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:08.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:08.806+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0011320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:44:09.128 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:09.127+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:09.128 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:09.127+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:09.128 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:09.127+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:09.128 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:09.127+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:09.467 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:09.468+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:09.467 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:09.468+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:09.467 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:09.468+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:09.468 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:09.468+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:09.541 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-01-01T17:44:09.541+0000 7fc7b8fdb700 -1 mon.a@0(probing) e1 get_health_metrics reporting 416 slow ops, oldest is log(1 entries from seq 42 at 2023-01-01T17:40:56.238062+0000) 2023-01-01T17:44:09.577 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:09.578+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:09.578 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:09.578+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:09.578 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:09.578+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:09.578 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:09.578+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:09.758 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:09.759+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:09.759 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:09.759+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:09.759 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:09.759+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:09.759 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:09.759+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:10.150 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:10.151+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:10.151 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:10.151+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:10.151 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:10.151+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:10.151 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:10.151+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:10.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:10.402+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0011320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:10.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:10.402+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0011320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:44:10.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:10.402+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0011860 legacy=0x7f87a0013c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:10.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:10.402+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 0x7f87a0009e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:44:10.498 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:10.402+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 reap_dead start 2023-01-01T17:44:10.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:10.403+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a000a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:44:10.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:10.403+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a0016370 con 0x7f87a0005590 2023-01-01T17:44:10.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:10.403+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a0004e80 2023-01-01T17:44:10.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:10.403+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00c08a0 con 0x7f87c00c1560 2023-01-01T17:44:10.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:10.403+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 msgr2=0x7f87a0009e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:44:10.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:10.403+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a000a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:10.499 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:10.403+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 0x7f87a0009e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:44:10.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:10.403+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-01-01T17:44:10.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:10.403+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:10.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:10.403+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a000a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:10.500 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:10.403+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a000a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:44:10.515 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:10.515+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:10.516 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:10.515+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:10.516 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:10.515+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:10.516 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:10.515+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:10.547 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:10.548+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:10.548 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:10.548+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:10.548 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:10.548+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:10.548 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:10.548+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:10.603 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:10.604+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a000a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:10.603 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:10.604+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 msgr2=0x7f87a0009e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:44:10.604 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:10.604+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 0x7f87a0009e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:44:10.604 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:10.604+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-01-01T17:44:10.604 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:10.604+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:10.604 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:10.604+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a000a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:10.604 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:10.604+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a000a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:44:10.738 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:10.739+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:10.739 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:10.739+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:10.740 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:10.739+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:10.740 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:10.739+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:10.905 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~17s 2023-01-01T17:44:10.905 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~17s 2023-01-01T17:44:10.905 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~17s 2023-01-01T17:44:10.905 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~17s 2023-01-01T17:44:10.905 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~17s 2023-01-01T17:44:10.906 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~17s 2023-01-01T17:44:10.906 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~17s 2023-01-01T17:44:10.906 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~17s 2023-01-01T17:44:10.906 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~17s 2023-01-01T17:44:11.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:11.005+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 msgr2=0x7f87a0009e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:44:11.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:11.005+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 0x7f87a0009e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:44:11.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:11.005+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a000a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:11.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:11.005+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:44:11.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:11.005+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:11.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:11.005+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a000a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:11.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:11.005+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a000a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:44:11.147 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:11.148+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:11.148 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:11.148+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:11.148 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:11.148+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:11.148 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:11.148+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:11.542 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:11.543+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:11.543 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:11.543+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:11.543 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:11.543+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:11.543 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:11.543+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:11.543 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:11.543+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:11.543 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:11.543+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:11.544 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:11.543+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:11.544 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:11.543+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:11.772 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:11.769+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:11.773 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:11.769+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:11.773 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:11.769+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:11.773 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:11.769+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:11.806 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:11.806+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 msgr2=0x7f87a0009e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:44:11.806 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:11.806+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 0x7f87a0009e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:44:11.806 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:11.806+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a000a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:11.806 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:11.806+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-01-01T17:44:11.806 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:11.806+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:11.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:11.806+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a000a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:11.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:11.806+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a000a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:44:12.109 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:12.110+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:12.110 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:12.110+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:12.110 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:12.110+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:12.110 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:12.110+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:12.543 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:12.544+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:12.544 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:12.544+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:12.544 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:12.544+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:12.544 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:12.544+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:12.565 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:12.566+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:12.565 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:12.566+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:12.565 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:12.566+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:12.566 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:12.566+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:12.799 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:12.800+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:12.800 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:12.800+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:12.800 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:12.800+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:12.800 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:12.800+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:13.114 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:13.115+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:13.114 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:13.115+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:13.115 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:13.115+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:13.115 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:13.115+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:13.402 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:13.403+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 msgr2=0x7f87a0009e80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:13.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:13.403+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 0x7f87a0009e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:44:13.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:13.403+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:13.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:13.403+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a000a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:44:13.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:13.403+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0005590 legacy=0x7f87a0006240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:44:13.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:13.403+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0012b40 0x7f87a0014f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:44:13.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:13.403+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a00070e0 con 0x7f87a00069e0 2023-01-01T17:44:13.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:13.403+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a0012b40 2023-01-01T17:44:13.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:13.403+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0012b40 msgr2=0x7f87a0014f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:13.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:13.403+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a00069e0 legacy=0x7f87a0011320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:13.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:13.403+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0012b40 0x7f87a0014f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:44:13.531 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:13.531+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:13.531 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:13.531+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:13.531 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:13.531+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:13.531 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:13.531+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:13.597 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:13.598+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:13.597 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:13.598+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:13.597 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:13.598+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:13.597 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:13.598+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:13.603 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:13.604+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a00069e0 legacy=0x7f87a0011320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:13.603 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:13.604+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0012b40 msgr2=0x7f87a0014f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:13.603 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:13.604+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0012b40 0x7f87a0014f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:44:13.805 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:13.806+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:13.806 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:13.806+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:13.806 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:13.806+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:13.806 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:13.806+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:14.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:14.005+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a00069e0 legacy=0x7f87a0011320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:14.004 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:14.005+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0012b40 msgr2=0x7f87a0014f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:14.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:14.005+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0012b40 0x7f87a0014f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:44:14.083 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:14.084+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:14.083 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:14.084+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:14.084 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:14.084+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:14.084 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:14.084+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:14.542 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-01-01T17:44:14.542+0000 7fc7b8fdb700 -1 mon.a@0(probing) e1 get_health_metrics reporting 453 slow ops, oldest is log(1 entries from seq 42 at 2023-01-01T17:40:56.238062+0000) 2023-01-01T17:44:14.551 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:14.551+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:14.555 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:14.551+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:14.555 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:14.552+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:14.555 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:14.552+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:14.593 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:14.592+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:14.594 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:14.592+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:14.594 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:14.592+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:14.594 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:14.592+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:14.794 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:14.795+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:14.795 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:14.795+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:14.795 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:14.795+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:14.795 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:14.795+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:14.809 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:14.806+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0012b40 msgr2=0x7f87a0014f50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:14.809 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:14.806+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a00069e0 legacy=0x7f87a0011320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:14.809 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:14.806+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0012b40 0x7f87a0014f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:44:15.082 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:15.083+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:15.083 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:15.083+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:15.083 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:15.083+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:15.083 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:15.083+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:15.513 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:15.512+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:15.513 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:15.512+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:15.513 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:15.512+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:15.513 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:15.512+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:15.613 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:15.612+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:15.613 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:15.612+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:15.613 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:15.612+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:15.613 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:15.612+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:15.826 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:15.826+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:15.826 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:15.826+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:15.826 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:15.826+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:15.827 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:15.826+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:16.046 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:16.046+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:16.046 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:16.046+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:16.046 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:16.046+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:16.047 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:16.046+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:16.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:16.402+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0012b40 msgr2=0x7f87a0014f50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:16.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:16.402+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0012b40 0x7f87a0014f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:44:16.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:16.402+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a00069e0 legacy=0x7f87a0011320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:16.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:16.402+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 reap_dead start 2023-01-01T17:44:16.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:16.402+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 0x7f87a0009e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:44:16.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:16.402+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a000a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:44:16.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:16.402+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a00155f0 con 0x7f87a0005590 2023-01-01T17:44:16.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:16.402+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a0004e80 2023-01-01T17:44:16.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:16.402+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00c08a0 con 0x7f87c00c1560 2023-01-01T17:44:16.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:16.403+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 msgr2=0x7f87a0009e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:44:16.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:16.403+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0005590 legacy=0x7f87a0006240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:16.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:16.403+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 0x7f87a0009e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:44:16.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:16.403+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a000a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:16.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:16.403+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-01-01T17:44:16.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:16.403+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:16.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:16.403+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a000a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:16.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:16.403+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a000a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:44:16.535 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:16.530+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:16.536 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:16.530+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:16.536 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:16.530+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:16.536 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:16.530+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:16.606 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:16.604+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a000a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:16.606 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:16.604+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 msgr2=0x7f87a0009e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:44:16.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:16.604+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0005590 legacy=0x7f87a0006240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:16.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:16.604+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 0x7f87a0009e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:44:16.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:16.604+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:44:16.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:16.604+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:16.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:16.604+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a000a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:16.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:16.604+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a000a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:44:16.653 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:16.653+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:16.654 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:16.653+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:16.654 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:16.653+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:16.654 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:16.653+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:16.719 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~23s 2023-01-01T17:44:16.720 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~23s 2023-01-01T17:44:16.720 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~23s 2023-01-01T17:44:16.720 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~23s 2023-01-01T17:44:16.720 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~23s 2023-01-01T17:44:16.721 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~23s 2023-01-01T17:44:16.721 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~23s 2023-01-01T17:44:16.721 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~23s 2023-01-01T17:44:16.722 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~23s 2023-01-01T17:44:16.809 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:16.807+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:16.809 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:16.807+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:16.810 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:16.807+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:16.810 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:16.807+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:17.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:17.005+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 msgr2=0x7f87a0009e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:44:17.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:17.005+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a000a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:17.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:17.005+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0005590 legacy=0x7f87a0006240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:17.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:17.005+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 0x7f87a0009e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:44:17.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:17.005+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:44:17.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:17.005+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:17.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:17.005+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a000a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:17.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:17.005+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a000a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:44:17.036 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:17.029+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:17.037 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:17.029+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:17.037 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:17.029+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:17.037 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:17.029+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:17.557 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:17.556+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:17.557 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:17.556+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:17.557 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:17.556+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:17.557 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:17.556+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:17.655 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:17.655+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:17.656 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:17.655+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:17.656 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:17.655+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:17.656 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:17.655+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:17.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:17.806+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 msgr2=0x7f87a0009e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:44:17.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:17.806+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0005590 legacy=0x7f87a0006240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:17.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:17.806+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 0x7f87a0009e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:44:17.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:17.806+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a000a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:17.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:17.806+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-01-01T17:44:17.809 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:17.806+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:17.809 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:17.806+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a000a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:17.813 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:17.806+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a000a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:44:17.842 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:17.842+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:17.843 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:17.842+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:17.843 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:17.842+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:17.843 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:17.842+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:17.981 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:17.980+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:17.981 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:17.980+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:17.981 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:17.980+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:17.981 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:17.980+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:18.605 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:18.605+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:18.605 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:18.605+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:18.605 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:18.605+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:18.605 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:18.605+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:18.640 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:18.640+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:18.640 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:18.640+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:18.640 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:18.640+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:18.641 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:18.640+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:18.795 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:18.795+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:18.796 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:18.795+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:18.796 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:18.795+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:18.796 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:18.795+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:18.980 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:18.979+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:18.986 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:18.979+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:18.986 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:18.979+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:18.986 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:18.979+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:19.403 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:19.403+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 msgr2=0x7f87a0009e80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:19.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:19.403+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 0x7f87a0009e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:44:19.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:19.403+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:19.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:19.403+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a000a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:44:19.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:19.403+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0005590 legacy=0x7f87a0006240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:19.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:19.403+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00069e0 0x7f87a0014f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:44:19.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:19.403+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a00070e0 con 0x7f87a0012b40 2023-01-01T17:44:19.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:19.403+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a00069e0 2023-01-01T17:44:19.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:19.403+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00069e0 msgr2=0x7f87a0014f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:19.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:19.403+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00069e0 0x7f87a0014f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:44:19.545 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-01-01T17:44:19.542+0000 7fc7b8fdb700 -1 mon.a@0(probing) e1 get_health_metrics reporting 491 slow ops, oldest is log(1 entries from seq 42 at 2023-01-01T17:40:56.238062+0000) 2023-01-01T17:44:19.545 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:19.543+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0012b40 legacy=0x7f87a0011320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-01-01T17:44:19.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:19.543+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0012b40 legacy=0x7f87a0011320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-01-01T17:44:19.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:19.543+0000 7f87bf7fe700 1 --1- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0012b40 0x7f87a0011320 :-1 s=OPENED pgs=685 cs=1 l=1).handle_message read tag failed 2023-01-01T17:44:19.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:19.543+0000 7f87bf7fe700 1 --1- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0012b40 0x7f87a0011320 :-1 s=OPENED pgs=685 cs=1 l=1).fault on lossy channel, failing 2023-01-01T17:44:19.604 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:19.603+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:19.604 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:19.603+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:19.604 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:19.603+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:19.604 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:19.603+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:19.605 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:19.604+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00069e0 msgr2=0x7f87a0014f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:19.605 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:19.604+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00069e0 0x7f87a0014f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:44:19.677 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:19.676+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:19.677 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:19.676+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:19.677 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:19.676+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:19.678 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:19.676+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:19.825 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:19.825+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:19.826 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:19.825+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:19.826 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:19.825+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:19.826 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:19.825+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:19.948 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:19.948+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:19.948 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:19.948+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:19.948 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:19.948+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:19.949 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:19.948+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:20.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:20.005+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00069e0 msgr2=0x7f87a0014f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:20.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:20.005+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00069e0 0x7f87a0014f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:44:20.588 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:20.588+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:20.588 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:20.588+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:20.588 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:20.588+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:20.589 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:20.588+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:20.693 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:20.692+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:20.694 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:20.692+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:20.694 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:20.692+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:20.694 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:20.692+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:20.806 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:20.806+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00069e0 msgr2=0x7f87a0014f20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:20.822 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:20.806+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00069e0 0x7f87a0014f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:44:20.851 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:20.850+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:20.851 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:20.850+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:20.851 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:20.850+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:20.851 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:20.850+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:20.945 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:20.945+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:20.946 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:20.945+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:20.946 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:20.945+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:20.946 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:20.945+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:21.167 DEBUG:teuthology.orchestra.run.smithi061:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-01-01T17:44:21.179 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-01-01T17:44:21.599 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:21.599+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:21.599 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:21.599+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:21.599 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:21.599+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:21.600 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:21.599+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:21.658 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:21.658+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:21.658 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:21.658+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:21.658 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:21.658+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:21.659 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:21.658+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:21.896 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:21.895+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:21.896 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:21.895+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:21.896 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:21.895+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:21.896 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:21.895+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:21.942 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:21.938+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:21.942 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:21.938+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:21.942 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:21.938+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:21.943 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:21.938+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:22.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:22.403+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00069e0 msgr2=0x7f87a0014f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:22.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:22.403+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00069e0 0x7f87a0014f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:44:22.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:22.403+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0012b40 legacy=0x7f87a0011320 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-01-01T17:44:22.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:22.403+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 reap_dead start 2023-01-01T17:44:22.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:22.403+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00157e0 0x7f87a0015bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:44:22.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:22.403+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 0x7f87a0009e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:44:22.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:22.403+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a00155f0 con 0x7f87a0004e80 2023-01-01T17:44:22.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:22.403+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a00157e0 2023-01-01T17:44:22.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:22.403+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00c08a0 con 0x7f87c00c1560 2023-01-01T17:44:22.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:22.403+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00157e0 msgr2=0x7f87a0015bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:22.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:22.403+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 msgr2=0x7f87a0009e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:44:22.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:22.403+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0004e80 legacy=0x7f87a0006240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:22.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:22.403+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 0x7f87a0009e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:44:22.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:22.403+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00157e0 0x7f87a0015bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:44:22.528 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~29s 2023-01-01T17:44:22.528 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~29s 2023-01-01T17:44:22.529 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~29s 2023-01-01T17:44:22.529 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~29s 2023-01-01T17:44:22.529 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~29s 2023-01-01T17:44:22.529 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~29s 2023-01-01T17:44:22.529 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~29s 2023-01-01T17:44:22.529 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~29s 2023-01-01T17:44:22.529 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~29s 2023-01-01T17:44:22.550 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:22.550+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:22.551 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:22.550+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:22.551 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:22.550+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:22.551 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:22.550+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:22.604 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:22.604+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 msgr2=0x7f87a0009e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:44:22.605 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:22.604+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00157e0 msgr2=0x7f87a0015bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:22.605 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:22.604+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0004e80 legacy=0x7f87a0006240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:22.605 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:22.604+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 0x7f87a0009e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:44:22.605 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:22.604+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00157e0 0x7f87a0015bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:44:22.668 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:22.668+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:22.668 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:22.668+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:22.669 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:22.668+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:22.669 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:22.668+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:22.910 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:22.909+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:22.910 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:22.909+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:22.910 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:22.909+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:22.910 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:22.909+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:22.935 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:22.935+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:22.935 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:22.935+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:22.935 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:22.935+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:22.935 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:22.935+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:23.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:23.005+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0004e80 legacy=0x7f87a0006240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:23.005 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:23.005+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 msgr2=0x7f87a0009e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:44:23.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:23.005+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00157e0 msgr2=0x7f87a0015bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:23.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:23.005+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 0x7f87a0009e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:44:23.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:23.005+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00157e0 0x7f87a0015bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:44:23.528 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:23.528+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:23.528 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:23.528+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:23.529 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:23.528+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:23.529 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:23.528+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:23.678 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:23.678+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:23.678 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:23.678+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:23.679 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:23.678+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:23.679 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:23.678+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:23.806 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:23.806+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00157e0 msgr2=0x7f87a0015bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:23.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:23.806+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 msgr2=0x7f87a0009e80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:44:23.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:23.806+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0004e80 legacy=0x7f87a0006240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:23.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:23.806+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 0x7f87a0009e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:44:23.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:23.806+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00157e0 0x7f87a0015bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:44:23.897 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:23.896+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:23.897 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:23.896+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:23.897 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:23.896+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:23.897 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:23.896+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:23.947 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:23.947+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:23.947 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:23.947+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:23.947 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:23.947+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:23.947 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:23.947+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:24.525 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:24.525+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:24.525 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:24.525+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:24.526 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:24.525+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:24.526 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:24.525+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:24.543 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-01-01T17:44:24.543+0000 7fc7b8fdb700 -1 mon.a@0(probing) e1 get_health_metrics reporting 528 slow ops, oldest is log(1 entries from seq 42 at 2023-01-01T17:40:56.238062+0000) 2023-01-01T17:44:24.642 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:24.642+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:24.643 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:24.642+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:24.643 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:24.642+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:24.643 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:24.642+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:24.927 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:24.925+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:24.927 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:24.925+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:24.927 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:24.925+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:24.927 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:24.925+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:24.957 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:24.957+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:24.957 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:24.957+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:24.957 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:24.957+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:24.958 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:24.957+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:25.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:25.404+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 msgr2=0x7f87a0009e80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:25.404 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:25.404+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87c00c1560 0x7f87a0009e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:44:25.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:25.404+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00157e0 msgr2=0x7f87a0015bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:25.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:25.404+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00157e0 0x7f87a0015bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:44:25.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:25.404+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0004e80 legacy=0x7f87a0006240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:25.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:25.404+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:44:25.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:25.404+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a0016190 con 0x7f87a0014b50 2023-01-01T17:44:25.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:25.404+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a0005590 2023-01-01T17:44:25.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:25.404+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:25.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:25.404+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:44:25.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:25.404+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:25.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:25.404+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:25.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:25.404+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:44:25.504 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:25.504+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:25.504 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:25.504+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:25.504 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:25.504+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:25.505 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:25.504+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:25.605 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:25.605+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:25.605 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:25.605+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:44:25.606 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:25.605+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:25.606 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:25.605+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:25.606 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:25.605+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:44:25.622 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:25.622+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:25.622 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:25.622+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:25.622 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:25.622+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:25.622 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:25.622+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:25.946 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:25.946+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:25.946 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:25.946+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:25.947 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:25.946+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:25.947 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:25.946+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:25.948 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:25.948+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:25.948 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:25.948+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:25.948 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:25.948+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:25.949 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:25.948+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:26.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:26.006+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:26.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:26.006+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:44:26.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:26.006+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:26.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:26.006+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:26.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:26.006+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:44:26.488 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:26.488+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:26.488 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:26.488+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:26.488 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:26.488+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:26.488 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:26.488+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:26.598 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:26.598+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:26.598 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:26.598+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:26.599 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:26.598+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:26.599 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:26.598+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:26.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:26.807+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:26.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:26.807+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:44:26.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:26.807+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:26.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:26.807+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:26.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:26.807+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:44:26.966 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:26.966+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:26.966 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:26.966+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:26.966 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:26.966+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:26.966 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:26.966+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:26.998 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:26.998+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:26.998 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:26.998+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:26.999 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:26.998+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:26.999 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:26.998+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:27.440 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:27.441+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:27.441 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:27.441+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:27.441 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:27.441+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:27.441 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:27.441+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:27.557 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:27.557+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:27.558 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:27.557+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:27.558 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:27.557+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:27.558 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:27.557+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:27.961 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:27.961+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:27.961 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:27.961+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:27.962 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:27.961+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:27.962 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:27.961+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:27.996 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:27.996+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:27.996 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:27.996+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:27.997 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:27.996+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:27.997 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:27.996+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:28.337 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~35s 2023-01-01T17:44:28.337 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~35s 2023-01-01T17:44:28.338 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~35s 2023-01-01T17:44:28.338 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~35s 2023-01-01T17:44:28.338 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~35s 2023-01-01T17:44:28.338 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~35s 2023-01-01T17:44:28.338 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~35s 2023-01-01T17:44:28.338 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~35s 2023-01-01T17:44:28.338 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~35s 2023-01-01T17:44:28.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:28.404+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a000a830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:28.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:28.404+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:44:28.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:28.404+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0014b50 legacy=0x7f87a0011ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:44:28.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:28.404+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 reap_dead start 2023-01-01T17:44:28.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:28.404+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:44:28.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:28.404+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a00155f0 con 0x7f87a0014b50 2023-01-01T17:44:28.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:28.404+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a0015ef0 con 0x7f87a0004e80 2023-01-01T17:44:28.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:28.404+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a0005590 2023-01-01T17:44:28.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:28.404+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0004e80 legacy=0x7f87a0006240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:28.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:28.404+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:28.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:28.404+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a000a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-01-01T17:44:28.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:28.404+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a000a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:28.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:28.404+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:28.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:28.404+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:44:28.480 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:28.480+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:28.481 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:28.480+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:28.481 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:28.480+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:28.481 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:28.480+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:28.584 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:28.584+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:28.584 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:28.584+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:28.584 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:28.584+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:28.585 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:28.584+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:28.606 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:28.605+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0004e80 legacy=0x7f87a0006240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:28.606 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:28.605+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:28.606 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:28.605+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a000a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-01-01T17:44:28.606 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:28.605+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a000a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:28.606 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:28.605+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:28.606 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:28.605+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:44:28.976 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:28.976+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:28.977 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:28.976+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:28.977 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:28.976+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:28.977 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:28.976+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:28.989 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:28.990+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:28.990 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:28.990+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:28.990 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:28.990+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:28.990 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:28.990+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:29.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:29.006+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:29.006 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:29.006+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0004e80 legacy=0x7f87a0006240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:29.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:29.006+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a000a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-01-01T17:44:29.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:29.006+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a000a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:29.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:29.006+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:29.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:29.006+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:44:29.529 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:29.526+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:29.530 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:29.526+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:29.530 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:29.526+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:29.530 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:29.526+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:29.546 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-01-01T17:44:29.544+0000 7fc7b8fdb700 -1 mon.a@0(probing) e1 get_health_metrics reporting 566 slow ops, oldest is log(1 entries from seq 42 at 2023-01-01T17:40:56.238062+0000) 2023-01-01T17:44:29.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:29.544+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0014b50 legacy=0x7f87a00157e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2023-01-01T17:44:29.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:29.544+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0014b50 legacy=0x7f87a00157e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-01-01T17:44:29.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:29.544+0000 7f87c4be5700 1 --1- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0014b50 0x7f87a00157e0 :-1 s=OPENED pgs=712 cs=1 l=1).handle_message read tag failed 2023-01-01T17:44:29.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:29.544+0000 7f87c4be5700 1 --1- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0014b50 0x7f87a00157e0 :-1 s=OPENED pgs=712 cs=1 l=1).fault on lossy channel, failing 2023-01-01T17:44:29.589 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:29.588+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:29.590 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:29.588+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:29.590 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:29.588+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:29.590 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:29.588+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:29.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:29.807+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0004e80 legacy=0x7f87a0006240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:29.807 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:29.807+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:29.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:29.807+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a000a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:44:29.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:29.807+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a000a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:29.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:29.807+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:29.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:29.807+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:44:29.932 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:29.930+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:29.932 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:29.930+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:29.933 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:29.930+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:29.933 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:29.930+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:29.960 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:29.960+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:29.960 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:29.960+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:29.960 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:29.960+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:29.960 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:29.960+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:30.505 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:30.505+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:30.506 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:30.505+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:30.506 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:30.505+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:30.506 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:30.505+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:30.627 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:30.627+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:30.627 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:30.627+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:30.627 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:30.627+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:30.627 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:30.627+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:30.918 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:30.918+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:30.996 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:30.918+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:30.996 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:30.918+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:30.996 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:30.918+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:30.997 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:30.993+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:30.997 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:30.993+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:30.998 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:30.993+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:30.998 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:30.993+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:31.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:31.405+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a000a810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:31.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:31.405+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:44:31.405 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:31.405+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0004e80 legacy=0x7f87a0006240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:31.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:31.405+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0014b50 legacy=0x7f87a00157e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-01-01T17:44:31.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:31.405+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0009e80 0x7f87a0010320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:44:31.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:31.405+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0010860 0x7f87a0010c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:44:31.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:31.405+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a0009e80 2023-01-01T17:44:31.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:31.405+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00c08a0 con 0x7f87a0010860 2023-01-01T17:44:31.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:31.405+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0009e80 msgr2=0x7f87a0010320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:31.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:31.405+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0010860 msgr2=0x7f87a0010c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:44:31.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:31.405+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0009e80 0x7f87a0010320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:44:31.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:31.405+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0010860 0x7f87a0010c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:44:31.475 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:31.475+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:31.475 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:31.475+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:31.475 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:31.475+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:31.476 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:31.475+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:31.606 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:31.606+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0009e80 msgr2=0x7f87a0010320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:31.606 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:31.606+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0010860 msgr2=0x7f87a0010c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:44:31.606 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:31.606+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0009e80 0x7f87a0010320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:44:31.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:31.606+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0010860 0x7f87a0010c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:44:31.643 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:31.643+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:31.643 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:31.643+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:31.643 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:31.643+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:31.643 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:31.643+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:31.947 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:31.946+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:31.947 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:31.946+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:31.947 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:31.946+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:31.948 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:31.946+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:31.995 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:31.995+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:31.995 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:31.995+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:31.995 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:31.995+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:31.996 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:31.995+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:32.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:32.007+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0009e80 msgr2=0x7f87a0010320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:32.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:32.007+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0010860 msgr2=0x7f87a0010c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:44:32.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:32.007+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0009e80 0x7f87a0010320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:44:32.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:32.007+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0010860 0x7f87a0010c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:44:32.488 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:32.488+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:32.489 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:32.488+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:32.489 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:32.488+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:32.489 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:32.488+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:32.679 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:32.679+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:32.679 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:32.679+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:32.679 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:32.679+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:32.680 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:32.679+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:32.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:32.808+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0009e80 msgr2=0x7f87a0010320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:32.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:32.808+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0010860 msgr2=0x7f87a0010c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:44:32.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:32.808+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0009e80 0x7f87a0010320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:44:32.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:32.808+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0010860 0x7f87a0010c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:44:32.975 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:32.975+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:32.975 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:32.975+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:32.975 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:32.975+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:32.975 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:32.975+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:33.016 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:33.016+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:33.017 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:33.016+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:33.017 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:33.016+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:33.017 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:33.016+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:33.522 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:33.522+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:33.522 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:33.522+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:33.523 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:33.522+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:33.523 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:33.522+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:33.705 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:33.701+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:33.706 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:33.701+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:33.706 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:33.701+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:33.706 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:33.701+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:33.953 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:33.951+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:33.953 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:33.951+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:33.953 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:33.951+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:33.953 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:33.951+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:34.016 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:34.016+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:34.016 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:34.016+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:34.016 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:34.016+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:34.017 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:34.016+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:34.148 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~41s 2023-01-01T17:44:34.148 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~41s 2023-01-01T17:44:34.148 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~41s 2023-01-01T17:44:34.149 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~41s 2023-01-01T17:44:34.149 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~41s 2023-01-01T17:44:34.149 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~41s 2023-01-01T17:44:34.149 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~41s 2023-01-01T17:44:34.149 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~41s 2023-01-01T17:44:34.149 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~41s 2023-01-01T17:44:34.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:34.405+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0010860 msgr2=0x7f87a0010c30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:34.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:34.405+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0010860 0x7f87a0010c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:44:34.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:34.405+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0009e80 msgr2=0x7f87a0010320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:34.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:34.405+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0009e80 0x7f87a0010320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:44:34.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:34.405+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 reap_dead start 2023-01-01T17:44:34.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:34.405+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:44:34.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:34.405+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0004e80 0x7f87a0006240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:44:34.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:34.405+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a00150b0 con 0x7f87a0009e80 2023-01-01T17:44:34.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:34.405+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a0005590 2023-01-01T17:44:34.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:34.405+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00c08a0 con 0x7f87a0004e80 2023-01-01T17:44:34.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:34.405+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:34.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:34.405+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0004e80 msgr2=0x7f87a0006240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:44:34.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:34.405+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0009e80 legacy=0x7f87a00157b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:34.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:34.405+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0004e80 0x7f87a0006240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:44:34.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:34.405+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a000a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:44:34.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:34.405+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a000a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:34.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:34.405+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:34.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:34.405+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:44:34.510 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:34.508+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:34.510 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:34.508+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:34.511 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:34.508+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:34.511 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:34.508+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:34.546 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-01-01T17:44:34.545+0000 7fc7b8fdb700 -1 mon.a@0(probing) e1 get_health_metrics reporting 603 slow ops, oldest is log(1 entries from seq 42 at 2023-01-01T17:40:56.238062+0000) 2023-01-01T17:44:34.606 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:34.606+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:34.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:34.606+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0004e80 msgr2=0x7f87a0006240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:44:34.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:34.606+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0009e80 legacy=0x7f87a00157b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:34.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:34.606+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0004e80 0x7f87a0006240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:44:34.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:34.606+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a000a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:44:34.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:34.606+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a000a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:34.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:34.606+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:34.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:34.606+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:44:34.713 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:34.713+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:34.713 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:34.713+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:34.713 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:34.713+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:34.714 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:34.713+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:34.998 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:34.999+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:34.999 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:34.999+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:34.999 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:34.999+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:34.999 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:34.999+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:35.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:35.007+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0009e80 legacy=0x7f87a00157b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:35.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:35.007+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0004e80 msgr2=0x7f87a0006240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:44:35.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:35.007+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0004e80 0x7f87a0006240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:44:35.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:35.007+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:35.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:35.007+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a000a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-01-01T17:44:35.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:35.007+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a000a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:35.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:35.007+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:35.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:35.007+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:44:35.032 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:35.028+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:35.033 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:35.028+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:35.033 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:35.028+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:35.033 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:35.028+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:35.492 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:35.493+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:35.493 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:35.493+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:35.493 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:35.493+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:35.493 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:35.493+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:35.761 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:35.760+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:35.761 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:35.760+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:35.762 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:35.760+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:35.762 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:35.761+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:35.809 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:35.808+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0009e80 legacy=0x7f87a00157b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:35.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:35.808+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0004e80 msgr2=0x7f87a0006240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:44:35.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:35.808+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0004e80 0x7f87a0006240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:44:35.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:35.808+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:35.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:35.808+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a000a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-01-01T17:44:35.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:35.808+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a000a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:35.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:35.808+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:35.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:35.808+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:44:36.007 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:36.006+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:36.007 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:36.006+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:36.007 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:36.006+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:36.007 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:36.006+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:36.027 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:36.027+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:36.027 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:36.027+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:36.027 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:36.027+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:36.027 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:36.027+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:36.519 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:36.519+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:36.519 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:36.519+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:36.519 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:36.519+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:36.519 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:36.519+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:36.768 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:36.768+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:36.768 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:36.768+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:36.768 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:36.768+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:36.768 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:36.768+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:36.996 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:36.995+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:36.996 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:36.995+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:36.996 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:36.995+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:36.996 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:36.995+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:37.047 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:37.047+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:37.047 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:37.047+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:37.048 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:37.047+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:37.048 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:37.047+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:37.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:37.405+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0004e80 msgr2=0x7f87a0006240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:37.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:37.405+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0004e80 0x7f87a0006240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:44:37.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:37.405+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a000a810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:37.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:37.405+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a000a810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:44:37.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:37.405+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0009e80 legacy=0x7f87a00157b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:37.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:37.405+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0014b50 0x7f87a000f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:44:37.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:37.405+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a0015ef0 con 0x7f87a000f7d0 2023-01-01T17:44:37.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:37.405+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a0014b50 2023-01-01T17:44:37.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:37.405+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0014b50 msgr2=0x7f87a000f290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:37.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:37.405+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0014b50 0x7f87a000f290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:44:37.484 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:37.483+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:37.484 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:37.483+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:37.484 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:37.483+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:37.484 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:37.483+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:37.606 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:37.606+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0014b50 msgr2=0x7f87a000f290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:37.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:37.606+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0014b50 0x7f87a000f290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:44:37.810 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:37.810+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:37.810 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:37.810+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:37.811 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:37.810+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:37.811 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:37.810+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:37.948 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:37.948+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:37.948 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:37.948+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:37.948 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:37.948+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:37.949 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:37.948+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:38.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:38.007+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0014b50 msgr2=0x7f87a000f290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:38.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:38.007+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0014b50 0x7f87a000f290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:44:38.064 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:38.063+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:38.064 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:38.063+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:38.064 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:38.063+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:38.064 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:38.063+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:38.461 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:38.461+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:38.462 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:38.461+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:38.462 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:38.461+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:38.462 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:38.461+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:38.803 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:38.803+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:38.803 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:38.803+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:38.803 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:38.803+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:38.804 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:38.803+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:38.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:38.808+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0014b50 msgr2=0x7f87a000f290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:38.808 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:38.808+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0014b50 0x7f87a000f290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:44:38.918 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:38.919+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:38.918 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:38.919+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:38.919 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:38.919+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:38.919 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:38.919+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:39.030 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:39.030+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:39.031 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:39.030+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:39.031 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:39.030+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:39.031 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:39.030+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:39.422 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:39.422+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:39.423 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:39.422+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:39.423 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:39.422+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:39.423 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:39.422+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:39.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:39.545+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a000f7d0 legacy=0x7f87a0011be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-01-01T17:44:39.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:39.546+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a000f7d0 legacy=0x7f87a0011be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-01-01T17:44:39.546 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:39.546+0000 7f87bf7fe700 1 --1- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a000f7d0 0x7f87a0011be0 :-1 s=OPENED pgs=738 cs=1 l=1).handle_message read tag failed 2023-01-01T17:44:39.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:39.546+0000 7f87bf7fe700 1 --1- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a000f7d0 0x7f87a0011be0 :-1 s=OPENED pgs=738 cs=1 l=1).fault on lossy channel, failing 2023-01-01T17:44:39.547 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-01-01T17:44:39.546+0000 7fc7b8fdb700 -1 mon.a@0(probing) e1 get_health_metrics reporting 646 slow ops, oldest is log(1 entries from seq 42 at 2023-01-01T17:40:56.238062+0000) 2023-01-01T17:44:39.804 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:39.804+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:39.804 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:39.804+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:39.804 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:39.804+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:39.805 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:39.804+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:39.892 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:39.891+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:39.892 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:39.891+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:39.892 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:39.891+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:39.892 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:39.891+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:39.957 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~46s 2023-01-01T17:44:39.957 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~46s 2023-01-01T17:44:39.958 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~46s 2023-01-01T17:44:39.958 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~46s 2023-01-01T17:44:39.958 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~46s 2023-01-01T17:44:39.958 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~46s 2023-01-01T17:44:39.958 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~46s 2023-01-01T17:44:39.958 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~46s 2023-01-01T17:44:39.958 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~46s 2023-01-01T17:44:39.997 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:39.997+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:39.998 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:39.997+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:39.998 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:39.997+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:39.998 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:39.997+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:40.406 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:40.406+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0014b50 msgr2=0x7f87a000f290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:40.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:40.406+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0014b50 0x7f87a000f290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:44:40.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:40.406+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a000f7d0 legacy=0x7f87a0011be0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-01-01T17:44:40.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:40.406+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 reap_dead start 2023-01-01T17:44:40.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:40.406+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0005590 0x7f87a000a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:44:40.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:40.406+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:44:40.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:40.406+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a00150b0 con 0x7f87a0009e80 2023-01-01T17:44:40.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:40.406+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a0004e80 2023-01-01T17:44:40.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:40.406+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00c08a0 con 0x7f87a0005590 2023-01-01T17:44:40.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:40.406+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0009e80 legacy=0x7f87a00157b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:40.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:40.406+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:40.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:40.406+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0005590 0x7f87a000a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:44:40.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:40.406+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:40.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:40.406+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-01-01T17:44:40.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:40.406+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:40.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:40.406+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:40.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:40.406+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:44:40.428 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:40.428+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:40.430 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:40.428+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:40.431 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:40.428+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:40.431 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:40.428+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:40.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:40.607+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:40.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:40.607+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0009e80 legacy=0x7f87a00157b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:40.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:40.607+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0005590 0x7f87a000a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:44:40.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:40.607+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:40.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:40.607+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-01-01T17:44:40.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:40.607+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:40.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:40.607+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:40.610 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:40.607+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:44:40.842 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:40.842+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:40.842 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:40.842+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:40.843 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:40.842+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:40.843 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:40.842+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:40.885 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:40.885+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:40.886 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:40.885+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:40.886 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:40.885+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:40.886 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:40.885+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:40.988 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:40.988+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:40.988 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:40.988+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:40.989 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:40.988+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:40.989 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:40.988+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:41.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:41.008+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:41.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:41.008+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0009e80 legacy=0x7f87a00157b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:41.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:41.008+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:41.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:41.008+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0005590 0x7f87a000a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:44:41.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:41.008+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-01-01T17:44:41.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:41.008+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:41.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:41.008+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:41.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:41.008+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:44:41.445 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:41.445+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:41.446 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:41.445+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:41.446 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:41.445+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:41.446 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:41.445+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:41.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:41.809+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0009e80 legacy=0x7f87a00157b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:41.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:41.809+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:41.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:41.809+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:41.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:41.809+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0005590 0x7f87a000a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:44:41.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:41.809+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-01-01T17:44:41.812 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:41.809+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:41.812 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:41.809+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:41.812 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:41.809+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:44:41.856 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:41.856+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:41.861 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:41.856+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:41.863 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:41.856+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:41.863 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:41.856+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:41.878 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:41.876+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:41.878 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:41.876+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:41.878 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:41.876+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:41.879 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:41.876+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:41.983 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:41.984+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:41.984 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:41.984+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:41.984 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:41.984+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:41.984 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:41.984+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:42.449 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:42.450+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:42.450 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:42.450+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:42.450 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:42.450+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:42.450 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:42.450+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:42.867 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:42.867+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:42.868 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:42.867+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:42.868 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:42.867+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:42.868 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:42.867+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:42.903 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:42.903+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:42.903 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:42.903+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:42.903 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:42.903+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:42.903 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:42.903+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:42.986 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:42.987+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:42.987 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:42.987+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:42.990 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:42.987+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:42.991 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:42.987+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:43.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:43.406+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a000a7b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:43.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:43.406+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0005590 0x7f87a000a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:44:43.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:43.406+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:43.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:43.406+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:44:43.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:43.406+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0009e80 legacy=0x7f87a00157b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:43.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:43.406+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012d90 0x7f87a0013190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:44:43.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:43.406+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a0015ef0 con 0x7f87a000f290 2023-01-01T17:44:43.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:43.406+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a0012d90 2023-01-01T17:44:43.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:43.406+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012d90 msgr2=0x7f87a0013190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:44:43.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:43.406+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012d90 0x7f87a0013190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:44:43.494 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:43.495+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:43.495 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:43.495+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:43.495 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:43.495+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:43.495 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:43.495+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:43.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:43.607+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012d90 msgr2=0x7f87a0013190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:44:43.607 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:43.607+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012d90 0x7f87a0013190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:44:43.856 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:43.857+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:43.857 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:43.857+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:43.857 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:43.857+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:43.857 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:43.857+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:43.928 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:43.928+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:43.928 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:43.928+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:43.928 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:43.928+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:43.928 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:43.928+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:43.989 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:43.989+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:43.989 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:43.989+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:43.989 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:43.989+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:43.989 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:43.989+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:44.007 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:44.008+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012d90 msgr2=0x7f87a0013190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:44:44.008 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:44.008+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012d90 0x7f87a0013190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:44:44.458 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:44.458+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:44.459 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:44.458+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:44.459 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:44.458+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:44.459 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:44.458+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:44.547 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-01-01T17:44:44.546+0000 7fc7b8fdb700 -1 mon.a@0(probing) e1 get_health_metrics reporting 710 slow ops, oldest is log(1 entries from seq 42 at 2023-01-01T17:40:56.238062+0000) 2023-01-01T17:44:44.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:44.547+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a000f290 legacy=0x7f87a0011670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-01-01T17:44:44.547 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:44.547+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a000f290 legacy=0x7f87a0011670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-01-01T17:44:44.548 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:44.547+0000 7f87bffff700 1 --1- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a000f290 0x7f87a0011670 :-1 s=OPENED pgs=752 cs=1 l=1).handle_message read tag failed 2023-01-01T17:44:44.548 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:44.547+0000 7f87bffff700 1 --1- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a000f290 0x7f87a0011670 :-1 s=OPENED pgs=752 cs=1 l=1).fault on lossy channel, failing 2023-01-01T17:44:44.809 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:44.809+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012d90 msgr2=0x7f87a0013190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:44:44.809 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:44.809+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012d90 0x7f87a0013190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:44:44.875 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:44.876+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:44.876 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:44.876+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:44.876 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:44.876+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:44.876 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:44.876+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:44.882 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:44.882+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:44.882 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:44.882+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:44.882 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:44.882+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:44.882 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:44.882+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:45.025 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:45.025+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:45.025 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:45.025+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:45.026 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:45.025+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:45.026 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:45.025+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:45.503 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:45.502+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:45.504 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:45.502+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:45.505 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:45.502+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:45.507 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:45.502+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:45.775 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~52s 2023-01-01T17:44:45.776 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~52s 2023-01-01T17:44:45.776 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~52s 2023-01-01T17:44:45.776 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~52s 2023-01-01T17:44:45.776 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~52s 2023-01-01T17:44:45.776 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~52s 2023-01-01T17:44:45.776 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~52s 2023-01-01T17:44:45.776 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~52s 2023-01-01T17:44:45.777 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~52s 2023-01-01T17:44:45.883 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:45.883+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:45.883 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:45.883+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:45.883 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:45.883+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:45.883 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:45.883+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:45.924 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:45.924+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:45.924 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:45.924+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:45.924 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:45.924+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:45.924 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:45.924+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:45.987 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:45.984+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:45.987 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:45.984+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:45.987 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:45.984+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:45.989 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:45.984+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:46.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:46.407+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012d90 msgr2=0x7f87a0013190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:46.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:46.407+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012d90 0x7f87a0013190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:44:46.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:46.407+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a000f290 legacy=0x7f87a0011670 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-01-01T17:44:46.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:46.407+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a00136d0 0x7f87a0013aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:44:46.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:46.407+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 reap_dead start 2023-01-01T17:44:46.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:46.407+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:44:46.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:46.407+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a00150b0 con 0x7f87a000f290 2023-01-01T17:44:46.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:46.407+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a0004e80 2023-01-01T17:44:46.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:46.407+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00c08a0 con 0x7f87a00136d0 2023-01-01T17:44:46.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:46.407+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a00136d0 msgr2=0x7f87a0013aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:44:46.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:46.407+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:46.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:46.407+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:44:46.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:46.407+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a00136d0 0x7f87a0013aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:44:46.507 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:46.508+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:46.508 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:46.508+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:46.509 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:46.508+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:46.509 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:46.508+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:46.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:46.608+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:46.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:46.608+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a00136d0 msgr2=0x7f87a0013aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:44:46.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:46.608+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:44:46.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:46.608+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a00136d0 0x7f87a0013aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:44:46.840 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:46.839+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:46.840 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:46.839+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:46.840 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:46.839+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:46.840 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:46.839+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:46.932 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:46.932+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:46.932 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:46.932+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:46.932 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:46.932+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:46.932 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:46.932+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:46.944 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:46.944+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:46.944 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:46.944+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:46.944 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:46.944+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:46.944 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:46.944+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:47.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:47.009+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:47.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:47.009+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a00136d0 msgr2=0x7f87a0013aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:44:47.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:47.009+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:44:47.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:47.009+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a00136d0 0x7f87a0013aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:44:47.544 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:47.541+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:47.544 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:47.541+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:47.544 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:47.541+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:47.544 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:47.541+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:47.808 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:47.809+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:47.809 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:47.809+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:47.809 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:47.809+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:47.809 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:47.809+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:47.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:47.810+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:47.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:47.810+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a00136d0 msgr2=0x7f87a0013aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:44:47.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:47.810+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:44:47.810 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:47.810+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a00136d0 0x7f87a0013aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:44:47.893 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:47.893+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:47.893 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:47.893+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:47.894 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:47.893+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:47.894 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:47.893+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:47.904 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:47.904+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:47.904 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:47.904+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:47.905 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:47.904+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:47.905 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:47.904+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:48.516 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:48.517+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:48.516 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:48.517+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:48.517 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:48.517+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:48.517 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:48.517+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:48.849 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:48.849+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:48.850 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:48.849+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:48.850 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:48.849+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:48.850 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:48.849+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:48.916 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:48.916+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:48.916 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:48.916+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:48.919 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:48.916+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:48.919 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:48.916+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:48.941 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:48.941+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:48.942 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:48.941+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:48.942 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:48.941+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:48.942 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:48.941+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:49.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:49.406+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a00136d0 msgr2=0x7f87a0013aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:49.407 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:49.406+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a00136d0 0x7f87a0013aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:44:49.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:49.406+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:49.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:49.406+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:44:49.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:49.406+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a000f290 legacy=0x7f87a0013fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:44:49.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:49.406+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a0013190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:44:49.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:49.406+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a0009e80 con 0x7f87a000a7b0 2023-01-01T17:44:49.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:49.406+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a0005590 2023-01-01T17:44:49.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:49.407+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a000a7b0 legacy=0x7f87a0012680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:49.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:49.407+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a0013190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:49.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:49.407+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a0013190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-01-01T17:44:49.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:49.407+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a0013190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:49.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:49.407+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a0013190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:49.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:49.407+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a0013190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:44:49.525 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:49.526+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:49.525 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:49.526+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:49.525 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:49.526+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:49.526 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:49.526+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:49.548 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-01-01T17:44:49.547+0000 7fc7b8fdb700 -1 mon.a@0(probing) e1 get_health_metrics reporting 754 slow ops, oldest is log(1 entries from seq 42 at 2023-01-01T17:40:56.238062+0000) 2023-01-01T17:44:49.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:49.608+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a0013190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:49.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:49.608+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a000a7b0 legacy=0x7f87a0012680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:49.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:49.608+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a0013190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:44:49.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:49.608+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a0013190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:49.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:49.608+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a0013190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:49.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:49.608+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a0013190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:44:49.823 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:49.820+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:49.824 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:49.820+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:49.824 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:49.820+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:49.824 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:49.820+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:49.962 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:49.963+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:49.962 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:49.963+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:49.963 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:49.963+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:49.963 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:49.963+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:49.964 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:49.964+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:49.965 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:49.964+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:49.965 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:49.964+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:49.965 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:49.964+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:50.009 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:50.009+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a0013190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:50.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:50.009+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a000a7b0 legacy=0x7f87a0012680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:50.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:50.009+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a0013190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-01-01T17:44:50.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:50.009+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a0013190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:50.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:50.009+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a0013190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:50.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:50.009+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a0013190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:44:50.565 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:50.566+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:50.566 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:50.566+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:50.566 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:50.566+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:50.566 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:50.566+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:50.801 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:50.802+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:50.802 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:50.802+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:50.802 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:50.802+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:50.802 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:50.802+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:50.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:50.810+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a0013190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:50.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:50.810+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a000a7b0 legacy=0x7f87a0012680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:50.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:50.810+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a0013190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:44:50.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:50.810+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a0013190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:50.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:50.810+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a0013190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:50.824 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:50.810+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a0013190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:44:50.950 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:50.949+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:50.950 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:50.949+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:50.950 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:50.949+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:50.950 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:50.949+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:51.005 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:51.005+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:51.005 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:51.005+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:51.005 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:51.005+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:51.005 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:51.005+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:51.294 DEBUG:teuthology.orchestra.run.smithi061:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-01-01T17:44:51.297 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-01-01T17:44:51.516 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:51.517+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:51.517 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:51.517+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:51.517 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:51.517+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:51.517 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:51.517+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:51.584 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~58s 2023-01-01T17:44:51.584 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~58s 2023-01-01T17:44:51.584 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~58s 2023-01-01T17:44:51.585 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~58s 2023-01-01T17:44:51.585 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~58s 2023-01-01T17:44:51.585 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~58s 2023-01-01T17:44:51.585 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~58s 2023-01-01T17:44:51.585 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~58s 2023-01-01T17:44:51.585 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~58s 2023-01-01T17:44:51.820 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:51.820+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:51.820 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:51.820+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:51.820 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:51.820+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:51.820 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:51.820+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:51.923 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:51.924+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:51.923 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:51.924+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:51.923 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:51.924+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:51.923 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:51.924+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:51.994 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:51.995+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:51.994 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:51.995+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:51.994 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:51.995+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:51.995 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:51.995+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:52.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:52.407+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 msgr2=0x7f87a0013190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:52.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:52.407+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0005590 0x7f87a0013190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:44:52.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:52.407+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a000a7b0 legacy=0x7f87a0012680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:52.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:52.407+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:44:52.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:52.407+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 reap_dead start 2023-01-01T17:44:52.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:52.407+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a000a7b0 0x7f87a00157b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:44:52.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:52.407+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a00150b0 con 0x7f87a0005570 2023-01-01T17:44:52.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:52.407+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a0004e80 2023-01-01T17:44:52.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:52.407+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00c08a0 con 0x7f87a000a7b0 2023-01-01T17:44:52.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:52.407+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:52.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:52.407+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a000a7b0 msgr2=0x7f87a00157b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:44:52.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:52.407+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0005570 legacy=0x7f87a0003a70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:52.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:52.407+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:44:52.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:52.407+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a000a7b0 0x7f87a00157b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:44:52.531 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:52.530+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:52.531 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:52.530+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:52.531 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:52.530+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:52.531 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:52.530+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:52.608 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:52.608+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0005570 legacy=0x7f87a0003a70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:52.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:52.608+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a000a7b0 msgr2=0x7f87a00157b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:44:52.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:52.608+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:52.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:52.608+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a000a7b0 0x7f87a00157b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:44:52.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:52.608+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:44:52.837 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:52.838+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:52.838 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:52.838+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:52.838 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:52.838+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:52.838 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:52.838+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:52.911 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:52.912+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:52.911 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:52.912+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:52.912 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:52.912+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:52.912 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:52.912+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:53.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:53.009+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0005570 legacy=0x7f87a0003a70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:53.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:53.009+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:53.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:53.009+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a000a7b0 msgr2=0x7f87a00157b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:44:53.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:53.009+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:44:53.120 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:53.009+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a000a7b0 0x7f87a00157b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:44:53.121 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:53.037+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:53.121 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:53.037+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:53.121 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:53.037+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:53.122 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:53.037+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:53.549 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:53.550+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:53.549 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:53.550+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:53.550 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:53.550+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:53.550 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:53.550+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:53.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:53.810+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0005570 legacy=0x7f87a0003a70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:53.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:53.810+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:53.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:53.810+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a000a7b0 msgr2=0x7f87a00157b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:44:53.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:53.810+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:44:53.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:53.810+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a000a7b0 0x7f87a00157b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:44:53.831 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:53.831+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:53.831 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:53.831+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:53.831 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:53.831+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:53.832 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:53.831+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:53.900 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:53.901+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:53.900 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:53.901+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:53.901 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:53.901+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:53.901 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:53.901+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:53.998 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:53.998+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:53.998 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:53.998+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:53.998 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:53.998+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:53.998 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:53.998+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:54.500 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:54.500+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:54.501 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:54.500+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:54.501 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:54.500+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:54.501 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:54.500+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:54.548 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-01-01T17:44:54.548+0000 7fc7b8fdb700 -1 mon.a@0(probing) e1 get_health_metrics reporting 791 slow ops, oldest is log(1 entries from seq 42 at 2023-01-01T17:40:56.238062+0000) 2023-01-01T17:44:54.881 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:54.881+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:55.057 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:54.881+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:55.058 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:54.881+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:55.058 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:54.881+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:55.058 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:54.920+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:55.059 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:54.920+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:55.059 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:54.920+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:55.059 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:54.920+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:55.060 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:55.023+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:55.060 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:55.023+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:55.060 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:55.023+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:55.060 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:55.023+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:55.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:55.408+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a000a7b0 msgr2=0x7f87a00157b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:55.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:55.408+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a000a7b0 0x7f87a00157b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:44:55.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:55.408+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:55.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:55.408+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:44:55.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:55.408+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0005570 legacy=0x7f87a0003a70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:55.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:55.408+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a00148b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:44:55.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:55.408+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a0009e80 con 0x7f87a0004180 2023-01-01T17:44:55.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:55.408+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a0004550 2023-01-01T17:44:55.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:55.408+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a00148b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:55.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:55.408+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 msgr2=0x7f87a00148b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-01-01T17:44:55.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:55.408+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 msgr2=0x7f87a00148b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:55.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:55.408+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a00148b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:55.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:55.408+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a00148b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:44:55.468 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:55.467+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:55.468 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:55.467+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:55.468 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:55.467+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:55.469 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:55.467+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:55.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:55.609+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a00148b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:55.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:55.609+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 msgr2=0x7f87a00148b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-01-01T17:44:55.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:55.609+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 msgr2=0x7f87a00148b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:55.610 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:55.609+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a00148b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:55.610 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:55.609+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a00148b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:44:55.857 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:55.857+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:55.905 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:55.857+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:55.906 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:55.857+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:55.906 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:55.857+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:55.906 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:55.904+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:55.907 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:55.904+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:55.907 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:55.904+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:55.907 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:55.904+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:55.977 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:55.977+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:55.977 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:55.977+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:55.977 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:55.977+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:55.977 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:55.977+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:56.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:56.010+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a00148b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:56.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:56.010+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 msgr2=0x7f87a00148b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-01-01T17:44:56.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:56.010+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 msgr2=0x7f87a00148b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:56.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:56.010+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a00148b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:56.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:56.010+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a00148b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:44:56.494 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:56.495+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:56.494 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:56.495+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:56.495 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:56.495+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:56.495 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:56.495+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:56.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:56.811+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a00148b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:56.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:56.811+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 msgr2=0x7f87a00148b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-01-01T17:44:56.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:56.811+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 msgr2=0x7f87a00148b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:56.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:56.811+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a00148b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:56.812 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:56.811+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a00148b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:44:56.818 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:56.818+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:56.818 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:56.818+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:56.818 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:56.818+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:56.819 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:56.818+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:56.870 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:56.871+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:56.871 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:56.871+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:56.871 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:56.871+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:56.871 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:56.871+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:56.996 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:56.997+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:56.997 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:56.997+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:56.997 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:56.997+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:56.997 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:56.997+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:57.395 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~64s 2023-01-01T17:44:57.395 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~64s 2023-01-01T17:44:57.395 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~64s 2023-01-01T17:44:57.396 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~64s 2023-01-01T17:44:57.396 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~64s 2023-01-01T17:44:57.396 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~64s 2023-01-01T17:44:57.396 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~64s 2023-01-01T17:44:57.396 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~64s 2023-01-01T17:44:57.396 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~64s 2023-01-01T17:44:57.520 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:57.520+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:57.520 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:57.520+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:57.520 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:57.520+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:57.521 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:57.520+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:57.850 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:57.850+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:57.850 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:57.850+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:57.850 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:57.850+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:57.850 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:57.850+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:57.879 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:57.880+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:57.879 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:57.880+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:57.879 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:57.880+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:57.880 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:57.880+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:58.022 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:58.020+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:58.022 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:58.020+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:58.022 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:58.020+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:58.022 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:58.020+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:58.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:58.407+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 msgr2=0x7f87a00148b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:44:58.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:58.407+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a00148b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:44:58.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:58.407+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0004180 legacy=0x7f87a00141a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:44:58.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:58.407+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 reap_dead start 2023-01-01T17:44:58.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:58.407+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a00148b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:44:58.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:58.407+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:44:58.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:58.407+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a00150b0 con 0x7f87a0005570 2023-01-01T17:44:58.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:58.407+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a0004550 2023-01-01T17:44:58.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:58.408+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00c08a0 con 0x7f87a0004e80 2023-01-01T17:44:58.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:58.408+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:58.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:58.408+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0005570 legacy=0x7f87a0003a70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:58.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:58.408+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:44:58.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:58.408+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a00148b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:58.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:58.408+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 msgr2=0x7f87a00148b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-01-01T17:44:58.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:58.408+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 msgr2=0x7f87a00148b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:58.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:58.408+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a00148b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:58.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:58.408+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a00148b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:44:58.562 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:58.563+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:58.562 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:58.563+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:58.563 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:58.563+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:58.563 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:58.563+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:58.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:58.609+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:58.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:58.609+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0005570 legacy=0x7f87a0003a70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:58.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:58.609+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:44:58.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:58.609+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a00148b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:58.610 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:58.609+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 msgr2=0x7f87a00148b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-01-01T17:44:58.610 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:58.609+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 msgr2=0x7f87a00148b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:58.610 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:58.609+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a00148b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:58.610 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:58.609+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a00148b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:44:58.853 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:58.854+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:58.854 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:58.854+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:58.854 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:58.854+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:58.854 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:58.854+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:58.876 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:58.876+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:58.876 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:58.876+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:58.877 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:58.876+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:58.877 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:58.876+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:59.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:59.010+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a00148b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:59.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:59.010+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0005570 legacy=0x7f87a0003a70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:59.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:59.010+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:59.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:59.010+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:44:59.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:59.010+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 msgr2=0x7f87a00148b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:44:59.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:59.010+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 msgr2=0x7f87a00148b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:59.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:59.010+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a00148b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:59.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:59.010+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a00148b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:44:59.066 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:59.067+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:59.066 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:59.067+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:59.066 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:59.067+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:59.067 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:44:59.067+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:44:59.551 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-01-01T17:44:59.550+0000 7fc7b8fdb700 -1 mon.a@0(probing) e1 get_health_metrics reporting 829 slow ops, oldest is log(1 entries from seq 42 at 2023-01-01T17:40:56.238062+0000) 2023-01-01T17:44:59.603 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:59.604+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:59.603 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:59.604+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:59.603 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:59.604+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:59.604 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:44:59.604+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:44:59.812 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:59.812+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:44:59.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:59.812+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0005570 legacy=0x7f87a0003a70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:44:59.889 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:59.812+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:44:59.890 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:59.812+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a00148b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:44:59.890 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:59.812+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 msgr2=0x7f87a00148b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-01-01T17:44:59.890 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:59.812+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 msgr2=0x7f87a00148b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:44:59.890 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:59.812+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a00148b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:44:59.890 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:44:59.812+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a00148b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:44:59.891 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:59.868+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:59.891 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:59.868+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:44:59.891 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:59.868+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:59.891 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:44:59.868+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:44:59.892 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:59.869+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:59.892 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:59.869+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:59.892 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:59.869+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:44:59.892 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:44:59.869+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:00.032 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:00.033+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:00.033 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:00.033+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:00.033 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:00.033+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:00.033 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:00.033+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:00.629 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:00.630+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:00.630 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:00.630+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:00.630 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:00.630+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:00.630 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:00.630+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:00.819 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:00.820+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:00.819 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:00.820+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:00.819 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:00.820+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:00.819 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:00.820+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:00.907 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:00.907+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:00.907 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:00.907+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:00.907 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:00.907+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:00.907 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:00.907+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:01.013 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:01.014+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:01.014 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:01.014+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:01.014 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:01.014+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:01.014 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:01.014+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:01.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:01.409+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:45:01.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:01.409+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:45:01.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:01.409+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 msgr2=0x7f87a00148b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:45:01.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:01.409+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a00148b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:45:01.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:01.409+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0005570 legacy=0x7f87a0003a70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:45:01.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:01.409+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0004180 0x7f87a000a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:45:01.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:01.409+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a0014df0 con 0x7f87a00141a0 2023-01-01T17:45:01.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:01.409+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a0004180 2023-01-01T17:45:01.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:01.409+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0004180 msgr2=0x7f87a000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:45:01.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:01.409+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0004180 0x7f87a000a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:45:01.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:01.610+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0004180 msgr2=0x7f87a000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:45:01.609 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:01.610+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0004180 0x7f87a000a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:45:01.664 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:01.665+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:01.669 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:01.665+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:01.669 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:01.665+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:01.670 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:01.665+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:01.865 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:01.866+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:01.865 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:01.866+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:01.866 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:01.866+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:01.866 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:01.866+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:01.944 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:01.945+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:01.944 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:01.945+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:01.944 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:01.945+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:01.945 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:01.945+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:01.989 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:01.990+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:01.989 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:01.990+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:01.990 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:01.990+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:01.990 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:01.990+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:02.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:02.011+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0004180 msgr2=0x7f87a000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:45:02.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:02.011+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0004180 0x7f87a000a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:45:02.702 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:02.702+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:02.702 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:02.702+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:02.702 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:02.702+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:02.702 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:02.702+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:02.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:02.812+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0004180 msgr2=0x7f87a000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:45:02.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:02.812+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0004180 0x7f87a000a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:45:02.857 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:02.858+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:02.857 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:02.858+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:02.857 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:02.858+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:02.858 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:02.858+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:02.989 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:02.989+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:02.989 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:02.989+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:02.989 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:02.989+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:02.989 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:02.989+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:03.017 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:03.018+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:03.018 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:03.018+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:03.018 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:03.018+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:03.018 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:03.018+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:03.211 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~70s 2023-01-01T17:45:03.211 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~70s 2023-01-01T17:45:03.211 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~70s 2023-01-01T17:45:03.212 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~70s 2023-01-01T17:45:03.212 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~70s 2023-01-01T17:45:03.212 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~70s 2023-01-01T17:45:03.212 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~70s 2023-01-01T17:45:03.212 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~70s 2023-01-01T17:45:03.212 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~70s 2023-01-01T17:45:03.749 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:03.748+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:03.749 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:03.748+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:03.749 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:03.748+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:03.749 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:03.748+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:03.874 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:03.875+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:03.875 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:03.875+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:03.875 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:03.875+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:03.875 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:03.875+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:03.984 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:03.985+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:03.985 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:03.985+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:03.985 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:03.985+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:03.985 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:03.985+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:04.054 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:04.055+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:04.054 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:04.055+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:04.054 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:04.055+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:04.055 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:04.055+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:04.408 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:04.409+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0004180 msgr2=0x7f87a000a7b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:45:04.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:04.409+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0004180 0x7f87a000a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:45:04.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:04.409+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a00141a0 legacy=0x7f87a00157b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:45:04.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:04.409+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 reap_dead start 2023-01-01T17:45:04.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:04.409+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a0014570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:45:04.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:04.409+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:45:04.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:04.409+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a00150b0 con 0x7f87a0005570 2023-01-01T17:45:04.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:04.409+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a0004550 2023-01-01T17:45:04.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:04.409+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00c08a0 con 0x7f87a0004e80 2023-01-01T17:45:04.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:04.409+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a0014570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:45:04.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:04.409+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:45:04.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:04.409+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:45:04.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:04.409+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 msgr2=0x7f87a0014570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:45:04.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:04.410+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 msgr2=0x7f87a0014570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:45:04.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:04.410+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a0014570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:45:04.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:04.410+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a0014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:45:04.550 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-01-01T17:45:04.551+0000 7fc7b8fdb700 -1 mon.a@0(probing) e1 get_health_metrics reporting 866 slow ops, oldest is log(1 entries from seq 42 at 2023-01-01T17:40:56.238062+0000) 2023-01-01T17:45:04.551 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:04.551+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0005570 legacy=0x7f87a00157b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2023-01-01T17:45:04.551 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:04.551+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0005570 legacy=0x7f87a00157b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-01-01T17:45:04.551 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:04.551+0000 7f87c4be5700 1 --1- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0005570 0x7f87a00157b0 :-1 s=OPENED pgs=807 cs=1 l=1).handle_message read tag failed 2023-01-01T17:45:04.551 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:04.551+0000 7f87c4be5700 1 --1- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0005570 0x7f87a00157b0 :-1 s=OPENED pgs=807 cs=1 l=1).fault on lossy channel, failing 2023-01-01T17:45:04.610 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:04.610+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:45:04.610 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:04.610+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:45:04.610 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:04.611+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a0014570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:45:04.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:04.611+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 msgr2=0x7f87a0014570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:45:04.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:04.611+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 msgr2=0x7f87a0014570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:45:04.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:04.611+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a0014570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:45:04.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:04.611+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a0014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:45:04.789 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:04.789+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:04.789 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:04.789+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:04.790 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:04.789+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:04.790 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:04.789+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:04.860 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:04.861+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:04.861 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:04.861+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:04.861 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:04.861+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:04.861 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:04.861+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:04.972 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:04.972+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:04.972 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:04.972+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:04.972 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:04.972+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:04.972 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:04.972+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:05.004 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:05.005+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:05.005 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:05.005+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:05.005 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:05.005+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:05.005 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:05.005+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:05.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:05.011+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:45:05.010 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:05.011+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:45:05.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:05.012+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a0014570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:45:05.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:05.012+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 msgr2=0x7f87a0014570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:45:05.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:05.012+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 msgr2=0x7f87a0014570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:45:05.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:05.012+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a0014570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:45:05.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:05.012+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a0014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:45:05.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:05.812+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:45:05.811 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:05.812+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:45:05.812 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:05.813+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a0014570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:45:05.812 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:05.813+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 msgr2=0x7f87a0014570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:45:05.812 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:05.813+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 msgr2=0x7f87a0014570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:45:05.813 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:05.813+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a0014570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:45:05.813 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:05.813+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a0014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:45:05.827 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:05.828+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:05.827 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:05.828+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:05.828 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:05.828+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:05.828 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:05.828+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:05.836 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:05.835+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:05.837 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:05.835+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:05.837 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:05.835+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:05.837 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:05.835+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:05.953 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:05.954+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:05.953 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:05.954+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:05.954 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:05.954+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:05.954 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:05.954+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:05.994 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:05.995+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:05.994 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:05.995+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:05.994 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:05.995+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:05.994 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:05.995+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:06.864 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:06.865+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:06.864 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:06.865+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:06.864 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:06.865+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:06.865 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:06.865+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:06.869 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:06.869+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:06.869 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:06.869+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:06.869 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:06.869+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:06.869 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:06.869+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:06.935 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:06.933+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:06.935 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:06.933+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:06.935 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:06.933+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:06.936 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:06.933+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:07.012 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:07.013+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:07.012 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:07.013+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:07.012 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:07.013+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:07.013 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:07.013+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:07.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:07.409+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:45:07.409 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:07.409+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:45:07.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:07.409+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 msgr2=0x7f87a0014570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:45:07.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:07.409+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004550 0x7f87a0014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:45:07.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:07.409+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0005570 legacy=0x7f87a00157b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-01-01T17:45:07.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:07.409+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0014ab0 0x7f87a000a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:45:07.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:07.410+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a000a010 con 0x7f87a0003a70 2023-01-01T17:45:07.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:07.410+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a0014ab0 2023-01-01T17:45:07.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:07.410+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0003a70 legacy=0x7f87a0003e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:45:07.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:07.410+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0014ab0 msgr2=0x7f87a000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:45:07.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:07.410+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0014ab0 0x7f87a000a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:45:07.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:07.611+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0003a70 legacy=0x7f87a0003e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:45:07.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:07.611+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0014ab0 msgr2=0x7f87a000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:45:07.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:07.611+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0014ab0 0x7f87a000a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:45:07.872 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:07.868+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:07.872 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:07.868+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:07.872 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:07.868+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:07.872 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:07.868+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:07.874 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:07.874+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:07.874 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:07.875+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:07.874 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:07.875+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:07.874 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:07.875+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:07.917 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:07.911+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:07.918 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:07.911+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:07.918 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:07.911+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:07.918 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:07.911+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:08.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:08.012+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0003a70 legacy=0x7f87a0003e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:45:08.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:08.012+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0014ab0 msgr2=0x7f87a000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:45:08.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:08.012+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0014ab0 0x7f87a000a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:45:08.047 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:08.047+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:08.048 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:08.047+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:08.048 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:08.047+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:08.055 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:08.047+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:08.812 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:08.813+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0003a70 legacy=0x7f87a0003e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:45:08.813 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:08.813+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0014ab0 msgr2=0x7f87a000a7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:45:08.813 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:08.813+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0014ab0 0x7f87a000a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:45:08.914 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:08.914+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:08.914 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:08.914+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:08.914 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:08.914+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:08.914 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:08.914+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:08.918 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:08.918+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:08.918 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:08.918+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:08.918 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:08.918+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:08.918 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:08.918+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:08.924 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:08.924+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:08.924 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:08.924+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:08.924 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:08.925+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:08.925 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:08.925+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:09.022 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~76s 2023-01-01T17:45:09.023 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~76s 2023-01-01T17:45:09.023 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~76s 2023-01-01T17:45:09.023 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~76s 2023-01-01T17:45:09.023 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~76s 2023-01-01T17:45:09.023 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~76s 2023-01-01T17:45:09.023 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~76s 2023-01-01T17:45:09.024 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~76s 2023-01-01T17:45:09.024 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~76s 2023-01-01T17:45:09.057 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:09.058+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:09.057 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:09.058+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:09.058 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:09.058+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:09.058 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:09.058+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:09.551 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-01-01T17:45:09.551+0000 7fc7b8fdb700 -1 mon.a@0(probing) e1 get_health_metrics reporting 920 slow ops, oldest is log(1 entries from seq 42 at 2023-01-01T17:40:56.238062+0000) 2023-01-01T17:45:09.874 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:09.875+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:09.875 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:09.875+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:09.875 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:09.875+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:09.875 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:09.875+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:09.897 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:09.898+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:09.897 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:09.898+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:09.897 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:09.898+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:09.898 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:09.898+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:09.932 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:09.933+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:09.933 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:09.933+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:09.933 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:09.933+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:09.933 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:09.933+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:10.072 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:10.073+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:10.072 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:10.073+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:10.073 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:10.073+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:10.073 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:10.073+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:10.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:10.410+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0014ab0 msgr2=0x7f87a000a7b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:45:10.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:10.410+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0014ab0 0x7f87a000a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:45:10.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:10.410+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0003a70 legacy=0x7f87a0003e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:45:10.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:10.410+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 reap_dead start 2023-01-01T17:45:10.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:10.410+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0005570 0x7f87a0006220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:45:10.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:10.410+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a00122b0 con 0x7f87a0004e80 2023-01-01T17:45:10.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:10.410+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a000a010 con 0x7f87a0012530 2023-01-01T17:45:10.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:10.410+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a0005570 2023-01-01T17:45:10.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:10.410+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0012530 legacy=0x7f87a001a520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:45:10.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:10.410+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0005570 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:45:10.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:10.410+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0005570 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:45:10.610 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:10.611+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0012530 legacy=0x7f87a001a520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:45:10.610 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:10.611+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0005570 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:45:10.610 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:10.611+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0005570 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:45:10.832 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:10.833+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:10.832 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:10.833+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:10.832 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:10.833+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:10.833 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:10.833+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:10.899 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:10.900+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:10.900 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:10.900+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:10.900 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:10.900+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:10.900 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:10.900+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:10.948 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:10.949+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:10.949 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:10.949+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:10.949 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:10.949+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:10.950 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:10.949+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:11.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:11.012+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0012530 legacy=0x7f87a001a520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:45:11.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:11.012+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0005570 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:45:11.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:11.012+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0005570 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:45:11.112 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:11.112+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:11.112 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:11.112+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:11.112 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:11.112+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:11.112 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:11.112+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:11.812 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:11.813+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0012530 legacy=0x7f87a001a520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:45:11.813 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:11.813+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0005570 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:45:11.813 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:11.813+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0005570 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:45:11.864 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:11.865+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:11.865 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:11.865+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:11.865 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:11.865+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:11.865 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:11.865+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:11.876 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:11.876+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:11.877 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:11.876+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:11.877 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:11.876+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:11.877 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:11.876+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:11.995 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:11.995+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:12.055 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:11.995+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:12.055 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:11.995+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:12.056 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:11.995+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:12.076 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:12.077+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:12.077 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:12.077+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:12.078 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:12.077+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:12.081 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:12.077+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:12.839 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:12.839+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:12.839 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:12.839+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:12.839 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:12.839+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:12.839 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:12.839+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:12.853 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:12.854+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:12.854 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:12.854+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:12.854 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:12.854+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:12.854 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:12.854+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:13.027 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:13.027+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:13.027 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:13.027+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:13.027 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:13.027+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:13.028 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:13.027+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:13.106 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:13.107+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:13.107 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:13.107+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:13.107 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:13.107+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:13.107 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:13.107+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:13.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:13.410+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0005570 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:45:13.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:13.410+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0005570 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:45:13.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:13.410+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0012530 legacy=0x7f87a001a520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:45:13.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:13.410+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0004e80 legacy=0x7f87a0015780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:45:13.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:13.410+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0014570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:45:13.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:13.410+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0014ab0 0x7f87a0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:45:13.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:13.410+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a000a7b0 2023-01-01T17:45:13.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:13.410+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00c08a0 con 0x7f87a0014ab0 2023-01-01T17:45:13.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:13.410+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0014ab0 msgr2=0x7f87a0003e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:45:13.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:13.410+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0014570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:45:13.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:13.410+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0014ab0 0x7f87a0003e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:45:13.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:13.411+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 msgr2=0x7f87a0014570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:45:13.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:13.411+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 msgr2=0x7f87a0014570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:45:13.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:13.411+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0014570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:45:13.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:13.411+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:45:13.610 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:13.611+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0014ab0 msgr2=0x7f87a0003e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:45:13.610 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:13.611+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0014ab0 0x7f87a0003e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:45:13.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:13.612+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0014570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:45:13.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:13.612+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 msgr2=0x7f87a0014570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:45:13.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:13.612+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 msgr2=0x7f87a0014570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:45:13.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:13.612+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0014570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:45:13.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:13.612+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:45:13.818 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:13.819+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:13.818 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:13.819+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:13.819 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:13.819+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:13.819 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:13.819+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:13.901 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:13.902+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:13.901 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:13.902+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:13.901 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:13.902+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:13.901 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:13.902+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:13.985 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:13.986+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:13.985 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:13.986+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:13.986 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:13.986+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:13.986 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:13.986+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:14.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:14.012+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0014ab0 msgr2=0x7f87a0003e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:45:14.011 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:14.012+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0014ab0 0x7f87a0003e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:45:14.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:14.013+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0014570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:45:14.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:14.013+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 msgr2=0x7f87a0014570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:45:14.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:14.013+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 msgr2=0x7f87a0014570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:45:14.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:14.013+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0014570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:45:14.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:14.013+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:45:14.158 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:14.157+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:14.158 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:14.157+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:14.158 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:14.157+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:14.158 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:14.157+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:14.552 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-01-01T17:45:14.552+0000 7fc7b8fdb700 -1 mon.a@0(probing) e1 get_health_metrics reporting 1023 slow ops, oldest is log(1 entries from seq 42 at 2023-01-01T17:40:56.238062+0000) 2023-01-01T17:45:14.812 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:14.813+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0014ab0 msgr2=0x7f87a0003e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:45:14.813 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:14.813+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0014ab0 0x7f87a0003e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:45:14.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:14.814+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0014570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:45:14.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:14.814+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 msgr2=0x7f87a0014570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:45:14.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:14.814+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 msgr2=0x7f87a0014570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:45:14.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:14.814+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0014570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:45:14.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:14.814+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:45:14.833 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~81s 2023-01-01T17:45:14.833 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~81s 2023-01-01T17:45:14.834 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~81s 2023-01-01T17:45:14.834 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~81s 2023-01-01T17:45:14.835 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~81s 2023-01-01T17:45:14.835 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~81s 2023-01-01T17:45:14.835 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~81s 2023-01-01T17:45:14.836 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~81s 2023-01-01T17:45:14.836 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~81s 2023-01-01T17:45:14.849 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:14.844+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:14.850 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:14.844+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:14.850 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:14.844+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:14.850 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:14.844+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:14.861 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:14.862+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:14.861 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:14.862+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:14.861 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:14.862+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:14.861 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:14.862+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:15.019 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:15.020+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:15.019 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:15.020+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:15.020 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:15.020+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:15.020 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:15.020+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:15.195 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:15.196+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:15.196 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:15.196+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:15.196 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:15.196+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:15.196 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:15.196+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:15.837 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:15.839+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:15.838 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:15.839+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:15.838 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:15.839+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:15.838 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:15.839+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:15.850 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:15.851+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:15.850 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:15.851+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:15.851 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:15.851+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:15.851 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:15.851+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:15.986 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:15.987+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:16.072 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:15.987+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:16.072 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:15.987+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:16.073 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:15.987+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:16.197 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:16.195+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:16.197 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:16.195+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:16.197 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:16.195+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:16.198 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:16.195+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:16.410 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:16.410+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0014ab0 msgr2=0x7f87a0003e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:45:16.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:16.410+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0014ab0 0x7f87a0003e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:45:16.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:16.410+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 msgr2=0x7f87a0014570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:45:16.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:16.410+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:45:16.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:16.410+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0014ab0 0x7f87a0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:45:16.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:16.410+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 reap_dead start 2023-01-01T17:45:16.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:16.410+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a0012900 con 0x7f87a0004e80 2023-01-01T17:45:16.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:16.410+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a000a010 con 0x7f87a0005570 2023-01-01T17:45:16.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:16.411+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a0014ab0 2023-01-01T17:45:16.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:16.411+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0014ab0 msgr2=0x7f87a0003e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:45:16.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:16.411+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0005570 legacy=0x7f87a000b270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:45:16.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:16.411+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0014ab0 0x7f87a0003e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:45:16.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:16.612+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0005570 legacy=0x7f87a000b270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:45:16.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:16.612+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0014ab0 msgr2=0x7f87a0003e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:45:16.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:16.612+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0014ab0 0x7f87a0003e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:45:16.811 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:16.811+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:16.812 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:16.811+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:16.812 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:16.811+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:16.812 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:16.811+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:16.831 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:16.831+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:16.831 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:16.831+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:16.831 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:16.831+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:16.832 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:16.831+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:16.964 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:16.963+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:17.041 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:16.963+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:17.041 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:16.963+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:17.042 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:16.963+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:17.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:17.012+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0005570 legacy=0x7f87a000b270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:45:17.042 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:17.012+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0014ab0 msgr2=0x7f87a0003e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:45:17.043 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:17.012+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0014ab0 0x7f87a0003e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:45:17.244 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:17.244+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:17.245 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:17.244+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:17.245 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:17.244+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:17.245 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:17.244+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:17.813 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:17.813+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0014ab0 msgr2=0x7f87a0003e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:45:17.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:17.813+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0005570 legacy=0x7f87a000b270 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:45:17.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:17.813+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0014ab0 0x7f87a0003e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:45:17.830 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:17.829+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:17.831 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:17.829+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:17.831 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:17.829+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:17.831 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:17.829+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:17.870 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:17.869+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:17.871 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:17.869+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:17.871 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:17.869+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:17.871 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:17.869+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:17.981 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:17.981+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:17.981 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:17.981+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:17.982 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:17.981+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:17.982 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:17.981+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:18.256 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:18.256+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:18.392 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:18.256+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:18.392 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:18.256+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:18.392 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:18.256+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:18.831 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:18.831+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:18.831 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:18.831+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:18.832 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:18.831+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:18.832 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:18.831+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:18.921 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:18.917+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:18.921 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:18.917+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:18.922 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:18.917+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:18.922 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:18.917+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:18.993 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:18.992+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:18.993 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:18.992+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:18.993 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:18.992+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:18.994 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:18.992+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:19.253 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:19.252+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:19.254 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:19.252+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:19.254 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:19.252+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:19.254 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:19.252+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:19.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:19.410+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0014ab0 msgr2=0x7f87a0003e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:45:19.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:19.410+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0014ab0 0x7f87a0003e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:45:19.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:19.410+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0005570 legacy=0x7f87a000b270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:45:19.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:19.410+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0004e80 legacy=0x7f87a0015780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-01-01T17:45:19.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:19.410+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012530 0x7f87a0006220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:45:19.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:19.410+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0014570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:45:19.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:19.410+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a000a7b0 2023-01-01T17:45:19.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:19.410+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00c08a0 con 0x7f87a0012530 2023-01-01T17:45:19.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:19.410+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012530 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:45:19.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:19.410+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012530 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:45:19.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:19.410+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0014570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:45:19.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:19.410+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 msgr2=0x7f87a0014570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-01-01T17:45:19.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:19.410+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 msgr2=0x7f87a0014570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:45:19.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:19.410+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0014570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:45:19.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:19.410+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:45:19.553 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-01-01T17:45:19.552+0000 7fc7b8fdb700 -1 mon.a@0(probing) e1 get_health_metrics reporting 1097 slow ops, oldest is log(1 entries from seq 42 at 2023-01-01T17:40:56.238062+0000) 2023-01-01T17:45:19.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:19.611+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012530 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:45:19.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:19.611+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012530 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:45:19.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:19.611+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0014570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:45:19.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:19.611+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 msgr2=0x7f87a0014570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-01-01T17:45:19.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:19.611+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 msgr2=0x7f87a0014570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:45:19.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:19.611+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0014570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:45:19.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:19.611+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:45:19.884 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:19.874+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:19.884 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:19.874+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:19.885 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:19.874+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:19.885 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:19.874+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:19.969 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:19.967+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:19.969 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:19.967+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:19.970 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:19.967+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:19.970 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:19.967+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:20.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:20.012+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012530 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:45:20.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:20.012+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0014570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:45:20.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:20.012+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012530 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:45:20.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:20.012+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 msgr2=0x7f87a0014570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:45:20.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:20.012+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 msgr2=0x7f87a0014570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:45:20.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:20.012+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0014570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:45:20.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:20.012+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:45:20.042 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:20.041+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:20.043 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:20.042+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:20.043 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:20.042+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:20.043 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:20.042+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:20.253 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:20.251+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:20.253 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:20.251+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:20.253 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:20.251+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:20.253 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:20.251+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:20.671 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~87s 2023-01-01T17:45:20.731 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~87s 2023-01-01T17:45:20.731 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~87s 2023-01-01T17:45:20.731 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~87s 2023-01-01T17:45:20.731 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~87s 2023-01-01T17:45:20.731 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~87s 2023-01-01T17:45:20.732 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~87s 2023-01-01T17:45:20.732 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~87s 2023-01-01T17:45:20.732 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~87s 2023-01-01T17:45:20.813 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:20.813+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012530 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:45:20.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:20.813+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012530 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:45:20.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:20.813+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0014570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:45:20.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:20.813+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 msgr2=0x7f87a0014570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:45:20.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:20.813+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 msgr2=0x7f87a0014570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:45:20.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:20.813+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0014570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:45:20.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:20.813+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:45:20.825 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:20.825+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:20.825 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:20.825+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:20.825 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:20.825+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:20.826 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:20.825+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:20.934 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:20.934+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:20.934 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:20.934+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:20.934 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:20.934+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:20.934 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:20.934+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:21.025 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:21.025+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:21.026 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:21.025+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:21.026 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:21.025+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:21.026 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:21.025+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:21.247 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:21.247+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:21.526 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:21.247+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:21.526 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:21.247+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:21.526 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:21.247+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:21.526 DEBUG:teuthology.orchestra.run.smithi061:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-01-01T17:45:21.532 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-01-01T17:45:21.867 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:21.868+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:21.868 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:21.868+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:21.868 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:21.868+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:21.868 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:21.868+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:21.916 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:21.916+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:21.916 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:21.916+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:21.917 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:21.916+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:21.917 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:21.916+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:21.993 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:21.993+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:21.994 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:21.993+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:21.994 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:21.993+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:21.994 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:21.993+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:22.288 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:22.288+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:22.289 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:22.288+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:22.289 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:22.288+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:22.290 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:22.288+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:22.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:22.410+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012530 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:45:22.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:22.410+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012530 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:45:22.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:22.410+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 msgr2=0x7f87a0014570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:45:22.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:22.410+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:45:22.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:22.410+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 reap_dead start 2023-01-01T17:45:22.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:22.410+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0006220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:45:22.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:22.410+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a0012ab0 con 0x7f87a0005570 2023-01-01T17:45:22.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:22.410+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a000a010 con 0x7f87a0004e80 2023-01-01T17:45:22.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:22.410+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a000a7b0 2023-01-01T17:45:22.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:22.410+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0004e80 legacy=0x7f87a0015780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:45:22.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:22.410+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0006220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:45:22.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:22.411+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-01-01T17:45:22.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:22.411+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:45:22.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:22.411+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0006220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:45:22.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:22.411+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:45:22.611 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:22.611+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0004e80 legacy=0x7f87a0015780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:45:22.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:22.612+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0006220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:45:22.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:22.612+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:45:22.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:22.612+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:45:22.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:22.612+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0006220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:45:22.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:22.612+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:45:22.898 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:22.896+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:22.898 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:22.896+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:22.898 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:22.896+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:22.898 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:22.896+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:22.940 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:22.939+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:22.940 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:22.939+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:22.940 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:22.939+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:22.940 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:22.939+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:23.012 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:23.012+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0004e80 legacy=0x7f87a0015780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:45:23.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:23.013+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0006220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:45:23.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:23.013+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:45:23.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:23.013+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:45:23.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:23.013+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0006220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:45:23.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:23.013+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:45:23.039 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:23.037+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:23.041 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:23.037+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:23.041 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:23.037+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:23.041 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:23.037+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:23.255 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:23.255+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:23.255 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:23.255+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:23.256 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:23.255+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:23.256 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:23.255+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:23.813 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:23.813+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0004e80 legacy=0x7f87a0015780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:45:23.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:23.814+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0006220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:45:23.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:23.814+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:45:23.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:23.814+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:45:23.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:23.814+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0006220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:45:23.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:23.814+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:45:23.934 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:23.934+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:23.935 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:23.934+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:23.935 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:23.934+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:23.935 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:23.934+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:23.940 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:23.938+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:23.940 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:23.938+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:23.940 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:23.938+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:23.940 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:23.938+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:24.088 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:24.088+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:24.088 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:24.088+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:24.088 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:24.088+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:24.089 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:24.088+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:24.278 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:24.279+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:24.279 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:24.279+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:24.279 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:24.279+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:24.279 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:24.279+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:24.553 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-01-01T17:45:24.553+0000 7fc7b8fdb700 -1 mon.a@0(probing) e1 get_health_metrics reporting 1152 slow ops, oldest is log(1 entries from seq 42 at 2023-01-01T17:40:56.238062+0000) 2023-01-01T17:45:24.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:24.553+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0005570 legacy=0x7f87a0014570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2023-01-01T17:45:24.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:24.553+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0005570 legacy=0x7f87a0014570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-01-01T17:45:24.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:24.553+0000 7f87bf7fe700 1 --1- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0005570 0x7f87a0014570 :-1 s=OPENED pgs=860 cs=1 l=1).handle_message read tag failed 2023-01-01T17:45:24.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:24.553+0000 7f87bf7fe700 1 --1- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0005570 0x7f87a0014570 :-1 s=OPENED pgs=860 cs=1 l=1).fault on lossy channel, failing 2023-01-01T17:45:24.896 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:24.895+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:24.896 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:24.895+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:24.896 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:24.895+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:24.896 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:24.895+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:24.988 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:24.987+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:24.988 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:24.987+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:24.988 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:24.987+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:24.988 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:24.987+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:25.067 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:25.067+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:25.067 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:25.067+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:25.067 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:25.067+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:25.067 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:25.067+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:25.306 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:25.306+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:25.306 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:25.306+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:25.307 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:25.306+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:25.307 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:25.306+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:25.411 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:25.410+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:45:25.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:25.410+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a000a7b0 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:45:25.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:25.410+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0004e80 legacy=0x7f87a0015780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:45:25.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:25.410+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0005570 legacy=0x7f87a0014570 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-01-01T17:45:25.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:25.410+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012500 0x7f87a0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:45:25.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:25.411+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00128d0 0x7f87a0004380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:45:25.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:25.411+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a00128d0 2023-01-01T17:45:25.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:25.411+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00c08a0 con 0x7f87a0012500 2023-01-01T17:45:25.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:25.411+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012500 msgr2=0x7f87a0003e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:45:25.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:25.411+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012500 0x7f87a0003e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:45:25.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:25.411+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00128d0 msgr2=0x7f87a0004380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:45:25.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:25.411+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00128d0 0x7f87a0004380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:45:25.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:25.612+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012500 msgr2=0x7f87a0003e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:45:25.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:25.612+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00128d0 msgr2=0x7f87a0004380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:45:25.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:25.612+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00128d0 0x7f87a0004380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:45:25.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:25.612+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012500 0x7f87a0003e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:45:25.913 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:25.913+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:25.913 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:25.913+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:25.914 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:25.913+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:25.914 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:25.913+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:25.991 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:25.990+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:25.998 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:25.990+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:25.998 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:25.990+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:25.998 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:25.990+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:26.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:26.013+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012500 msgr2=0x7f87a0003e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:45:26.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:26.013+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00128d0 msgr2=0x7f87a0004380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:45:26.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:26.013+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00128d0 0x7f87a0004380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:45:26.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:26.013+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012500 0x7f87a0003e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:45:26.021 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:26.021+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:26.021 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:26.021+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:26.021 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:26.021+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:26.021 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:26.021+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:26.262 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:26.261+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:26.262 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:26.261+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:26.262 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:26.261+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:26.263 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:26.261+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:26.544 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~93s 2023-01-01T17:45:26.544 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~93s 2023-01-01T17:45:26.544 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~93s 2023-01-01T17:45:26.544 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~93s 2023-01-01T17:45:26.544 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~93s 2023-01-01T17:45:26.544 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~93s 2023-01-01T17:45:26.545 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~93s 2023-01-01T17:45:26.545 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~93s 2023-01-01T17:45:26.545 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~93s 2023-01-01T17:45:26.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:26.814+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012500 msgr2=0x7f87a0003e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:45:26.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:26.814+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00128d0 msgr2=0x7f87a0004380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:45:26.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:26.814+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00128d0 0x7f87a0004380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:45:26.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:26.814+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012500 0x7f87a0003e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:45:26.963 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:26.963+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:26.963 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:26.963+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:26.964 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:26.963+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:26.964 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:26.963+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:27.008 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:27.008+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:27.009 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:27.008+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:27.009 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:27.008+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:27.009 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:27.008+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:27.039 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:27.039+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:27.040 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:27.039+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:27.040 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:27.039+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:27.040 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:27.039+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:27.272 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:27.271+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:27.272 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:27.271+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:27.272 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:27.271+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:27.272 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:27.272+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:27.984 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:27.983+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:27.984 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:27.983+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:27.984 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:27.983+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:27.984 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:27.983+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:27.990 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:27.990+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:27.990 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:27.990+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:27.991 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:27.990+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:27.991 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:27.990+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:28.005 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:28.005+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:28.005 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:28.005+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:28.006 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:28.005+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:28.006 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:28.005+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:28.241 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:28.241+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:28.242 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:28.241+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:28.242 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:28.241+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:28.242 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:28.241+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:28.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:28.411+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012500 msgr2=0x7f87a0003e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:45:28.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:28.411+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012500 0x7f87a0003e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:45:28.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:28.411+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00128d0 msgr2=0x7f87a0004380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:45:28.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:28.411+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00128d0 0x7f87a0004380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:45:28.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:28.411+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 reap_dead start 2023-01-01T17:45:28.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:28.411+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012500 0x7f87a0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:45:28.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:28.411+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:45:28.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:28.411+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a0014c80 con 0x7f87a000a7b0 2023-01-01T17:45:28.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:28.411+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a0004e80 2023-01-01T17:45:28.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:28.411+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00c08a0 con 0x7f87a0012500 2023-01-01T17:45:28.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:28.411+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012500 msgr2=0x7f87a0003e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:45:28.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:28.411+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:45:28.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:28.411+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012500 0x7f87a0003e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:45:28.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:28.411+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-01-01T17:45:28.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:28.411+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:45:28.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:28.411+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:45:28.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:28.411+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:45:28.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:28.612+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012500 msgr2=0x7f87a0003e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:45:28.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:28.612+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012500 0x7f87a0003e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:45:28.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:28.612+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:45:28.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:28.612+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-01-01T17:45:28.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:28.612+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:45:28.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:28.612+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:45:28.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:28.612+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:45:28.963 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:28.963+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:28.963 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:28.963+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:28.963 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:28.963+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:28.963 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:28.963+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:28.966 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:28.966+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:28.966 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:28.966+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:28.966 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:28.966+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:28.967 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:28.966+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:28.971 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:28.969+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:28.971 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:28.969+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:28.971 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:28.969+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:28.971 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:28.969+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:29.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:29.013+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012500 msgr2=0x7f87a0003e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:45:29.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:29.013+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012500 0x7f87a0003e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:45:29.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:29.013+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:45:29.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:29.013+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:45:29.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:29.013+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:45:29.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:29.013+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:45:29.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:29.013+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:45:29.224 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:29.224+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:29.224 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:29.224+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:29.225 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:29.224+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:29.225 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:29.224+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:29.554 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:29.554+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a000a7b0 legacy=0x7f87a0014570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-01-01T17:45:29.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:29.554+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a000a7b0 legacy=0x7f87a0014570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-01-01T17:45:29.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:29.554+0000 7f87c4be5700 1 --1- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a000a7b0 0x7f87a0014570 :-1 s=OPENED pgs=874 cs=1 l=1).handle_message read tag failed 2023-01-01T17:45:29.555 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:29.554+0000 7f87c4be5700 1 --1- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a000a7b0 0x7f87a0014570 :-1 s=OPENED pgs=874 cs=1 l=1).fault on lossy channel, failing 2023-01-01T17:45:29.556 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-01-01T17:45:29.554+0000 7fc7b8fdb700 -1 mon.a@0(probing) e1 get_health_metrics reporting 1197 slow ops, oldest is log(1 entries from seq 42 at 2023-01-01T17:40:56.238062+0000) 2023-01-01T17:45:29.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:29.814+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012500 msgr2=0x7f87a0003e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:45:29.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:29.814+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012500 0x7f87a0003e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:45:29.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:29.814+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:45:29.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:29.814+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:45:29.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:29.814+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:45:29.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:29.814+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:45:29.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:29.814+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:45:29.921 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:29.921+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:29.921 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:29.921+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:29.921 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:29.921+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:29.922 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:29.921+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:29.970 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:29.970+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:29.970 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:29.970+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:29.971 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:29.970+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:29.971 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:29.970+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:30.002 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:30.001+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:30.002 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:30.001+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:30.002 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:30.001+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:30.002 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:30.001+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:30.193 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:30.192+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:30.193 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:30.192+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:30.193 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:30.192+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:30.193 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:30.192+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:30.932 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:30.933+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:30.933 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:30.933+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:30.933 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:30.933+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:30.933 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:30.933+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:30.966 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:30.965+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:30.966 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:30.965+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:30.966 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:30.965+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:30.966 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:30.965+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:31.015 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:31.014+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:31.015 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:31.014+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:31.015 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:31.014+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:31.015 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:31.014+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:31.215 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:31.216+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:31.216 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:31.216+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:31.216 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:31.216+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:31.216 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:31.216+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:31.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:31.411+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012500 msgr2=0x7f87a0003e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:45:31.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:31.411+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012500 0x7f87a0003e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:45:31.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:31.411+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:45:31.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:31.411+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:45:31.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:31.411+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a000a7b0 legacy=0x7f87a0014570 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-01-01T17:45:31.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:31.411+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00128d0 0x7f87a0004380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:45:31.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:31.411+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a000a010 con 0x7f87a0005570 2023-01-01T17:45:31.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:31.411+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a00128d0 2023-01-01T17:45:31.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:31.411+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00128d0 msgr2=0x7f87a0004380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:45:31.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:31.411+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0005570 legacy=0x7f87a0015780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:45:31.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:31.411+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00128d0 0x7f87a0004380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:45:31.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:31.612+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00128d0 msgr2=0x7f87a0004380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:45:31.612 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:31.612+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0005570 legacy=0x7f87a0015780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:45:31.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:31.612+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00128d0 0x7f87a0004380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:45:31.904 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:31.904+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:31.905 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:31.904+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:31.905 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:31.904+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:31.905 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:31.904+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:31.929 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:31.929+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:31.929 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:31.929+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:31.929 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:31.929+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:31.930 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:31.929+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:32.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:32.013+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00128d0 msgr2=0x7f87a0004380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:45:32.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:32.013+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0005570 legacy=0x7f87a0015780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:45:32.013 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:32.013+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00128d0 0x7f87a0004380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:45:32.056 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:32.056+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:32.057 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:32.056+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:32.057 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:32.056+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:32.057 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:32.056+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:32.249 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:32.249+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:32.249 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:32.249+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:32.249 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:32.249+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:32.250 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:32.249+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:32.351 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~99s 2023-01-01T17:45:32.351 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~99s 2023-01-01T17:45:32.351 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~99s 2023-01-01T17:45:32.351 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~99s 2023-01-01T17:45:32.351 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~99s 2023-01-01T17:45:32.351 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~99s 2023-01-01T17:45:32.352 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~99s 2023-01-01T17:45:32.352 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~99s 2023-01-01T17:45:32.352 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~99s 2023-01-01T17:45:32.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:32.814+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00128d0 msgr2=0x7f87a0004380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:45:32.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:32.814+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0005570 legacy=0x7f87a0015780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:45:32.814 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:32.814+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00128d0 0x7f87a0004380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:45:32.863 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:32.863+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:32.864 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:32.863+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:32.864 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:32.863+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:32.864 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:32.863+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:32.891 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:32.892+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:32.892 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:32.892+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:32.892 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:32.892+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:32.892 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:32.892+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:33.092 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:33.092+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:33.092 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:33.092+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:33.092 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:33.092+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:33.092 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:33.092+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:33.220 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:33.221+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:33.221 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:33.221+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:33.221 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:33.221+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:33.221 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:33.221+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:33.823 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:33.824+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:33.824 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:33.824+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:33.824 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:33.824+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:33.824 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:33.824+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:33.927 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:33.928+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:33.928 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:33.928+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:33.928 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:33.928+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:33.928 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:33.928+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:34.046 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:34.046+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:34.046 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:34.046+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:34.047 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:34.046+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:34.047 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:34.046+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:34.246 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:34.246+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:34.246 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:34.246+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:34.246 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:34.246+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:34.246 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:34.246+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:34.412 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:34.412+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00128d0 msgr2=0x7f87a0004380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:45:34.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:34.412+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a00128d0 0x7f87a0004380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:45:34.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:34.412+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a0005570 legacy=0x7f87a0015780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:45:34.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:34.412+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 reap_dead start 2023-01-01T17:45:34.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:34.412+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:45:34.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:34.412+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0005570 0x7f87a0015780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:45:34.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:34.412+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a00122b0 con 0x7f87a000a7b0 2023-01-01T17:45:34.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:34.412+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a0004e80 2023-01-01T17:45:34.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:34.412+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00c08a0 con 0x7f87a0005570 2023-01-01T17:45:34.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:34.412+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:45:34.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:34.412+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0005570 msgr2=0x7f87a0015780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:45:34.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:34.412+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0005570 0x7f87a0015780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:45:34.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:34.412+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:45:34.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:34.412+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:45:34.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:34.412+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:45:34.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:34.412+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:45:34.555 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-01-01T17:45:34.555+0000 7fc7b8fdb700 -1 mon.a@0(probing) e1 get_health_metrics reporting 1239 slow ops, oldest is log(1 entries from seq 42 at 2023-01-01T17:40:56.238062+0000) 2023-01-01T17:45:34.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:34.556+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a000a7b0 legacy=0x7f87a0014570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2023-01-01T17:45:34.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:34.556+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a000a7b0 legacy=0x7f87a0014570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-01-01T17:45:34.556 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:34.556+0000 7f87c4be5700 1 --1- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a000a7b0 0x7f87a0014570 :-1 s=OPENED pgs=888 cs=1 l=1).handle_message read tag failed 2023-01-01T17:45:34.557 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:34.556+0000 7f87c4be5700 1 --1- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a000a7b0 0x7f87a0014570 :-1 s=OPENED pgs=888 cs=1 l=1).fault on lossy channel, failing 2023-01-01T17:45:34.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:34.613+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:45:34.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:34.613+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0005570 msgr2=0x7f87a0015780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:45:34.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:34.613+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0005570 0x7f87a0015780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:45:34.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:34.613+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-01-01T17:45:34.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:34.613+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:45:34.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:34.613+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:45:34.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:34.613+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:45:34.826 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:34.827+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:34.827 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:34.827+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:34.827 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:34.827+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:34.827 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:34.827+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:34.940 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:34.940+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:34.940 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:34.940+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:34.940 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:34.940+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:34.940 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:34.940+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:35.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:35.014+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0005570 msgr2=0x7f87a0015780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:45:35.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:35.014+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0005570 0x7f87a0015780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:45:35.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:35.014+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:45:35.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:35.014+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-01-01T17:45:35.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:35.014+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:45:35.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:35.014+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:45:35.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:35.014+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:45:35.022 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:35.021+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:35.027 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:35.021+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:35.027 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:35.021+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:35.027 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:35.021+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:35.280 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:35.281+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:35.281 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:35.281+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:35.281 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:35.281+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:35.281 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:35.281+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:35.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:35.815+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0005570 msgr2=0x7f87a0015780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:45:35.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:35.815+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0005570 0x7f87a0015780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:45:35.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:35.815+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:45:35.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:35.815+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:45:35.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:35.815+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:45:35.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:35.815+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:45:35.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:35.815+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:45:35.869 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:35.869+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:35.869 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:35.869+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:35.869 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:35.869+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:35.870 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:35.869+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:35.989 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:35.989+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:35.989 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:35.989+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:35.989 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:35.989+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:35.989 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:35.989+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:36.051 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:36.051+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:36.051 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:36.051+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:36.051 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:36.051+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:36.051 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:36.051+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:36.256 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:36.256+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:36.256 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:36.256+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:36.256 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:36.256+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:36.256 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:36.256+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:36.844 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:36.844+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:36.844 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:36.844+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:36.844 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:36.844+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:36.844 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:36.844+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:37.032 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:37.032+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:37.032 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:37.032+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:37.032 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:37.032+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:37.033 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:37.032+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:37.060 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:37.060+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:37.061 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:37.060+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:37.061 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:37.060+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:37.061 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:37.060+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:37.249 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:37.249+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:37.249 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:37.249+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:37.249 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:37.249+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:37.250 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:37.249+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:37.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:37.412+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0005570 msgr2=0x7f87a0015780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:45:37.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:37.412+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0005570 0x7f87a0015780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:45:37.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:37.412+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:45:37.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:37.412+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:45:37.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:37.412+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a000a7b0 legacy=0x7f87a0014570 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-01-01T17:45:37.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:37.412+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0012500 0x7f87a0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:45:37.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:37.412+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a000a010 con 0x7f87a00128d0 2023-01-01T17:45:37.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:37.412+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a0012500 2023-01-01T17:45:37.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:37.412+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a00128d0 legacy=0x7f87a00112a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:45:37.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:37.412+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0012500 msgr2=0x7f87a0003e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:45:37.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:37.412+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0012500 0x7f87a0003e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:45:37.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:37.613+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0012500 msgr2=0x7f87a0003e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:45:37.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:37.613+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a00128d0 legacy=0x7f87a00112a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:45:37.613 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:37.613+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0012500 0x7f87a0003e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:45:37.811 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:37.812+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:37.811 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:37.812+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:37.812 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:37.812+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:37.812 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:37.812+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:38.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:38.014+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0012500 msgr2=0x7f87a0003e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:45:38.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:38.014+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a00128d0 legacy=0x7f87a00112a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:45:38.014 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:38.014+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0012500 0x7f87a0003e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:45:38.037 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:38.037+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:38.037 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:38.037+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:38.037 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:38.037+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:38.038 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:38.037+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:38.069 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:38.069+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:38.070 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:38.069+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:38.070 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:38.069+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:38.070 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:38.069+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:38.159 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~105s 2023-01-01T17:45:38.159 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~105s 2023-01-01T17:45:38.159 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~105s 2023-01-01T17:45:38.159 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~105s 2023-01-01T17:45:38.159 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~105s 2023-01-01T17:45:38.159 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~105s 2023-01-01T17:45:38.160 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~105s 2023-01-01T17:45:38.160 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~105s 2023-01-01T17:45:38.160 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~105s 2023-01-01T17:45:38.245 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:38.246+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:38.246 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:38.246+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:38.246 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:38.246+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:38.246 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:38.246+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:38.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:38.815+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a00128d0 legacy=0x7f87a00112a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:45:38.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:38.815+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0012500 msgr2=0x7f87a0003e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:45:38.815 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:38.815+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0012500 0x7f87a0003e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:45:38.834 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:38.835+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:38.835 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:38.835+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:38.835 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:38.835+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:38.835 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:38.835+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:39.048 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:39.048+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:39.048 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:39.048+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:39.048 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:39.048+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:39.048 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:39.048+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:39.056 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:39.056+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:39.056 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:39.056+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:39.056 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:39.056+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:39.057 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:39.056+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:39.238 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:39.238+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:39.238 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:39.238+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:39.239 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:39.238+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:39.239 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:39.238+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:39.556 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-01-01T17:45:39.556+0000 7fc7b8fdb700 -1 mon.a@0(probing) e1 get_health_metrics reporting 1412 slow ops, oldest is log(1 entries from seq 42 at 2023-01-01T17:40:56.238062+0000) 2023-01-01T17:45:39.865 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:39.865+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:39.865 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:39.865+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:39.865 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:39.865+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:39.866 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:39.865+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:40.057 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:40.057+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:40.058 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:40.057+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:40.058 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:40.057+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:40.058 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:40.057+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:40.073 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:40.074+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:40.074 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:40.074+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:40.074 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:40.074+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:40.074 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:40.074+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:40.241 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:40.241+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:40.241 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:40.241+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:40.242 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:40.241+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:40.242 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:40.241+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:40.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:40.412+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0012500 msgr2=0x7f87a0003e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:45:40.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:40.412+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0012500 0x7f87a0003e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:45:40.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:40.412+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a00128d0 legacy=0x7f87a00112a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:45:40.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:40.412+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:45:40.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:40.412+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 reap_dead start 2023-01-01T17:45:40.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:40.412+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0005570 0x7f87a0015780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:45:40.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:40.412+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a0005fe0 con 0x7f87a000a7b0 2023-01-01T17:45:40.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:40.412+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a0004e80 2023-01-01T17:45:40.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:40.412+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00c08a0 con 0x7f87a0005570 2023-01-01T17:45:40.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:40.413+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:45:40.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:40.413+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0005570 msgr2=0x7f87a0015780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:45:40.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:40.413+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a000a7b0 legacy=0x7f87a0014570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:45:40.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:40.413+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0005570 0x7f87a0015780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:45:40.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:40.413+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:45:40.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:40.413+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:45:40.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:40.413+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:45:40.418 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:40.413+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:45:40.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:40.614+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0005570 msgr2=0x7f87a0015780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:45:40.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:40.614+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a000a7b0 legacy=0x7f87a0014570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:45:40.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:40.614+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0005570 0x7f87a0015780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:45:40.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:40.614+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:45:40.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:40.614+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-01-01T17:45:40.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:40.614+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:45:40.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:40.614+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:45:40.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:40.614+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:45:40.817 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:40.818+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:40.818 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:40.818+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:40.818 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:40.818+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:40.818 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:40.818+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:41.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:41.015+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:45:41.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:41.015+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a000a7b0 legacy=0x7f87a0014570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:45:41.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:41.015+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0005570 msgr2=0x7f87a0015780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:45:41.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:41.015+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0005570 0x7f87a0015780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:45:41.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:41.015+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-01-01T17:45:41.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:41.015+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:45:41.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:41.015+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:45:41.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:41.015+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:45:41.076 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:41.076+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:41.077 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:41.076+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:41.077 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:41.076+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:41.077 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:41.076+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:41.080 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:41.081+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:41.080 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:41.081+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:41.080 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:41.081+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:41.080 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:41.081+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:41.198 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:41.199+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:41.199 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:41.199+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:41.199 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:41.199+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:41.199 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:41.199+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:41.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:41.816+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a000a7b0 legacy=0x7f87a0014570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:45:41.873 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:41.816+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0005570 msgr2=0x7f87a0015780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:45:41.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:41.816+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0005570 0x7f87a0015780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:45:41.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:41.816+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:45:41.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:41.816+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-01-01T17:45:41.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:41.816+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:45:41.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:41.816+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:45:41.874 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:41.816+0000 7f87bffff700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:45:41.875 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:41.857+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:41.875 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:41.858+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:41.875 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:41.858+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:41.875 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:41.858+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:42.040 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:42.039+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:42.040 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:42.039+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:42.040 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:42.039+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:42.041 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:42.039+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:42.043 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:42.044+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:42.044 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:42.044+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:42.044 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:42.044+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:42.044 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:42.044+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:42.240 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:42.240+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:42.240 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:42.240+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:42.240 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:42.240+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:42.240 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:42.240+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:42.865 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:42.865+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:42.866 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:42.865+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:42.866 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:42.865+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:42.866 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:42.865+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:43.048 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:43.048+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:43.048 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:43.048+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:43.048 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:43.048+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:43.048 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:43.048+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:43.055 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:43.055+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:43.055 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:43.055+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:43.055 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:43.055+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:43.055 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:43.055+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:43.231 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:43.231+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:43.231 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:43.231+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:43.231 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:43.231+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:43.231 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:43.231+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:43.413 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:43.413+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0005570 msgr2=0x7f87a0015780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:45:43.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:43.413+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0005570 0x7f87a0015780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:45:43.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:43.413+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:45:43.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:43.413+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:45:43.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:43.413+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a000a7b0 legacy=0x7f87a0014570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:45:43.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:43.413+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a00128d0 0x7f87a0018510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:45:43.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:43.413+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a000a010 con 0x7f87a0012500 2023-01-01T17:45:43.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:43.413+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a00128d0 2023-01-01T17:45:43.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:43.413+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a00128d0 msgr2=0x7f87a0018510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:45:43.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:43.413+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a00128d0 0x7f87a0018510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:45:43.617 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:43.614+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a00128d0 msgr2=0x7f87a0018510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:45:43.618 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:43.614+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a00128d0 0x7f87a0018510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:45:43.878 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:43.878+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:43.878 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:43.878+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:43.878 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:43.878+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:43.878 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:43.878+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:43.967 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~110s 2023-01-01T17:45:43.967 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~110s 2023-01-01T17:45:43.968 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~110s 2023-01-01T17:45:43.968 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~110s 2023-01-01T17:45:43.968 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~110s 2023-01-01T17:45:43.968 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~110s 2023-01-01T17:45:43.968 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~110s 2023-01-01T17:45:43.968 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~110s 2023-01-01T17:45:43.968 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~110s 2023-01-01T17:45:44.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:44.015+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a00128d0 msgr2=0x7f87a0018510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:45:44.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:44.015+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a00128d0 0x7f87a0018510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:45:44.035 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:44.035+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:44.036 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:44.035+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:44.036 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:44.035+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:44.036 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:44.035+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:44.093 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:44.093+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:44.094 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:44.093+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:44.094 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:44.093+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:44.094 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:44.093+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:44.248 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:44.248+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:44.248 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:44.248+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:44.248 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:44.248+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:44.249 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:44.248+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:44.560 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-01-01T17:45:44.557+0000 7fc7b8fdb700 -1 mon.a@0(probing) e1 get_health_metrics reporting 1491 slow ops, oldest is log(1 entries from seq 42 at 2023-01-01T17:40:56.238062+0000) 2023-01-01T17:45:44.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:44.558+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0012500 legacy=0x7f87a0003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-01-01T17:45:44.562 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:44.558+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0012500 legacy=0x7f87a0003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-01-01T17:45:44.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:44.558+0000 7f87bffff700 1 --1- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0012500 0x7f87a0003e40 :-1 s=OPENED pgs=914 cs=1 l=1).handle_message read tag failed 2023-01-01T17:45:44.563 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:44.558+0000 7f87bffff700 1 --1- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0012500 0x7f87a0003e40 :-1 s=OPENED pgs=914 cs=1 l=1).fault on lossy channel, failing 2023-01-01T17:45:44.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:44.816+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a00128d0 msgr2=0x7f87a0018510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:45:44.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:44.816+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a00128d0 0x7f87a0018510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:45:44.848 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:44.849+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:44.849 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:44.849+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:44.849 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:44.849+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:44.849 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:44.849+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:45.077 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:45.077+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:45.077 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:45.077+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:45.077 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:45.077+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:45.077 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:45.077+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:45.096 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:45.096+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:45.096 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:45.096+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:45.097 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:45.096+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:45.097 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:45.096+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:45.249 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:45.249+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:45.249 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:45.249+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:45.250 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:45.249+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:45.250 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:45.249+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:45.882 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:45.883+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:45.882 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:45.883+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:45.882 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:45.883+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:45.883 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:45.883+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:46.094 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:46.093+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:46.094 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:46.093+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:46.095 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:46.093+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:46.095 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:46.093+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:46.105 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:46.105+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:46.105 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:46.105+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:46.105 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:46.105+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:46.105 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:46.105+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:46.242 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:46.242+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:46.242 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:46.242+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:46.242 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:46.242+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:46.243 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:46.242+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:46.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:46.413+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a00128d0 msgr2=0x7f87a0018510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:45:46.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:46.413+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a00128d0 0x7f87a0018510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:45:46.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:46.413+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0012500 legacy=0x7f87a0003e40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-01-01T17:45:46.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:46.413+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 reap_dead start 2023-01-01T17:45:46.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:46.413+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004550 0x7f87a0015780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:45:46.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:46.413+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:45:46.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:46.413+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a0005fe0 con 0x7f87a000a7b0 2023-01-01T17:45:46.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:46.413+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.61:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a0004e80 2023-01-01T17:45:46.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:46.413+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00c08a0 con 0x7f87a0004550 2023-01-01T17:45:46.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:46.413+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a000a7b0 legacy=0x7f87a0014570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:45:46.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:46.413+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004550 msgr2=0x7f87a0015780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:45:46.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:46.413+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004550 0x7f87a0015780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:45:46.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:46.413+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:45:46.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:46.414+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-01-01T17:45:46.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:46.414+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:45:46.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:46.414+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:45:46.417 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:46.414+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:45:46.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:46.614+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a000a7b0 legacy=0x7f87a0014570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:45:46.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:46.614+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004550 msgr2=0x7f87a0015780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:45:46.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:46.614+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004550 0x7f87a0015780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:45:46.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:46.615+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:45:46.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:46.615+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:45:46.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:46.615+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:45:46.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:46.615+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:45:46.616 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:46.615+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:45:46.919 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:46.920+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:46.920 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:46.920+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:46.920 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:46.920+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:46.920 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:46.920+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:47.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:47.015+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a000a7b0 legacy=0x7f87a0014570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:45:47.015 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:47.015+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004550 msgr2=0x7f87a0015780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:45:47.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:47.015+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004550 0x7f87a0015780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:45:47.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:47.016+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:45:47.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:47.016+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:45:47.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:47.016+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:45:47.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:47.016+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:45:47.017 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:47.016+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:45:47.118 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:47.118+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:47.118 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:47.118+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:47.118 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:47.118+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:47.118 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:47.118+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:47.137 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:47.137+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:47.137 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:47.137+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:47.137 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:47.137+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:47.138 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:47.137+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:47.278 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:47.278+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:47.278 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:47.278+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:47.278 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:47.278+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:47.278 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:47.278+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:47.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:47.816+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004550 msgr2=0x7f87a0015780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3300/0 2023-01-01T17:45:47.816 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:47.816+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a000a7b0 legacy=0x7f87a0014570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.149:6789/0 2023-01-01T17:45:47.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:47.816+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004550 0x7f87a0015780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:45:47.817 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:47.817+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-01-01T17:45:47.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:47.817+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-01-01T17:45:47.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:47.817+0000 7f87c4be5700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-01-01T17:45:47.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:47.817+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-01-01T17:45:47.818 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:47.817+0000 7f87c4be5700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:45:47.956 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:47.955+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:47.956 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:47.955+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:47.956 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:47.955+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:47.957 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:47.955+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:48.096 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:48.097+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:48.097 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:48.097+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:48.097 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:48.097+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:48.097 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:48.097+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:48.153 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:48.153+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:48.154 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:48.153+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:48.154 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:48.153+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:48.154 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:48.153+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:48.249 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:48.249+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:48.249 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:48.249+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:48.249 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:48.249+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:48.249 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:48.249+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:48.957 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:48.957+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:48.958 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:48.957+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:48.958 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:48.957+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:48.958 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:48.957+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:49.064 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:49.064+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:49.064 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:49.064+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:49.064 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:49.064+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:49.064 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:49.064+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:49.136 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:49.136+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:49.136 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:49.136+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:49.136 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:49.136+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:49.136 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:49.136+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:49.283 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:49.283+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:49.283 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:49.283+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:49.283 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:49.283+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:49.283 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:49.283+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:49.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:49.413+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004550 msgr2=0x7f87a0015780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:45:49.414 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:49.413+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.149:3300/0 conn(0x7f87a0004550 0x7f87a0015780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:45:49.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:49.413+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 msgr2=0x7f87a0006220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:45:49.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:49.413+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> v2:172.21.15.61:3300/0 conn(0x7f87a0004e80 0x7f87a0006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-01-01T17:45:49.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:49.413+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.149:6789/0 conn(0x7f87a000a7b0 legacy=0x7f87a0014570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-01-01T17:45:49.415 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:49.413+0000 7f87bdffb700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012500 0x7f87a0018510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-01-01T17:45:49.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:49.414+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> v1:172.21.15.61:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a0015d40 con 0x7f87a0005570 2023-01-01T17:45:49.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:49.414+0000 7f87bdffb700 1 -- 172.21.15.61:0/268967012 --> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00a4510 con 0x7f87a0012500 2023-01-01T17:45:49.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:49.414+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012500 msgr2=0x7f87a0018510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:45:49.416 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:49.414+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012500 0x7f87a0018510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-01-01T17:45:49.558 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:49.558+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0005570 legacy=0x7f87a0003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-01-01T17:45:49.558 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:49.558+0000 7f87bffff700 1 -- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0005570 legacy=0x7f87a0003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-01-01T17:45:49.558 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:49.558+0000 7f87bffff700 1 --1- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0005570 0x7f87a0003e40 :-1 s=OPENED pgs=928 cs=1 l=1).handle_message read tag failed 2023-01-01T17:45:49.559 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:49.558+0000 7f87bffff700 1 --1- 172.21.15.61:0/268967012 >> v1:172.21.15.61:6789/0 conn(0x7f87a0005570 0x7f87a0003e40 :-1 s=OPENED pgs=928 cs=1 l=1).fault on lossy channel, failing 2023-01-01T17:45:49.559 INFO:tasks.ceph.mon.a.smithi061.stderr:2023-01-01T17:45:49.558+0000 7fc7b8fdb700 -1 mon.a@0(probing) e1 get_health_metrics reporting 1562 slow ops, oldest is log(1 entries from seq 42 at 2023-01-01T17:40:56.238062+0000) 2023-01-01T17:45:49.614 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:49.615+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012500 msgr2=0x7f87a0018510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:45:49.615 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:49.615+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012500 0x7f87a0018510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-01-01T17:45:49.774 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~116s 2023-01-01T17:45:49.774 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~116s 2023-01-01T17:45:49.774 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~116s 2023-01-01T17:45:49.775 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~116s 2023-01-01T17:45:49.775 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~116s 2023-01-01T17:45:49.775 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~116s 2023-01-01T17:45:49.775 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~116s 2023-01-01T17:45:49.775 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~116s 2023-01-01T17:45:49.775 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~116s 2023-01-01T17:45:49.913 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:49.914+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:49.914 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:49.914+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:49.914 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:49.914+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:49.914 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:49.914+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:50.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:50.016+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012500 msgr2=0x7f87a0018510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:45:50.016 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:50.016+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012500 0x7f87a0018510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-01-01T17:45:50.036 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:50.037+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:50.037 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:50.037+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:50.037 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:50.037+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:50.037 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:50.037+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:50.151 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:50.151+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:50.151 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:50.151+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:50.151 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:50.151+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:50.151 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:50.151+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:50.240 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:50.239+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:50.240 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:50.239+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:50.240 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:50.239+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:50.240 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:50.239+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:50.819 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:50.817+0000 7f87bf7fe700 1 -- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012500 msgr2=0x7f87a0018510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.149:3301/0 2023-01-01T17:45:50.820 INFO:teuthology.orchestra.run.smithi061.stderr:2023-01-01T17:45:50.817+0000 7f87bf7fe700 1 --2- 172.21.15.61:0/268967012 >> [v2:172.21.15.149:3301/0,v1:172.21.15.149:6790/0] conn(0x7f87a0012500 0x7f87a0018510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-01-01T17:45:50.940 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:50.941+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:50.941 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:50.941+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:50.941 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:50.941+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:50.941 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:50.941+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:50.999 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:51.000+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:51.000 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:51.000+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:51.000 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:51.000+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:51.000 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:51.000+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:51.186 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:51.186+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:51.186 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:51.186+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:51.186 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:51.186+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:51.186 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:51.186+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:51.226 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:51.226+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:51.226 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:51.226+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:51.226 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:51.226+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:51.226 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:51.226+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:51.600 DEBUG:teuthology.orchestra.run.smithi061:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-01-01T17:45:51.604 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-01-01T17:45:51.920 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:51.920+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.169219+0000 front 2023-01-01T17:40:54.169177+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:51.920 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:51.920+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.169307+0000 front 2023-01-01T17:40:54.169298+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:51.920 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:51.920+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.169361+0000 front 2023-01-01T17:40:54.169347+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:51.920 INFO:tasks.ceph.osd.1.smithi061.stderr:2023-01-01T17:45:51.920+0000 7f44ab732700 -1 osd.1 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.169325+0000 front 2023-01-01T17:40:54.169336+0000 (oldest deadline 2023-01-01T17:43:55.393631+0000) 2023-01-01T17:45:52.049 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:52.049+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.719630+0000 front 2023-01-01T17:40:54.719764+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:52.049 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:52.049+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.719789+0000 front 2023-01-01T17:40:54.719708+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:52.050 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:52.049+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.719672+0000 front 2023-01-01T17:40:54.719576+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:52.050 INFO:tasks.ceph.osd.0.smithi061.stderr:2023-01-01T17:45:52.049+0000 7f255e5ec700 -1 osd.0 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.719609+0000 front 2023-01-01T17:40:54.719739+0000 (oldest deadline 2023-01-01T17:43:30.738585+0000) 2023-01-01T17:45:52.216 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:52.217+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:54.200704+0000 front 2023-01-01T17:40:54.200566+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:52.216 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:52.217+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:54.200542+0000 front 2023-01-01T17:40:54.200625+0000 (oldest deadline 2023-01-01T17:43:55.425120+0000) 2023-01-01T17:45:52.217 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:52.217+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:54.200731+0000 front 2023-01-01T17:40:54.200742+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:52.217 INFO:tasks.ceph.osd.3.smithi061.stderr:2023-01-01T17:45:52.217+0000 7f9d64bb8700 -1 osd.3 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:54.200596+0000 front 2023-01-01T17:40:54.200670+0000 (oldest deadline 2023-01-01T17:43:27.020347+0000) 2023-01-01T17:45:52.241 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:52.241+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6824 osd.4 since back 2023-01-01T17:40:50.799052+0000 front 2023-01-01T17:40:50.798983+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:52.241 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:52.241+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6812 osd.5 since back 2023-01-01T17:40:50.798962+0000 front 2023-01-01T17:40:50.798972+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:52.241 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:52.241+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6804 osd.6 since back 2023-01-01T17:40:50.799024+0000 front 2023-01-01T17:40:50.799040+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:52.241 INFO:tasks.ceph.osd.2.smithi061.stderr:2023-01-01T17:45:52.241+0000 7f6daaa4c700 -1 osd.2 26 heartbeat_check: no reply from 172.21.15.149:6825 osd.7 since back 2023-01-01T17:40:50.799064+0000 front 2023-01-01T17:40:50.798997+0000 (oldest deadline 2023-01-01T17:43:57.423988+0000) 2023-01-01T17:45:52.299 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-01-01T17:45:52.300 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1902, in task ctx.managers[config['cluster']].stop_pg_num_changes() File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 2302, in stop_pg_num_changes osd_dump = self.get_osd_dump_json() File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 2536, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 1609, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 1600, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi061 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' 2023-01-01T17:45:52.310 INFO:teuthology.misc:Shutting down mds daemons... 2023-01-01T17:45:52.310 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-01-01T17:45:52.311 INFO:teuthology.orchestra.run:waiting for 300 2023-01-01T17:45:52.327 INFO:tasks.ceph.mds.a:Stopped 2023-01-01T17:45:52.327 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-01-01T17:45:52.327 INFO:teuthology.orchestra.run:waiting for 300 2023-01-01T17:45:52.378 INFO:tasks.ceph.mds.c:Stopped 2023-01-01T17:45:52.379 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-01-01T17:45:52.379 INFO:teuthology.orchestra.run:waiting for 300 2023-01-01T17:45:52.379 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-01-01T17:45:52.379 ERROR:teuthology.misc:Saw exception from ceph.mds.b Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1441, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1902, in task ctx.managers[config['cluster']].stop_pg_num_changes() File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 2302, in stop_pg_num_changes osd_dump = self.get_osd_dump_json() File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 2536, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 1609, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 1600, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi061 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/misc.py", line 1170, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi149 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b' 2023-01-01T17:45:52.390 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-01-01T17:45:52.390 INFO:teuthology.orchestra.run:waiting for 300 2023-01-01T17:45:52.393 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-01-01T17:45:52.393 ERROR:teuthology.misc:Saw exception from ceph.mds.d Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1441, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1902, in task ctx.managers[config['cluster']].stop_pg_num_changes() File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 2302, in stop_pg_num_changes osd_dump = self.get_osd_dump_json() File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 2536, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 1609, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 1600, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi061 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/misc.py", line 1170, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi149 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' 2023-01-01T17:45:52.403 INFO:teuthology.misc:Shutting down osd daemons... 2023-01-01T17:45:52.403 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-01-01T17:45:52.404 INFO:teuthology.orchestra.run:waiting for 300 2023-01-01T17:45:52.460 INFO:tasks.ceph.osd.0:Stopped 2023-01-01T17:45:52.461 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-01-01T17:45:52.461 INFO:teuthology.orchestra.run:waiting for 300 2023-01-01T17:45:52.551 INFO:tasks.ceph.osd.1:Stopped 2023-01-01T17:45:52.551 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-01-01T17:45:52.551 INFO:teuthology.orchestra.run:waiting for 300 2023-01-01T17:45:52.588 INFO:tasks.ceph.osd.2:Stopped 2023-01-01T17:45:52.588 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-01-01T17:45:52.588 INFO:teuthology.orchestra.run:waiting for 300 2023-01-01T17:45:52.668 INFO:tasks.ceph.osd.3:Stopped 2023-01-01T17:45:52.669 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-01-01T17:45:52.669 INFO:teuthology.orchestra.run:waiting for 300 2023-01-01T17:45:52.669 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-01-01T17:45:52.670 ERROR:teuthology.misc:Saw exception from ceph.osd.4 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1441, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1902, in task ctx.managers[config['cluster']].stop_pg_num_changes() File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 2302, in stop_pg_num_changes osd_dump = self.get_osd_dump_json() File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 2536, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 1609, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 1600, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi061 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1441, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/contextutil.py", line 47, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1443, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/misc.py", line 1177, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/misc.py", line 1170, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi149 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/misc.py", line 1170, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi149 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4' 2023-01-01T17:45:52.685 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-01-01T17:45:52.685 INFO:teuthology.orchestra.run:waiting for 300 2023-01-01T17:45:52.688 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-01-01T17:45:52.688 ERROR:teuthology.misc:Saw exception from ceph.osd.5 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1441, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1902, in task ctx.managers[config['cluster']].stop_pg_num_changes() File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 2302, in stop_pg_num_changes osd_dump = self.get_osd_dump_json() File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 2536, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 1609, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 1600, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi061 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1441, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/contextutil.py", line 47, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1443, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/misc.py", line 1177, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/misc.py", line 1170, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi149 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/misc.py", line 1170, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi149 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5' 2023-01-01T17:45:52.703 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-01-01T17:45:52.703 INFO:teuthology.orchestra.run:waiting for 300 2023-01-01T17:45:52.703 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-01-01T17:45:52.703 ERROR:teuthology.misc:Saw exception from ceph.osd.6 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1441, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1902, in task ctx.managers[config['cluster']].stop_pg_num_changes() File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 2302, in stop_pg_num_changes osd_dump = self.get_osd_dump_json() File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 2536, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 1609, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 1600, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi061 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1441, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/contextutil.py", line 47, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1443, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/misc.py", line 1177, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/misc.py", line 1170, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi149 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/misc.py", line 1170, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi149 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6' 2023-01-01T17:45:52.719 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-01-01T17:45:52.719 INFO:teuthology.orchestra.run:waiting for 300 2023-01-01T17:45:52.719 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-01-01T17:45:52.719 ERROR:teuthology.misc:Saw exception from ceph.osd.7 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1441, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1902, in task ctx.managers[config['cluster']].stop_pg_num_changes() File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 2302, in stop_pg_num_changes osd_dump = self.get_osd_dump_json() File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 2536, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 1609, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 1600, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi061 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1441, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/contextutil.py", line 47, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1443, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/misc.py", line 1177, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/misc.py", line 1170, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi149 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/misc.py", line 1170, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi149 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' 2023-01-01T17:45:52.734 INFO:teuthology.misc:Shutting down mgr daemons... 2023-01-01T17:45:52.735 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-01-01T17:45:52.735 INFO:teuthology.orchestra.run:waiting for 300 2023-01-01T17:45:52.764 INFO:tasks.ceph.mgr.y:Stopped 2023-01-01T17:45:52.764 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-01-01T17:45:52.764 INFO:teuthology.orchestra.run:waiting for 300 2023-01-01T17:45:52.764 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-01-01T17:45:52.765 ERROR:teuthology.misc:Saw exception from ceph.mgr.x Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1441, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1902, in task ctx.managers[config['cluster']].stop_pg_num_changes() File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 2302, in stop_pg_num_changes osd_dump = self.get_osd_dump_json() File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 2536, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 1609, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 1600, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi061 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1441, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/contextutil.py", line 47, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1443, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/misc.py", line 1177, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/misc.py", line 1170, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi149 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1441, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/contextutil.py", line 47, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1443, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/misc.py", line 1177, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/misc.py", line 1170, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi149 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/misc.py", line 1170, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi149 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' 2023-01-01T17:45:52.787 INFO:teuthology.misc:Shutting down mon daemons... 2023-01-01T17:45:52.788 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-01-01T17:45:52.788 INFO:teuthology.orchestra.run:waiting for 300 2023-01-01T17:45:52.818 INFO:tasks.ceph.mon.a:Stopped 2023-01-01T17:45:52.819 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-01-01T17:45:52.819 INFO:teuthology.orchestra.run:waiting for 300 2023-01-01T17:45:52.819 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-01-01T17:45:52.819 ERROR:teuthology.misc:Saw exception from ceph.mon.b Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1441, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1902, in task ctx.managers[config['cluster']].stop_pg_num_changes() File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 2302, in stop_pg_num_changes osd_dump = self.get_osd_dump_json() File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 2536, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 1609, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 1600, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi061 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1441, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/contextutil.py", line 47, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1443, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/misc.py", line 1177, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/misc.py", line 1170, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi149 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1441, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/contextutil.py", line 47, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1443, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/misc.py", line 1177, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/misc.py", line 1170, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi149 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1441, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/contextutil.py", line 47, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1443, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/misc.py", line 1177, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/misc.py", line 1170, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi149 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/misc.py", line 1170, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi149 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b' 2023-01-01T17:45:52.844 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-01-01T17:45:52.844 INFO:teuthology.orchestra.run:waiting for 300 2023-01-01T17:45:52.848 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-01-01T17:45:52.848 ERROR:teuthology.misc:Saw exception from ceph.mon.c Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1441, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1902, in task ctx.managers[config['cluster']].stop_pg_num_changes() File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 2302, in stop_pg_num_changes osd_dump = self.get_osd_dump_json() File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 2536, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 1609, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 1600, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi061 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1441, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/contextutil.py", line 47, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1443, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/misc.py", line 1177, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/misc.py", line 1170, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi149 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1441, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/contextutil.py", line 47, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1443, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/misc.py", line 1177, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/misc.py", line 1170, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi149 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1441, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/contextutil.py", line 47, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1443, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/misc.py", line 1177, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/misc.py", line 1170, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi149 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/misc.py", line 1170, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi149 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c' 2023-01-01T17:45:52.873 INFO:tasks.ceph:Checking cluster log for badness... 2023-01-01T17:45:52.873 DEBUG:teuthology.orchestra.run.smithi061:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-01-01T17:45:52.913 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi061.front.sepia.ceph.com 2023-01-01T17:45:52.913 DEBUG:teuthology.orchestra.run.smithi061:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-01-01T17:45:53.141 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi061.front.sepia.ceph.com 2023-01-01T17:45:53.142 DEBUG:teuthology.orchestra.run.smithi061:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-01-01T17:45:53.238 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi061.front.sepia.ceph.com 2023-01-01T17:45:53.238 DEBUG:teuthology.orchestra.run.smithi061:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-01-01T17:45:53.316 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi061.front.sepia.ceph.com 2023-01-01T17:45:53.316 DEBUG:teuthology.orchestra.run.smithi061:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-01-01T17:45:53.395 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi149.front.sepia.ceph.com 2023-01-01T17:45:53.395 DEBUG:teuthology.orchestra.run.smithi149:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-01-01T17:45:53.476 INFO:teuthology.orchestra.run.smithi149.stderr:umount: /var/lib/ceph/osd/ceph-4: not mounted. 2023-01-01T17:45:53.477 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-01-01T17:45:53.478 DEBUG:teuthology.orchestra.run.smithi149:> sudo PATH=/usr/sbin:$PATH lsof ; ps auxf 2023-01-01T17:45:53.617 INFO:teuthology.orchestra.run.smithi149.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2023-01-01T17:45:53.618 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.618 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.618 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root txt REG 8,1 1601312 8116 /usr/lib/systemd/systemd 2023-01-01T17:45:53.618 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-01-01T17:45:53.618 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-01-01T17:45:53.618 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 735192 5135 /usr/lib64/libsepol.so.1 2023-01-01T17:45:53.619 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-01-01T17:45:53.619 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:53.619 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 66912 5393 /usr/lib64/libjson-c.so.4.0.0 2023-01-01T17:45:53.619 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 371240 32501 /usr/lib64/libdevmapper.so.1.02 2023-01-01T17:45:53.619 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 26192 5300 /usr/lib64/libattr.so.1.1.2448 2023-01-01T17:45:53.619 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-01-01T17:45:53.619 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-01-01T17:45:53.619 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:53.620 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-01-01T17:45:53.620 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:53.620 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:53.620 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:53.620 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:53.620 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:53.620 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:53.620 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-01-01T17:45:53.621 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:53.621 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 526360 7346 /usr/lib64/libcryptsetup.so.12.6.0 2023-01-01T17:45:53.621 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 54816 5302 /usr/lib64/libacl.so.1.1.2253 2023-01-01T17:45:53.621 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:53.621 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.621 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:53.621 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:53.622 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 100200 7343 /usr/lib64/libkmod.so.2.3.3 2023-01-01T17:45:53.622 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-01-01T17:45:53.622 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-01-01T17:45:53.622 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:53.622 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:53.622 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 128784 5906 /usr/lib64/libseccomp.so.2.5.2 2023-01-01T17:45:53.622 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:53.622 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 2740672 8111 /usr/lib/systemd/libsystemd-shared-239.so 2023-01-01T17:45:53.623 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.623 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 576141 1062 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-01-01T17:45:53.623 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root mem REG 8,1 19983 1966 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-01-01T17:45:53.623 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 0u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.623 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 1u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.623 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 2u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.623 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 3w CHR 1,11 0t0 2057 /dev/kmsg 2023-01-01T17:45:53.623 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 4u a_inode 0,14 0 11447 [eventpoll] 2023-01-01T17:45:53.623 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 5u a_inode 0,14 0 11447 [signalfd] 2023-01-01T17:45:53.624 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 6r DIR 0,26 0 1 /sys/fs/cgroup/systemd 2023-01-01T17:45:53.624 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 7u a_inode 0,14 0 11447 [timerfd] 2023-01-01T17:45:53.624 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 8u netlink 0t0 13785 KOBJECT_UEVENT 2023-01-01T17:45:53.624 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 9u a_inode 0,14 0 11447 [eventpoll] 2023-01-01T17:45:53.624 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 10r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.624 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 11u netlink 0t0 1474 AUDIT 2023-01-01T17:45:53.624 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 12r REG 0,5 0 14368 /proc/1/mountinfo 2023-01-01T17:45:53.625 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 13r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.625 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 14r REG 0,5 0 4026532074 /proc/swaps 2023-01-01T17:45:53.625 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 15u unix 0xffff8dad40243f00 0t0 13786 /run/systemd/private type=STREAM 2023-01-01T17:45:53.625 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 16u a_inode 0,14 0 11447 [timerfd] 2023-01-01T17:45:53.625 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 17r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.625 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 23u unix 0xffff8dad4034f980 0t0 18091 /run/udev/control type=SEQPACKET 2023-01-01T17:45:53.626 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 24u unix 0xffff8dad427a5e80 0t0 14370 /run/systemd/notify type=DGRAM 2023-01-01T17:45:53.626 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 25u unix 0xffff8dad427a4380 0t0 14372 /run/systemd/cgroups-agent type=DGRAM 2023-01-01T17:45:53.626 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 26u unix 0xffff8dad427a1680 0t0 14374 type=DGRAM 2023-01-01T17:45:53.626 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 27r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.626 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 28u unix 0xffff8dad427a1b00 0t0 14375 type=DGRAM 2023-01-01T17:45:53.627 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 29u FIFO 0,24 0t0 18104 /run/initctl 2023-01-01T17:45:53.627 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 30u unix 0xffff8dad427a6c00 0t0 14383 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.627 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 31u unix 0xffff8dad4034d580 0t0 18109 /run/rpcbind.sock type=STREAM 2023-01-01T17:45:53.627 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 32u unix 0xffff8dad427a1200 0t0 14387 /run/systemd/journal/socket type=DGRAM 2023-01-01T17:45:53.627 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 33u IPv4 18111 0t0 TCP *:sunrpc (LISTEN) 2023-01-01T17:45:53.627 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 34u unix 0xffff8dad427a7080 0t0 14394 /run/systemd/journal/dev-log type=DGRAM 2023-01-01T17:45:53.627 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 35u IPv4 18112 0t0 UDP *:sunrpc 2023-01-01T17:45:53.628 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 36u IPv6 18113 0t0 TCP *:sunrpc (LISTEN) 2023-01-01T17:45:53.628 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 37u IPv6 18114 0t0 UDP *:sunrpc 2023-01-01T17:45:53.628 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 38r CHR 10,235 0t0 2154 /dev/autofs 2023-01-01T17:45:53.628 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 39r FIFO 0,13 0t0 18119 pipe 2023-01-01T17:45:53.628 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 40u unix 0xffff8dad4034b600 0t0 18124 /run/lvm/lvmpolld.socket type=STREAM 2023-01-01T17:45:53.628 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 41u netlink 0t0 18640 KOBJECT_UEVENT 2023-01-01T17:45:53.628 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 42u unix 0xffff8dad402bb600 0t0 20104 /run/systemd/coredump type=SEQPACKET 2023-01-01T17:45:53.629 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 43u FIFO 0,24 0t0 2796 /run/dmeventd-server 2023-01-01T17:45:53.629 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 44u FIFO 0,24 0t0 2797 /run/dmeventd-client 2023-01-01T17:45:53.629 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 45u unix 0xffff8dad402bf500 0t0 20113 type=DGRAM 2023-01-01T17:45:53.629 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 46u unix 0xffff8dad403bd100 0t0 13894 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.629 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 47u netlink 0t0 1594 SELINUX 2023-01-01T17:45:53.629 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 48u unix 0xffff8dad09280480 0t0 17035 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.629 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 49u a_inode 0,14 0 11447 [timerfd] 2023-01-01T17:45:53.629 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 51u unix 0xffff8dad40349f80 0t0 22568 /run/dbus/system_bus_socket type=STREAM 2023-01-01T17:45:53.630 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 52u unix 0xffff8dad40348000 0t0 22572 /var/run/cups/cups.sock type=STREAM 2023-01-01T17:45:53.630 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 53u unix 0xffff8dad4034e780 0t0 22578 /var/run/.heim_org.h5l.kcm-socket type=STREAM 2023-01-01T17:45:53.630 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 54u unix 0xffff8dad4034bf00 0t0 22600 /run/avahi-daemon/socket type=STREAM 2023-01-01T17:45:53.630 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 55u unix 0xffff8dad4034da00 0t0 22615 type=STREAM 2023-01-01T17:45:53.630 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 56u unix 0xffff8dad40245100 0t0 20818 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.630 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 57u unix 0xffff8dad403bb180 0t0 24734 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.631 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 58u unix 0xffff8dad402bb180 0t0 22630 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.631 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 59u unix 0xffff8dad403bad00 0t0 22632 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.631 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 60u unix 0xffff8dad40cef980 0t0 22634 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.631 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 61u unix 0xffff8dad41993f00 0t0 22637 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.631 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 62u unix 0xffff8dad40240900 0t0 30445 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.631 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 63u unix 0xffff8dad40349200 0t0 20675 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.631 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 64u unix 0xffff8dad402b9b00 0t0 25663 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.631 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 65u unix 0xffff8dad09282400 0t0 20735 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.632 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 66u unix 0xffff8dad09283a80 0t0 20737 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.632 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 67u unix 0xffff8dad09284380 0t0 25646 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.632 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 68u unix 0xffff8dad403bba80 0t0 24736 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.632 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 70u unix 0xffff8dad41991680 0t0 44770 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.632 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 71u unix 0xffff8dad4034e300 0t0 24403 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.632 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 74u unix 0xffff8dad402b8900 0t0 30447 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.632 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 1 root 76u unix 0xffff8dad09287500 0t0 31936 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.632 INFO:teuthology.orchestra.run.smithi149.stdout:kthreadd 2 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.633 INFO:teuthology.orchestra.run.smithi149.stdout:kthreadd 2 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.633 INFO:teuthology.orchestra.run.smithi149.stdout:kthreadd 2 root txt unknown /proc/2/exe 2023-01-01T17:45:53.633 INFO:teuthology.orchestra.run.smithi149.stdout:rcu_gp 3 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.633 INFO:teuthology.orchestra.run.smithi149.stdout:rcu_gp 3 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.634 INFO:teuthology.orchestra.run.smithi149.stdout:rcu_gp 3 root txt unknown /proc/3/exe 2023-01-01T17:45:53.634 INFO:teuthology.orchestra.run.smithi149.stdout:rcu_par_g 4 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.634 INFO:teuthology.orchestra.run.smithi149.stdout:rcu_par_g 4 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.635 INFO:teuthology.orchestra.run.smithi149.stdout:rcu_par_g 4 root txt unknown /proc/4/exe 2023-01-01T17:45:53.635 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/0 5 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.635 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/0 5 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.635 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/0 5 root txt unknown /proc/5/exe 2023-01-01T17:45:53.635 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/0 6 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.635 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/0 6 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.635 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/0 6 root txt unknown /proc/6/exe 2023-01-01T17:45:53.635 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/0 7 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.635 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/0 7 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.636 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/0 7 root txt unknown /proc/7/exe 2023-01-01T17:45:53.636 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/u 8 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.636 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/u 8 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.636 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/u 8 root txt unknown /proc/8/exe 2023-01-01T17:45:53.636 INFO:teuthology.orchestra.run.smithi149.stdout:mm_percpu 9 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.637 INFO:teuthology.orchestra.run.smithi149.stdout:mm_percpu 9 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.637 INFO:teuthology.orchestra.run.smithi149.stdout:mm_percpu 9 root txt unknown /proc/9/exe 2023-01-01T17:45:53.637 INFO:teuthology.orchestra.run.smithi149.stdout:rcu_tasks 10 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.637 INFO:teuthology.orchestra.run.smithi149.stdout:rcu_tasks 10 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.637 INFO:teuthology.orchestra.run.smithi149.stdout:rcu_tasks 10 root txt unknown /proc/10/exe 2023-01-01T17:45:53.638 INFO:teuthology.orchestra.run.smithi149.stdout:rcu_tasks 11 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.638 INFO:teuthology.orchestra.run.smithi149.stdout:rcu_tasks 11 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.638 INFO:teuthology.orchestra.run.smithi149.stdout:rcu_tasks 11 root txt unknown /proc/11/exe 2023-01-01T17:45:53.638 INFO:teuthology.orchestra.run.smithi149.stdout:ksoftirqd 12 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.638 INFO:teuthology.orchestra.run.smithi149.stdout:ksoftirqd 12 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.638 INFO:teuthology.orchestra.run.smithi149.stdout:ksoftirqd 12 root txt unknown /proc/12/exe 2023-01-01T17:45:53.638 INFO:teuthology.orchestra.run.smithi149.stdout:rcu_sched 13 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.638 INFO:teuthology.orchestra.run.smithi149.stdout:rcu_sched 13 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.639 INFO:teuthology.orchestra.run.smithi149.stdout:rcu_sched 13 root txt unknown /proc/13/exe 2023-01-01T17:45:53.639 INFO:teuthology.orchestra.run.smithi149.stdout:migration 14 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.639 INFO:teuthology.orchestra.run.smithi149.stdout:migration 14 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.639 INFO:teuthology.orchestra.run.smithi149.stdout:migration 14 root txt unknown /proc/14/exe 2023-01-01T17:45:53.639 INFO:teuthology.orchestra.run.smithi149.stdout:watchdog/ 15 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.639 INFO:teuthology.orchestra.run.smithi149.stdout:watchdog/ 15 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.639 INFO:teuthology.orchestra.run.smithi149.stdout:watchdog/ 15 root txt unknown /proc/15/exe 2023-01-01T17:45:53.639 INFO:teuthology.orchestra.run.smithi149.stdout:cpuhp/0 16 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.640 INFO:teuthology.orchestra.run.smithi149.stdout:cpuhp/0 16 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.640 INFO:teuthology.orchestra.run.smithi149.stdout:cpuhp/0 16 root txt unknown /proc/16/exe 2023-01-01T17:45:53.640 INFO:teuthology.orchestra.run.smithi149.stdout:cpuhp/1 17 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.640 INFO:teuthology.orchestra.run.smithi149.stdout:cpuhp/1 17 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.640 INFO:teuthology.orchestra.run.smithi149.stdout:cpuhp/1 17 root txt unknown /proc/17/exe 2023-01-01T17:45:53.640 INFO:teuthology.orchestra.run.smithi149.stdout:watchdog/ 18 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.640 INFO:teuthology.orchestra.run.smithi149.stdout:watchdog/ 18 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.641 INFO:teuthology.orchestra.run.smithi149.stdout:watchdog/ 18 root txt unknown /proc/18/exe 2023-01-01T17:45:53.641 INFO:teuthology.orchestra.run.smithi149.stdout:migration 19 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.641 INFO:teuthology.orchestra.run.smithi149.stdout:migration 19 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.641 INFO:teuthology.orchestra.run.smithi149.stdout:migration 19 root txt unknown /proc/19/exe 2023-01-01T17:45:53.641 INFO:teuthology.orchestra.run.smithi149.stdout:ksoftirqd 20 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.641 INFO:teuthology.orchestra.run.smithi149.stdout:ksoftirqd 20 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.641 INFO:teuthology.orchestra.run.smithi149.stdout:ksoftirqd 20 root txt unknown /proc/20/exe 2023-01-01T17:45:53.642 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/1 21 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.642 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/1 21 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.642 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/1 21 root txt unknown /proc/21/exe 2023-01-01T17:45:53.642 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/1 22 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.642 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/1 22 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.642 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/1 22 root txt unknown /proc/22/exe 2023-01-01T17:45:53.642 INFO:teuthology.orchestra.run.smithi149.stdout:cpuhp/2 23 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.642 INFO:teuthology.orchestra.run.smithi149.stdout:cpuhp/2 23 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.643 INFO:teuthology.orchestra.run.smithi149.stdout:cpuhp/2 23 root txt unknown /proc/23/exe 2023-01-01T17:45:53.643 INFO:teuthology.orchestra.run.smithi149.stdout:watchdog/ 24 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.643 INFO:teuthology.orchestra.run.smithi149.stdout:watchdog/ 24 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.643 INFO:teuthology.orchestra.run.smithi149.stdout:watchdog/ 24 root txt unknown /proc/24/exe 2023-01-01T17:45:53.643 INFO:teuthology.orchestra.run.smithi149.stdout:migration 25 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.643 INFO:teuthology.orchestra.run.smithi149.stdout:migration 25 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.643 INFO:teuthology.orchestra.run.smithi149.stdout:migration 25 root txt unknown /proc/25/exe 2023-01-01T17:45:53.643 INFO:teuthology.orchestra.run.smithi149.stdout:ksoftirqd 26 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.644 INFO:teuthology.orchestra.run.smithi149.stdout:ksoftirqd 26 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.644 INFO:teuthology.orchestra.run.smithi149.stdout:ksoftirqd 26 root txt unknown /proc/26/exe 2023-01-01T17:45:53.644 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/2 27 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.644 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/2 27 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.644 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/2 27 root txt unknown /proc/27/exe 2023-01-01T17:45:53.644 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/2 28 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.644 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/2 28 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.645 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/2 28 root txt unknown /proc/28/exe 2023-01-01T17:45:53.645 INFO:teuthology.orchestra.run.smithi149.stdout:cpuhp/3 29 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.645 INFO:teuthology.orchestra.run.smithi149.stdout:cpuhp/3 29 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.645 INFO:teuthology.orchestra.run.smithi149.stdout:cpuhp/3 29 root txt unknown /proc/29/exe 2023-01-01T17:45:53.645 INFO:teuthology.orchestra.run.smithi149.stdout:watchdog/ 30 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.645 INFO:teuthology.orchestra.run.smithi149.stdout:watchdog/ 30 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.645 INFO:teuthology.orchestra.run.smithi149.stdout:watchdog/ 30 root txt unknown /proc/30/exe 2023-01-01T17:45:53.646 INFO:teuthology.orchestra.run.smithi149.stdout:migration 31 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.646 INFO:teuthology.orchestra.run.smithi149.stdout:migration 31 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.646 INFO:teuthology.orchestra.run.smithi149.stdout:migration 31 root txt unknown /proc/31/exe 2023-01-01T17:45:53.646 INFO:teuthology.orchestra.run.smithi149.stdout:ksoftirqd 32 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.646 INFO:teuthology.orchestra.run.smithi149.stdout:ksoftirqd 32 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.646 INFO:teuthology.orchestra.run.smithi149.stdout:ksoftirqd 32 root txt unknown /proc/32/exe 2023-01-01T17:45:53.646 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/3 33 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.647 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/3 33 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.647 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/3 33 root txt unknown /proc/33/exe 2023-01-01T17:45:53.647 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/3 34 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.647 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/3 34 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.648 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/3 34 root txt unknown /proc/34/exe 2023-01-01T17:45:53.648 INFO:teuthology.orchestra.run.smithi149.stdout:cpuhp/4 35 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.648 INFO:teuthology.orchestra.run.smithi149.stdout:cpuhp/4 35 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.648 INFO:teuthology.orchestra.run.smithi149.stdout:cpuhp/4 35 root txt unknown /proc/35/exe 2023-01-01T17:45:53.648 INFO:teuthology.orchestra.run.smithi149.stdout:watchdog/ 36 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.648 INFO:teuthology.orchestra.run.smithi149.stdout:watchdog/ 36 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.648 INFO:teuthology.orchestra.run.smithi149.stdout:watchdog/ 36 root txt unknown /proc/36/exe 2023-01-01T17:45:53.648 INFO:teuthology.orchestra.run.smithi149.stdout:migration 37 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.649 INFO:teuthology.orchestra.run.smithi149.stdout:migration 37 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.649 INFO:teuthology.orchestra.run.smithi149.stdout:migration 37 root txt unknown /proc/37/exe 2023-01-01T17:45:53.649 INFO:teuthology.orchestra.run.smithi149.stdout:ksoftirqd 38 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.649 INFO:teuthology.orchestra.run.smithi149.stdout:ksoftirqd 38 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.649 INFO:teuthology.orchestra.run.smithi149.stdout:ksoftirqd 38 root txt unknown /proc/38/exe 2023-01-01T17:45:53.649 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/4 39 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.649 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/4 39 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.650 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/4 39 root txt unknown /proc/39/exe 2023-01-01T17:45:53.650 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/4 40 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.650 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/4 40 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.650 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/4 40 root txt unknown /proc/40/exe 2023-01-01T17:45:53.650 INFO:teuthology.orchestra.run.smithi149.stdout:cpuhp/5 41 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.650 INFO:teuthology.orchestra.run.smithi149.stdout:cpuhp/5 41 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.650 INFO:teuthology.orchestra.run.smithi149.stdout:cpuhp/5 41 root txt unknown /proc/41/exe 2023-01-01T17:45:53.650 INFO:teuthology.orchestra.run.smithi149.stdout:watchdog/ 42 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.651 INFO:teuthology.orchestra.run.smithi149.stdout:watchdog/ 42 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.651 INFO:teuthology.orchestra.run.smithi149.stdout:watchdog/ 42 root txt unknown /proc/42/exe 2023-01-01T17:45:53.651 INFO:teuthology.orchestra.run.smithi149.stdout:migration 43 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.651 INFO:teuthology.orchestra.run.smithi149.stdout:migration 43 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.651 INFO:teuthology.orchestra.run.smithi149.stdout:migration 43 root txt unknown /proc/43/exe 2023-01-01T17:45:53.651 INFO:teuthology.orchestra.run.smithi149.stdout:ksoftirqd 44 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.651 INFO:teuthology.orchestra.run.smithi149.stdout:ksoftirqd 44 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.652 INFO:teuthology.orchestra.run.smithi149.stdout:ksoftirqd 44 root txt unknown /proc/44/exe 2023-01-01T17:45:53.652 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/5 45 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.652 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/5 45 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.652 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/5 45 root txt unknown /proc/45/exe 2023-01-01T17:45:53.652 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/5 46 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.652 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/5 46 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.652 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/5 46 root txt unknown /proc/46/exe 2023-01-01T17:45:53.652 INFO:teuthology.orchestra.run.smithi149.stdout:cpuhp/6 47 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.653 INFO:teuthology.orchestra.run.smithi149.stdout:cpuhp/6 47 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.653 INFO:teuthology.orchestra.run.smithi149.stdout:cpuhp/6 47 root txt unknown /proc/47/exe 2023-01-01T17:45:53.653 INFO:teuthology.orchestra.run.smithi149.stdout:watchdog/ 48 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.653 INFO:teuthology.orchestra.run.smithi149.stdout:watchdog/ 48 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.653 INFO:teuthology.orchestra.run.smithi149.stdout:watchdog/ 48 root txt unknown /proc/48/exe 2023-01-01T17:45:53.653 INFO:teuthology.orchestra.run.smithi149.stdout:migration 49 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.653 INFO:teuthology.orchestra.run.smithi149.stdout:migration 49 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.654 INFO:teuthology.orchestra.run.smithi149.stdout:migration 49 root txt unknown /proc/49/exe 2023-01-01T17:45:53.654 INFO:teuthology.orchestra.run.smithi149.stdout:ksoftirqd 50 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.654 INFO:teuthology.orchestra.run.smithi149.stdout:ksoftirqd 50 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.654 INFO:teuthology.orchestra.run.smithi149.stdout:ksoftirqd 50 root txt unknown /proc/50/exe 2023-01-01T17:45:53.654 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/6 51 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.654 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/6 51 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.654 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/6 51 root txt unknown /proc/51/exe 2023-01-01T17:45:53.655 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/6 52 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.655 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/6 52 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.655 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/6 52 root txt unknown /proc/52/exe 2023-01-01T17:45:53.655 INFO:teuthology.orchestra.run.smithi149.stdout:cpuhp/7 53 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.655 INFO:teuthology.orchestra.run.smithi149.stdout:cpuhp/7 53 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.655 INFO:teuthology.orchestra.run.smithi149.stdout:cpuhp/7 53 root txt unknown /proc/53/exe 2023-01-01T17:45:53.656 INFO:teuthology.orchestra.run.smithi149.stdout:watchdog/ 54 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.656 INFO:teuthology.orchestra.run.smithi149.stdout:watchdog/ 54 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.656 INFO:teuthology.orchestra.run.smithi149.stdout:watchdog/ 54 root txt unknown /proc/54/exe 2023-01-01T17:45:53.656 INFO:teuthology.orchestra.run.smithi149.stdout:migration 55 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.656 INFO:teuthology.orchestra.run.smithi149.stdout:migration 55 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.656 INFO:teuthology.orchestra.run.smithi149.stdout:migration 55 root txt unknown /proc/55/exe 2023-01-01T17:45:53.656 INFO:teuthology.orchestra.run.smithi149.stdout:ksoftirqd 56 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.656 INFO:teuthology.orchestra.run.smithi149.stdout:ksoftirqd 56 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.657 INFO:teuthology.orchestra.run.smithi149.stdout:ksoftirqd 56 root txt unknown /proc/56/exe 2023-01-01T17:45:53.657 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/7 57 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.657 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/7 57 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.657 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/7 57 root txt unknown /proc/57/exe 2023-01-01T17:45:53.657 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/7 58 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.657 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/7 58 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.657 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/7 58 root txt unknown /proc/58/exe 2023-01-01T17:45:53.658 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/u 60 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.658 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/u 60 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.658 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/u 60 root txt unknown /proc/60/exe 2023-01-01T17:45:53.658 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/u 61 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.658 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/u 61 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.658 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/u 61 root txt unknown /proc/61/exe 2023-01-01T17:45:53.658 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/u 62 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.658 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/u 62 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.659 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/u 62 root txt unknown /proc/62/exe 2023-01-01T17:45:53.659 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/u 63 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.659 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/u 63 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.659 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/u 63 root txt unknown /proc/63/exe 2023-01-01T17:45:53.659 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/u 64 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.659 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/u 64 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.659 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/u 64 root txt unknown /proc/64/exe 2023-01-01T17:45:53.660 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/u 65 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.660 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/u 65 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.660 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/u 65 root txt unknown /proc/65/exe 2023-01-01T17:45:53.660 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/u 66 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.660 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/u 66 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.660 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/u 66 root txt unknown /proc/66/exe 2023-01-01T17:45:53.660 INFO:teuthology.orchestra.run.smithi149.stdout:kdevtmpfs 67 root cwd DIR 0,6 3380 3 / 2023-01-01T17:45:53.661 INFO:teuthology.orchestra.run.smithi149.stdout:kdevtmpfs 67 root rtd DIR 0,6 3380 3 / 2023-01-01T17:45:53.661 INFO:teuthology.orchestra.run.smithi149.stdout:kdevtmpfs 67 root txt unknown /proc/67/exe 2023-01-01T17:45:53.661 INFO:teuthology.orchestra.run.smithi149.stdout:netns 68 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.661 INFO:teuthology.orchestra.run.smithi149.stdout:netns 68 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.661 INFO:teuthology.orchestra.run.smithi149.stdout:netns 68 root txt unknown /proc/68/exe 2023-01-01T17:45:53.661 INFO:teuthology.orchestra.run.smithi149.stdout:kauditd 69 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.662 INFO:teuthology.orchestra.run.smithi149.stdout:kauditd 69 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.662 INFO:teuthology.orchestra.run.smithi149.stdout:kauditd 69 root txt unknown /proc/69/exe 2023-01-01T17:45:53.662 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/4 70 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.662 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/4 70 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.662 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/4 70 root txt unknown /proc/70/exe 2023-01-01T17:45:53.662 INFO:teuthology.orchestra.run.smithi149.stdout:khungtask 71 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.662 INFO:teuthology.orchestra.run.smithi149.stdout:khungtask 71 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.662 INFO:teuthology.orchestra.run.smithi149.stdout:khungtask 71 root txt unknown /proc/71/exe 2023-01-01T17:45:53.663 INFO:teuthology.orchestra.run.smithi149.stdout:oom_reape 72 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.663 INFO:teuthology.orchestra.run.smithi149.stdout:oom_reape 72 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.663 INFO:teuthology.orchestra.run.smithi149.stdout:oom_reape 72 root txt unknown /proc/72/exe 2023-01-01T17:45:53.663 INFO:teuthology.orchestra.run.smithi149.stdout:writeback 73 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.663 INFO:teuthology.orchestra.run.smithi149.stdout:writeback 73 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.663 INFO:teuthology.orchestra.run.smithi149.stdout:writeback 73 root txt unknown /proc/73/exe 2023-01-01T17:45:53.664 INFO:teuthology.orchestra.run.smithi149.stdout:kcompactd 74 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.664 INFO:teuthology.orchestra.run.smithi149.stdout:kcompactd 74 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.664 INFO:teuthology.orchestra.run.smithi149.stdout:kcompactd 74 root txt unknown /proc/74/exe 2023-01-01T17:45:53.664 INFO:teuthology.orchestra.run.smithi149.stdout:ksmd 75 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.664 INFO:teuthology.orchestra.run.smithi149.stdout:ksmd 75 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.664 INFO:teuthology.orchestra.run.smithi149.stdout:ksmd 75 root txt unknown /proc/75/exe 2023-01-01T17:45:53.664 INFO:teuthology.orchestra.run.smithi149.stdout:khugepage 76 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.664 INFO:teuthology.orchestra.run.smithi149.stdout:khugepage 76 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.665 INFO:teuthology.orchestra.run.smithi149.stdout:khugepage 76 root txt unknown /proc/76/exe 2023-01-01T17:45:53.665 INFO:teuthology.orchestra.run.smithi149.stdout:crypto 77 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.665 INFO:teuthology.orchestra.run.smithi149.stdout:crypto 77 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.665 INFO:teuthology.orchestra.run.smithi149.stdout:crypto 77 root txt unknown /proc/77/exe 2023-01-01T17:45:53.665 INFO:teuthology.orchestra.run.smithi149.stdout:kintegrit 78 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.665 INFO:teuthology.orchestra.run.smithi149.stdout:kintegrit 78 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.665 INFO:teuthology.orchestra.run.smithi149.stdout:kintegrit 78 root txt unknown /proc/78/exe 2023-01-01T17:45:53.666 INFO:teuthology.orchestra.run.smithi149.stdout:kblockd 79 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.666 INFO:teuthology.orchestra.run.smithi149.stdout:kblockd 79 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.666 INFO:teuthology.orchestra.run.smithi149.stdout:kblockd 79 root txt unknown /proc/79/exe 2023-01-01T17:45:53.666 INFO:teuthology.orchestra.run.smithi149.stdout:blkcg_pun 80 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.666 INFO:teuthology.orchestra.run.smithi149.stdout:blkcg_pun 80 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.666 INFO:teuthology.orchestra.run.smithi149.stdout:blkcg_pun 80 root txt unknown /proc/80/exe 2023-01-01T17:45:53.667 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/2 81 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.667 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/2 81 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.667 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/2 81 root txt unknown /proc/81/exe 2023-01-01T17:45:53.667 INFO:teuthology.orchestra.run.smithi149.stdout:tpm_dev_w 82 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.667 INFO:teuthology.orchestra.run.smithi149.stdout:tpm_dev_w 82 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.667 INFO:teuthology.orchestra.run.smithi149.stdout:tpm_dev_w 82 root txt unknown /proc/82/exe 2023-01-01T17:45:53.668 INFO:teuthology.orchestra.run.smithi149.stdout:md 83 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.668 INFO:teuthology.orchestra.run.smithi149.stdout:md 83 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.668 INFO:teuthology.orchestra.run.smithi149.stdout:md 83 root txt unknown /proc/83/exe 2023-01-01T17:45:53.668 INFO:teuthology.orchestra.run.smithi149.stdout:edac-poll 84 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.668 INFO:teuthology.orchestra.run.smithi149.stdout:edac-poll 84 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.668 INFO:teuthology.orchestra.run.smithi149.stdout:edac-poll 84 root txt unknown /proc/84/exe 2023-01-01T17:45:53.668 INFO:teuthology.orchestra.run.smithi149.stdout:watchdogd 85 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.669 INFO:teuthology.orchestra.run.smithi149.stdout:watchdogd 85 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.669 INFO:teuthology.orchestra.run.smithi149.stdout:watchdogd 85 root txt unknown /proc/85/exe 2023-01-01T17:45:53.669 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/0 86 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.669 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/0 86 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.669 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/0 86 root txt unknown /proc/86/exe 2023-01-01T17:45:53.669 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/5 87 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.669 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/5 87 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.670 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/5 87 root txt unknown /proc/87/exe 2023-01-01T17:45:53.670 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/7 93 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.670 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/7 93 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.670 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/7 93 root txt unknown /proc/93/exe 2023-01-01T17:45:53.670 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/1 113 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.670 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/1 113 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.670 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/1 113 root txt unknown /proc/113/exe 2023-01-01T17:45:53.671 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/6 114 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.671 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/6 114 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.671 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/6 114 root txt unknown /proc/114/exe 2023-01-01T17:45:53.671 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/3 115 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.671 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/3 115 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.671 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/3 115 root txt unknown /proc/115/exe 2023-01-01T17:45:53.671 INFO:teuthology.orchestra.run.smithi149.stdout:kswapd0 124 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.671 INFO:teuthology.orchestra.run.smithi149.stdout:kswapd0 124 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.672 INFO:teuthology.orchestra.run.smithi149.stdout:kswapd0 124 root txt unknown /proc/124/exe 2023-01-01T17:45:53.672 INFO:teuthology.orchestra.run.smithi149.stdout:kthrotld 226 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.672 INFO:teuthology.orchestra.run.smithi149.stdout:kthrotld 226 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.672 INFO:teuthology.orchestra.run.smithi149.stdout:kthrotld 226 root txt unknown /proc/226/exe 2023-01-01T17:45:53.672 INFO:teuthology.orchestra.run.smithi149.stdout:acpi_ther 227 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.672 INFO:teuthology.orchestra.run.smithi149.stdout:acpi_ther 227 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.672 INFO:teuthology.orchestra.run.smithi149.stdout:acpi_ther 227 root txt unknown /proc/227/exe 2023-01-01T17:45:53.673 INFO:teuthology.orchestra.run.smithi149.stdout:kmpath_rd 228 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.673 INFO:teuthology.orchestra.run.smithi149.stdout:kmpath_rd 228 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.673 INFO:teuthology.orchestra.run.smithi149.stdout:kmpath_rd 228 root txt unknown /proc/228/exe 2023-01-01T17:45:53.673 INFO:teuthology.orchestra.run.smithi149.stdout:kaluad 229 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.673 INFO:teuthology.orchestra.run.smithi149.stdout:kaluad 229 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.673 INFO:teuthology.orchestra.run.smithi149.stdout:kaluad 229 root txt unknown /proc/229/exe 2023-01-01T17:45:53.673 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/1 230 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.674 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/1 230 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.674 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/1 230 root txt unknown /proc/230/exe 2023-01-01T17:45:53.674 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/3 231 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.674 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/3 231 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.674 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/3 231 root txt unknown /proc/231/exe 2023-01-01T17:45:53.674 INFO:teuthology.orchestra.run.smithi149.stdout:ipv6_addr 232 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.674 INFO:teuthology.orchestra.run.smithi149.stdout:ipv6_addr 232 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.675 INFO:teuthology.orchestra.run.smithi149.stdout:ipv6_addr 232 root txt unknown /proc/232/exe 2023-01-01T17:45:53.675 INFO:teuthology.orchestra.run.smithi149.stdout:kstrp 233 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.675 INFO:teuthology.orchestra.run.smithi149.stdout:kstrp 233 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.675 INFO:teuthology.orchestra.run.smithi149.stdout:kstrp 233 root txt unknown /proc/233/exe 2023-01-01T17:45:53.675 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/1 254 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.675 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/1 254 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.675 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/1 254 root txt unknown /proc/254/exe 2023-01-01T17:45:53.675 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/5 271 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.676 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/5 271 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.676 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/5 271 root txt unknown /proc/271/exe 2023-01-01T17:45:53.676 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/7 315 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.676 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/7 315 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.676 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/7 315 root txt unknown /proc/315/exe 2023-01-01T17:45:53.676 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/2 348 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.676 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/2 348 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.677 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/2 348 root txt unknown /proc/348/exe 2023-01-01T17:45:53.677 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/5 351 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.677 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/5 351 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.677 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/5 351 root txt unknown /proc/351/exe 2023-01-01T17:45:53.677 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/4 361 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.677 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/4 361 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.677 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/4 361 root txt unknown /proc/361/exe 2023-01-01T17:45:53.677 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/1 372 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.678 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/1 372 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.678 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/1 372 root txt unknown /proc/372/exe 2023-01-01T17:45:53.678 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/7 376 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.678 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/7 376 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.678 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/7 376 root txt unknown /proc/376/exe 2023-01-01T17:45:53.678 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/7 377 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.679 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/7 377 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.679 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/7 377 root txt unknown /proc/377/exe 2023-01-01T17:45:53.679 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/3 444 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.679 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/3 444 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.679 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/3 444 root txt unknown /proc/444/exe 2023-01-01T17:45:53.679 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/0 461 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.679 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/0 461 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.679 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/0 461 root txt unknown /proc/461/exe 2023-01-01T17:45:53.680 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/6 462 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.680 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/6 462 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.680 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/6 462 root txt unknown /proc/462/exe 2023-01-01T17:45:53.680 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/5 494 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.680 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/5 494 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.680 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/5 494 root txt unknown /proc/494/exe 2023-01-01T17:45:53.680 INFO:teuthology.orchestra.run.smithi149.stdout:ata_sff 501 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.680 INFO:teuthology.orchestra.run.smithi149.stdout:ata_sff 501 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.681 INFO:teuthology.orchestra.run.smithi149.stdout:ata_sff 501 root txt unknown /proc/501/exe 2023-01-01T17:45:53.681 INFO:teuthology.orchestra.run.smithi149.stdout:nvme-wq 503 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.681 INFO:teuthology.orchestra.run.smithi149.stdout:nvme-wq 503 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.681 INFO:teuthology.orchestra.run.smithi149.stdout:nvme-wq 503 root txt unknown /proc/503/exe 2023-01-01T17:45:53.681 INFO:teuthology.orchestra.run.smithi149.stdout:nvme-rese 505 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.681 INFO:teuthology.orchestra.run.smithi149.stdout:nvme-rese 505 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.681 INFO:teuthology.orchestra.run.smithi149.stdout:nvme-rese 505 root txt unknown /proc/505/exe 2023-01-01T17:45:53.682 INFO:teuthology.orchestra.run.smithi149.stdout:nvme-dele 506 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.682 INFO:teuthology.orchestra.run.smithi149.stdout:nvme-dele 506 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.682 INFO:teuthology.orchestra.run.smithi149.stdout:nvme-dele 506 root txt unknown /proc/506/exe 2023-01-01T17:45:53.682 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_eh_0 507 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.682 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_eh_0 507 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.682 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_eh_0 507 root txt unknown /proc/507/exe 2023-01-01T17:45:53.682 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_tmf_ 508 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.683 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_tmf_ 508 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.683 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_tmf_ 508 root txt unknown /proc/508/exe 2023-01-01T17:45:53.683 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_eh_1 509 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.683 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_eh_1 509 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.683 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_eh_1 509 root txt unknown /proc/509/exe 2023-01-01T17:45:53.683 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_tmf_ 510 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.683 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_tmf_ 510 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.683 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_tmf_ 510 root txt unknown /proc/510/exe 2023-01-01T17:45:53.684 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_eh_2 511 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.684 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_eh_2 511 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.684 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_eh_2 511 root txt unknown /proc/511/exe 2023-01-01T17:45:53.684 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_tmf_ 513 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.684 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_tmf_ 513 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.684 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_tmf_ 513 root txt unknown /proc/513/exe 2023-01-01T17:45:53.684 INFO:teuthology.orchestra.run.smithi149.stdout:ixgbe 514 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.685 INFO:teuthology.orchestra.run.smithi149.stdout:ixgbe 514 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.685 INFO:teuthology.orchestra.run.smithi149.stdout:ixgbe 514 root txt unknown /proc/514/exe 2023-01-01T17:45:53.685 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/0 515 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.685 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/0 515 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.685 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/0 515 root txt unknown /proc/515/exe 2023-01-01T17:45:53.685 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_eh_3 516 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.685 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_eh_3 516 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.686 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_eh_3 516 root txt unknown /proc/516/exe 2023-01-01T17:45:53.686 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_tmf_ 517 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.686 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_tmf_ 517 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.686 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_tmf_ 517 root txt unknown /proc/517/exe 2023-01-01T17:45:53.686 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_eh_4 520 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.686 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_eh_4 520 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.686 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_eh_4 520 root txt unknown /proc/520/exe 2023-01-01T17:45:53.686 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_tmf_ 521 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.687 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_tmf_ 521 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.687 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_tmf_ 521 root txt unknown /proc/521/exe 2023-01-01T17:45:53.687 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_eh_5 522 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.687 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_eh_5 522 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.687 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_eh_5 522 root txt unknown /proc/522/exe 2023-01-01T17:45:53.687 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_tmf_ 523 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.687 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_tmf_ 523 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.687 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_tmf_ 523 root txt unknown /proc/523/exe 2023-01-01T17:45:53.688 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_eh_6 524 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.688 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_eh_6 524 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.688 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_eh_6 524 root txt unknown /proc/524/exe 2023-01-01T17:45:53.688 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_tmf_ 525 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.688 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_tmf_ 525 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.688 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_tmf_ 525 root txt unknown /proc/525/exe 2023-01-01T17:45:53.688 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_eh_7 526 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.689 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_eh_7 526 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.689 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_eh_7 526 root txt unknown /proc/526/exe 2023-01-01T17:45:53.689 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_tmf_ 527 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.689 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_tmf_ 527 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.689 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_tmf_ 527 root txt unknown /proc/527/exe 2023-01-01T17:45:53.689 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_eh_8 528 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.689 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_eh_8 528 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.689 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_eh_8 528 root txt unknown /proc/528/exe 2023-01-01T17:45:53.690 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_tmf_ 529 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.690 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_tmf_ 529 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.690 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_tmf_ 529 root txt unknown /proc/529/exe 2023-01-01T17:45:53.690 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_eh_9 530 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.690 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_eh_9 530 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.690 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_eh_9 530 root txt unknown /proc/530/exe 2023-01-01T17:45:53.690 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_tmf_ 531 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.691 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_tmf_ 531 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.691 INFO:teuthology.orchestra.run.smithi149.stdout:scsi_tmf_ 531 root txt unknown /proc/531/exe 2023-01-01T17:45:53.691 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/u 532 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.691 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/u 532 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.691 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/u 532 root txt unknown /proc/532/exe 2023-01-01T17:45:53.691 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/u 533 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.691 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/u 533 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.691 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/u 533 root txt unknown /proc/533/exe 2023-01-01T17:45:53.692 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/u 534 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.692 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/u 534 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.692 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/u 534 root txt unknown /proc/534/exe 2023-01-01T17:45:53.692 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/3 560 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.692 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/3 560 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.692 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/3 560 root txt unknown /proc/560/exe 2023-01-01T17:45:53.692 INFO:teuthology.orchestra.run.smithi149.stdout:jbd2/sda1 562 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.693 INFO:teuthology.orchestra.run.smithi149.stdout:jbd2/sda1 562 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.693 INFO:teuthology.orchestra.run.smithi149.stdout:jbd2/sda1 562 root txt unknown /proc/562/exe 2023-01-01T17:45:53.693 INFO:teuthology.orchestra.run.smithi149.stdout:ext4-rsv- 563 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.693 INFO:teuthology.orchestra.run.smithi149.stdout:ext4-rsv- 563 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.693 INFO:teuthology.orchestra.run.smithi149.stdout:ext4-rsv- 563 root txt unknown /proc/563/exe 2023-01-01T17:45:53.693 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/6 630 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.694 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/6 630 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.694 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/6 630 root txt unknown /proc/630/exe 2023-01-01T17:45:53.694 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/4 633 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.694 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/4 633 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.694 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/4 633 root txt unknown /proc/633/exe 2023-01-01T17:45:53.694 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/2 639 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.694 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/2 639 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.694 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/2 639 root txt unknown /proc/639/exe 2023-01-01T17:45:53.695 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.695 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.695 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root txt REG 8,1 153992 8126 /usr/lib/systemd/systemd-journald 2023-01-01T17:45:53.695 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root mem REG 0,24 8388608 2270 /run/log/journal/5a84457b7b52416e95d47d02e2e4a60f/system.journal 2023-01-01T17:45:53.695 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:53.695 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-01-01T17:45:53.695 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-01-01T17:45:53.696 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root mem REG 8,1 735192 5135 /usr/lib64/libsepol.so.1 2023-01-01T17:45:53.696 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-01-01T17:45:53.696 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:53.696 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root mem REG 8,1 66912 5393 /usr/lib64/libjson-c.so.4.0.0 2023-01-01T17:45:53.696 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-01-01T17:45:53.696 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-01-01T17:45:53.696 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root mem REG 8,1 371240 32501 /usr/lib64/libdevmapper.so.1.02 2023-01-01T17:45:53.696 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:53.697 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root mem REG 8,1 26192 5300 /usr/lib64/libattr.so.1.1.2448 2023-01-01T17:45:53.697 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:53.697 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:53.697 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:53.697 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:53.697 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:53.697 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:53.698 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-01-01T17:45:53.698 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root mem REG 8,1 128784 5906 /usr/lib64/libseccomp.so.2.5.2 2023-01-01T17:45:53.698 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:53.698 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root mem REG 8,1 526360 7346 /usr/lib64/libcryptsetup.so.12.6.0 2023-01-01T17:45:53.698 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root mem REG 8,1 54816 5302 /usr/lib64/libacl.so.1.1.2253 2023-01-01T17:45:53.698 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:53.698 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:53.699 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.699 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:53.699 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:53.699 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:53.699 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root mem REG 8,1 2740672 8111 /usr/lib/systemd/libsystemd-shared-239.so 2023-01-01T17:45:53.699 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.699 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root mem REG 0,24 8 2247 /run/systemd/journal/kernel-seqnum 2023-01-01T17:45:53.700 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.700 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root 1w CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.700 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root 2w CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.700 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root 3u unix 0xffff8dad427a7080 0t0 14394 /run/systemd/journal/dev-log type=DGRAM 2023-01-01T17:45:53.700 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root 4u unix 0xffff8dad427a6c00 0t0 14383 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.700 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root 5u unix 0xffff8dad427a1200 0t0 14387 /run/systemd/journal/socket type=DGRAM 2023-01-01T17:45:53.700 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root 6u a_inode 0,14 0 11447 [eventpoll] 2023-01-01T17:45:53.700 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root 7u CHR 1,11 0t0 2057 /dev/kmsg 2023-01-01T17:45:53.701 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root 8r REG 0,5 0 2248 /proc/sys/kernel/hostname 2023-01-01T17:45:53.701 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root 9u a_inode 0,14 0 11447 [signalfd] 2023-01-01T17:45:53.701 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root 10u a_inode 0,14 0 11447 [signalfd] 2023-01-01T17:45:53.701 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root 11u a_inode 0,14 0 11447 [signalfd] 2023-01-01T17:45:53.701 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root 12u unix 0xffff8dad403b8000 0t0 2726 type=DGRAM 2023-01-01T17:45:53.701 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root 13u a_inode 0,14 0 11447 [timerfd] 2023-01-01T17:45:53.701 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root 14u REG 0,24 8388608 2270 /run/log/journal/5a84457b7b52416e95d47d02e2e4a60f/system.journal 2023-01-01T17:45:53.702 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root 15u unix 0xffff8dad403bd100 0t0 13894 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.702 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root 16u unix 0xffff8dad09280480 0t0 17035 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.702 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root 18u unix 0xffff8dad40245100 0t0 20818 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.702 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root 19u unix 0xffff8dad403bb180 0t0 24734 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.702 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root 20u unix 0xffff8dad402bb180 0t0 22630 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.702 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root 21u unix 0xffff8dad403bad00 0t0 22632 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.702 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root 22u unix 0xffff8dad40cef980 0t0 22634 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.703 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root 23u unix 0xffff8dad41993f00 0t0 22637 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.703 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root 24u unix 0xffff8dad40240900 0t0 30445 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.703 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root 25u unix 0xffff8dad40349200 0t0 20675 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.703 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root 26u unix 0xffff8dad403bba80 0t0 24736 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.703 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root 27u unix 0xffff8dad09282400 0t0 20735 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.703 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root 28u unix 0xffff8dad09283a80 0t0 20737 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.703 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root 29u unix 0xffff8dad09284380 0t0 25646 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.703 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root 30u unix 0xffff8dad41991680 0t0 44770 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.704 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root 32u unix 0xffff8dad402b8900 0t0 30447 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.704 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root 33u unix 0xffff8dad4034e300 0t0 24403 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.704 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root 34u unix 0xffff8dad402b9b00 0t0 25663 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.704 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-j 660 root 36u unix 0xffff8dad09287500 0t0 31936 /run/systemd/journal/stdout type=STREAM 2023-01-01T17:45:53.704 INFO:teuthology.orchestra.run.smithi149.stdout:ext4lazyi 668 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.704 INFO:teuthology.orchestra.run.smithi149.stdout:ext4lazyi 668 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.704 INFO:teuthology.orchestra.run.smithi149.stdout:ext4lazyi 668 root txt unknown /proc/668/exe 2023-01-01T17:45:53.704 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.705 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.705 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root txt REG 8,1 418304 8317 /usr/lib/systemd/systemd-udevd 2023-01-01T17:45:53.705 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root DEL REG 8,1 68024 /var/lib/sss/mc/passwd 2023-01-01T17:45:53.705 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root DEL REG 8,1 72551 /var/lib/sss/mc/group 2023-01-01T17:45:53.705 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:53.705 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 559522 41419 /usr/lib/modules/4.18.0-372.9.1.el8.x86_64/modules.symbols.bin 2023-01-01T17:45:53.705 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 871129 41679 /usr/lib/modules/4.18.0-372.9.1.el8.x86_64/modules.alias.bin 2023-01-01T17:45:53.706 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 11120017 66468 /etc/udev/hwdb.bin 2023-01-01T17:45:53.706 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-01-01T17:45:53.706 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-01-01T17:45:53.706 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 735192 5135 /usr/lib64/libsepol.so.1 2023-01-01T17:45:53.706 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-01-01T17:45:53.706 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:53.706 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:53.706 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:53.707 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 66912 5393 /usr/lib64/libjson-c.so.4.0.0 2023-01-01T17:45:53.707 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 371240 32501 /usr/lib64/libdevmapper.so.1.02 2023-01-01T17:45:53.707 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:53.707 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 26192 5300 /usr/lib64/libattr.so.1.1.2448 2023-01-01T17:45:53.707 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-01-01T17:45:53.707 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-01-01T17:45:53.707 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:53.707 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:53.708 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:53.708 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:53.708 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-01-01T17:45:53.708 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:53.708 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 128784 5906 /usr/lib64/libseccomp.so.2.5.2 2023-01-01T17:45:53.708 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:53.708 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 526360 7346 /usr/lib64/libcryptsetup.so.12.6.0 2023-01-01T17:45:53.709 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:53.709 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:53.709 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.709 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:53.709 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:53.709 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:53.709 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 54816 5302 /usr/lib64/libacl.so.1.1.2253 2023-01-01T17:45:53.710 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 100200 7343 /usr/lib64/libkmod.so.2.3.3 2023-01-01T17:45:53.710 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 2740672 8111 /usr/lib/systemd/libsystemd-shared-239.so 2023-01-01T17:45:53.710 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.710 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 442609 41424 /usr/lib/modules/4.18.0-372.9.1.el8.x86_64/modules.dep.bin 2023-01-01T17:45:53.710 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 576141 1062 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-01-01T17:45:53.710 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 10109 41420 /usr/lib/modules/4.18.0-372.9.1.el8.x86_64/modules.builtin.bin 2023-01-01T17:45:53.710 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root mem REG 8,1 19983 1966 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-01-01T17:45:53.711 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.711 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root 1u unix 0xffff8dad403bbf00 0t0 20485 type=STREAM 2023-01-01T17:45:53.711 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root 2u unix 0xffff8dad403bbf00 0t0 20485 type=STREAM 2023-01-01T17:45:53.711 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root 3u netlink 0t0 18640 KOBJECT_UEVENT 2023-01-01T17:45:53.711 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root 4u unix 0xffff8dad4034f980 0t0 18091 /run/udev/control type=SEQPACKET 2023-01-01T17:45:53.711 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root 5u unix 0xffff8dad40348480 0t0 18246 type=DGRAM 2023-01-01T17:45:53.711 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root 6r REG 8,1 11120017 66468 /etc/udev/hwdb.bin 2023-01-01T17:45:53.711 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root 7u unix 0xffff8dad4034c800 0t0 18258 type=DGRAM 2023-01-01T17:45:53.712 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root 8r REG 8,1 6940392 72551 /var/lib/sss/mc/group (deleted) 2023-01-01T17:45:53.712 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root 9r REG 8,1 9253600 68024 /var/lib/sss/mc/passwd (deleted) 2023-01-01T17:45:53.712 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root 10u unix 0xffff8dad4034ba80 0t0 18259 type=DGRAM 2023-01-01T17:45:53.712 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root 11r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.712 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root 12u a_inode 0,14 0 11447 [eventpoll] 2023-01-01T17:45:53.712 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root 13u a_inode 0,14 0 11447 [signalfd] 2023-01-01T17:45:53.712 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root 14u a_inode 0,14 0 11447 [timerfd] 2023-01-01T17:45:53.713 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-u 700 root 15u a_inode 0,14 0 11447 [timerfd] 2023-01-01T17:45:53.713 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/4 718 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.713 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/4 718 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.713 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/4 718 root txt unknown /proc/718/exe 2023-01-01T17:45:53.713 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.713 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.713 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc txt REG 8,1 63160 14085 /usr/bin/rpcbind 2023-01-01T17:45:53.714 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:53.714 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:53.714 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:53.714 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:53.714 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:53.714 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:53.714 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:53.714 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:53.715 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-01-01T17:45:53.715 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-01-01T17:45:53.715 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:53.715 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-01-01T17:45:53.715 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:53.715 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:53.715 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:53.715 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:53.716 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:53.716 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:53.716 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:53.716 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-01-01T17:45:53.716 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-01-01T17:45:53.716 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-01-01T17:45:53.716 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-01-01T17:45:53.717 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.717 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:53.717 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:53.717 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc mem REG 8,1 213592 7033 /usr/lib64/libtirpc.so.3.0.0 2023-01-01T17:45:53.717 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.717 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.717 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc 1u unix 0xffff8dad09284c80 0t0 18727 type=STREAM 2023-01-01T17:45:53.718 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc 2u unix 0xffff8dad09284c80 0t0 18727 type=STREAM 2023-01-01T17:45:53.718 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc 3u unix 0xffff8dad4034d580 0t0 18109 /run/rpcbind.sock type=STREAM 2023-01-01T17:45:53.718 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc 4u IPv4 18111 0t0 TCP *:sunrpc (LISTEN) 2023-01-01T17:45:53.718 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc 5u IPv4 18112 0t0 UDP *:sunrpc 2023-01-01T17:45:53.718 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc 6u IPv6 18113 0t0 TCP *:sunrpc (LISTEN) 2023-01-01T17:45:53.718 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc 7u IPv6 18114 0t0 UDP *:sunrpc 2023-01-01T17:45:53.718 INFO:teuthology.orchestra.run.smithi149.stdout:rpcbind 746 rpc 8rW REG 0,24 0 18292 /run/rpcbind/rpcbind.lock 2023-01-01T17:45:53.718 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.719 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.719 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root txt REG 8,1 159528 9150 /usr/sbin/auditd 2023-01-01T17:45:53.719 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root mem REG 8,1 9253600 20335 /var/lib/sss/mc/passwd 2023-01-01T17:45:53.719 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:53.719 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root mem REG 8,1 6940392 20342 /var/lib/sss/mc/group 2023-01-01T17:45:53.719 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:53.719 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:53.720 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:53.720 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:53.720 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:53.720 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-01-01T17:45:53.720 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-01-01T17:45:53.720 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:53.720 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-01-01T17:45:53.720 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-01-01T17:45:53.721 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-01-01T17:45:53.721 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.721 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-01-01T17:45:53.721 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-01-01T17:45:53.721 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-01-01T17:45:53.721 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:53.721 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-01-01T17:45:53.721 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root mem REG 8,1 145416 5400 /usr/lib64/libauparse.so.0.0.0 2023-01-01T17:45:53.722 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-01-01T17:45:53.722 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.722 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root 0u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.722 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root 1u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.722 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root 2u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.722 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root 3u netlink 0t0 14020 AUDIT 2023-01-01T17:45:53.722 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root 4r REG 8,1 6940392 20342 /var/lib/sss/mc/group 2023-01-01T17:45:53.723 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root 5r REG 8,1 9253600 20335 /var/lib/sss/mc/passwd 2023-01-01T17:45:53.723 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root 6w REG 8,1 5386800 66436 /var/log/audit/audit.log 2023-01-01T17:45:53.723 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root 7u unix 0xffff8dad4034f500 0t0 18298 type=DGRAM 2023-01-01T17:45:53.723 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root 8u unix 0xffff8dad40349b00 0t0 18297 type=STREAM 2023-01-01T17:45:53.723 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root 9u unix 0xffff8dad4034c380 0t0 18299 type=STREAM 2023-01-01T17:45:53.723 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root 10u unix 0xffff8dad4034de80 0t0 18300 type=STREAM 2023-01-01T17:45:53.723 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root 11u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.723 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 root 12u unix 0xffff8dad40244380 0t0 32054 type=STREAM 2023-01-01T17:45:53.724 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.724 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.724 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root txt REG 8,1 159528 9150 /usr/sbin/auditd 2023-01-01T17:45:53.724 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root mem REG 8,1 9253600 20335 /var/lib/sss/mc/passwd 2023-01-01T17:45:53.724 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:53.724 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root mem REG 8,1 6940392 20342 /var/lib/sss/mc/group 2023-01-01T17:45:53.724 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:53.725 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:53.725 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:53.725 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:53.725 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:53.725 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-01-01T17:45:53.725 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-01-01T17:45:53.726 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:53.726 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-01-01T17:45:53.726 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-01-01T17:45:53.726 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-01-01T17:45:53.726 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.726 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-01-01T17:45:53.726 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-01-01T17:45:53.727 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-01-01T17:45:53.727 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:53.727 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-01-01T17:45:53.727 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root mem REG 8,1 145416 5400 /usr/lib64/libauparse.so.0.0.0 2023-01-01T17:45:53.727 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-01-01T17:45:53.727 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.727 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root 0u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.727 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root 1u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.728 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root 2u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.728 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root 3u netlink 0t0 14020 AUDIT 2023-01-01T17:45:53.728 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root 4r REG 8,1 6940392 20342 /var/lib/sss/mc/group 2023-01-01T17:45:53.728 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root 5r REG 8,1 9253600 20335 /var/lib/sss/mc/passwd 2023-01-01T17:45:53.728 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root 6w REG 8,1 5386800 66436 /var/log/audit/audit.log 2023-01-01T17:45:53.728 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root 7u unix 0xffff8dad4034f500 0t0 18298 type=DGRAM 2023-01-01T17:45:53.729 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root 8u unix 0xffff8dad40349b00 0t0 18297 type=STREAM 2023-01-01T17:45:53.729 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root 9u unix 0xffff8dad4034c380 0t0 18299 type=STREAM 2023-01-01T17:45:53.729 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root 10u unix 0xffff8dad4034de80 0t0 18300 type=STREAM 2023-01-01T17:45:53.729 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root 11u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.729 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 751 auditd root 12u unix 0xffff8dad40244380 0t0 32054 type=STREAM 2023-01-01T17:45:53.729 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.729 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.729 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root txt REG 8,1 159528 9150 /usr/sbin/auditd 2023-01-01T17:45:53.730 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root mem REG 8,1 9253600 20335 /var/lib/sss/mc/passwd 2023-01-01T17:45:53.730 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:53.730 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root mem REG 8,1 6940392 20342 /var/lib/sss/mc/group 2023-01-01T17:45:53.730 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:53.730 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:53.730 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:53.730 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:53.731 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:53.731 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-01-01T17:45:53.731 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-01-01T17:45:53.731 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:53.731 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-01-01T17:45:53.731 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-01-01T17:45:53.731 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-01-01T17:45:53.731 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.732 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-01-01T17:45:53.732 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-01-01T17:45:53.732 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-01-01T17:45:53.732 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:53.732 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-01-01T17:45:53.732 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root mem REG 8,1 145416 5400 /usr/lib64/libauparse.so.0.0.0 2023-01-01T17:45:53.732 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-01-01T17:45:53.733 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.733 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root 0u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.733 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root 1u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.733 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root 2u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.733 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root 3u netlink 0t0 14020 AUDIT 2023-01-01T17:45:53.733 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root 4r REG 8,1 6940392 20342 /var/lib/sss/mc/group 2023-01-01T17:45:53.733 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root 5r REG 8,1 9253600 20335 /var/lib/sss/mc/passwd 2023-01-01T17:45:53.734 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root 6w REG 8,1 5386800 66436 /var/log/audit/audit.log 2023-01-01T17:45:53.734 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root 7u unix 0xffff8dad4034f500 0t0 18298 type=DGRAM 2023-01-01T17:45:53.734 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root 8u unix 0xffff8dad40349b00 0t0 18297 type=STREAM 2023-01-01T17:45:53.734 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root 9u unix 0xffff8dad4034c380 0t0 18299 type=STREAM 2023-01-01T17:45:53.734 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root 10u unix 0xffff8dad4034de80 0t0 18300 type=STREAM 2023-01-01T17:45:53.734 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root 11u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.734 INFO:teuthology.orchestra.run.smithi149.stdout:auditd 750 753 auditd root 12u unix 0xffff8dad40244380 0t0 32054 type=STREAM 2023-01-01T17:45:53.734 INFO:teuthology.orchestra.run.smithi149.stdout:sedispatc 752 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.735 INFO:teuthology.orchestra.run.smithi149.stdout:sedispatc 752 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.735 INFO:teuthology.orchestra.run.smithi149.stdout:sedispatc 752 root txt REG 8,1 21008 10285 /usr/sbin/sedispatch 2023-01-01T17:45:53.735 INFO:teuthology.orchestra.run.smithi149.stdout:sedispatc 752 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:53.735 INFO:teuthology.orchestra.run.smithi149.stdout:sedispatc 752 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:53.735 INFO:teuthology.orchestra.run.smithi149.stdout:sedispatc 752 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:53.735 INFO:teuthology.orchestra.run.smithi149.stdout:sedispatc 752 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:53.735 INFO:teuthology.orchestra.run.smithi149.stdout:sedispatc 752 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:53.736 INFO:teuthology.orchestra.run.smithi149.stdout:sedispatc 752 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:53.736 INFO:teuthology.orchestra.run.smithi149.stdout:sedispatc 752 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:53.736 INFO:teuthology.orchestra.run.smithi149.stdout:sedispatc 752 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:53.736 INFO:teuthology.orchestra.run.smithi149.stdout:sedispatc 752 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:53.736 INFO:teuthology.orchestra.run.smithi149.stdout:sedispatc 752 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:53.736 INFO:teuthology.orchestra.run.smithi149.stdout:sedispatc 752 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:53.736 INFO:teuthology.orchestra.run.smithi149.stdout:sedispatc 752 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:53.737 INFO:teuthology.orchestra.run.smithi149.stdout:sedispatc 752 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-01-01T17:45:53.737 INFO:teuthology.orchestra.run.smithi149.stdout:sedispatc 752 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:53.737 INFO:teuthology.orchestra.run.smithi149.stdout:sedispatc 752 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:53.737 INFO:teuthology.orchestra.run.smithi149.stdout:sedispatc 752 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.737 INFO:teuthology.orchestra.run.smithi149.stdout:sedispatc 752 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:53.737 INFO:teuthology.orchestra.run.smithi149.stdout:sedispatc 752 root mem REG 8,1 145416 5400 /usr/lib64/libauparse.so.0.0.0 2023-01-01T17:45:53.737 INFO:teuthology.orchestra.run.smithi149.stdout:sedispatc 752 root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-01-01T17:45:53.738 INFO:teuthology.orchestra.run.smithi149.stdout:sedispatc 752 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-01-01T17:45:53.738 INFO:teuthology.orchestra.run.smithi149.stdout:sedispatc 752 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.738 INFO:teuthology.orchestra.run.smithi149.stdout:sedispatc 752 root 0u unix 0xffff8dad40349680 0t0 18296 type=STREAM 2023-01-01T17:45:53.738 INFO:teuthology.orchestra.run.smithi149.stdout:sedispatc 752 root 1u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.738 INFO:teuthology.orchestra.run.smithi149.stdout:sedispatc 752 root 2u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.738 INFO:teuthology.orchestra.run.smithi149.stdout:sedispatc 752 root 3u unix 0xffff8dad40245a00 0t0 32196 type=STREAM 2023-01-01T17:45:53.739 INFO:teuthology.orchestra.run.smithi149.stdout:sedispatc 752 root 4u unix 0xffff8dad40247080 0t0 39707 type=DGRAM 2023-01-01T17:45:53.739 INFO:teuthology.orchestra.run.smithi149.stdout:rpciod 754 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.739 INFO:teuthology.orchestra.run.smithi149.stdout:rpciod 754 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.739 INFO:teuthology.orchestra.run.smithi149.stdout:rpciod 754 root txt unknown /proc/754/exe 2023-01-01T17:45:53.739 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/u 755 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.739 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/u 755 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.739 INFO:teuthology.orchestra.run.smithi149.stdout:kworker/u 755 root txt unknown /proc/755/exe 2023-01-01T17:45:53.740 INFO:teuthology.orchestra.run.smithi149.stdout:xprtiod 756 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.740 INFO:teuthology.orchestra.run.smithi149.stdout:xprtiod 756 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.740 INFO:teuthology.orchestra.run.smithi149.stdout:xprtiod 756 root txt unknown /proc/756/exe 2023-01-01T17:45:53.740 INFO:teuthology.orchestra.run.smithi149.stdout:kipmi0 784 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.740 INFO:teuthology.orchestra.run.smithi149.stdout:kipmi0 784 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.740 INFO:teuthology.orchestra.run.smithi149.stdout:kipmi0 784 root txt unknown /proc/784/exe 2023-01-01T17:45:53.740 INFO:teuthology.orchestra.run.smithi149.stdout:kdmflush/ 787 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.741 INFO:teuthology.orchestra.run.smithi149.stdout:kdmflush/ 787 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.741 INFO:teuthology.orchestra.run.smithi149.stdout:kdmflush/ 787 root txt unknown /proc/787/exe 2023-01-01T17:45:53.741 INFO:teuthology.orchestra.run.smithi149.stdout:kdmflush/ 788 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.741 INFO:teuthology.orchestra.run.smithi149.stdout:kdmflush/ 788 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.741 INFO:teuthology.orchestra.run.smithi149.stdout:kdmflush/ 788 root txt unknown /proc/788/exe 2023-01-01T17:45:53.741 INFO:teuthology.orchestra.run.smithi149.stdout:kdmflush/ 789 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.742 INFO:teuthology.orchestra.run.smithi149.stdout:kdmflush/ 789 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.742 INFO:teuthology.orchestra.run.smithi149.stdout:kdmflush/ 789 root txt unknown /proc/789/exe 2023-01-01T17:45:53.742 INFO:teuthology.orchestra.run.smithi149.stdout:kdmflush/ 790 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.742 INFO:teuthology.orchestra.run.smithi149.stdout:kdmflush/ 790 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.742 INFO:teuthology.orchestra.run.smithi149.stdout:kdmflush/ 790 root txt unknown /proc/790/exe 2023-01-01T17:45:53.742 INFO:teuthology.orchestra.run.smithi149.stdout:kdmflush/ 791 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.742 INFO:teuthology.orchestra.run.smithi149.stdout:kdmflush/ 791 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.743 INFO:teuthology.orchestra.run.smithi149.stdout:kdmflush/ 791 root txt unknown /proc/791/exe 2023-01-01T17:45:53.743 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.743 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.743 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 root txt REG 8,1 63768 11145 /usr/sbin/irqbalance 2023-01-01T17:45:53.743 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-01-01T17:45:53.743 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-01-01T17:45:53.743 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-01-01T17:45:53.744 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-01-01T17:45:53.744 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-01-01T17:45:53.744 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-01-01T17:45:53.744 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-01-01T17:45:53.744 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-01-01T17:45:53.744 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:53.745 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:53.745 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-01-01T17:45:53.745 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-01-01T17:45:53.745 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.745 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 root mem REG 8,1 187496 4713 /usr/lib64/libtinfo.so.6.1 2023-01-01T17:45:53.745 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 root mem REG 8,1 255032 4705 /usr/lib64/libncursesw.so.6.1 2023-01-01T17:45:53.745 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 root mem REG 8,1 51192 5937 /usr/lib64/libnuma.so.1.0.0 2023-01-01T17:45:53.746 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-01-01T17:45:53.746 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-01-01T17:45:53.746 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-01-01T17:45:53.746 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.746 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 root 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.746 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 root 1u unix 0xffff8dad402b8000 0t0 24281 type=STREAM 2023-01-01T17:45:53.746 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 root 2u unix 0xffff8dad402b8000 0t0 24281 type=STREAM 2023-01-01T17:45:53.746 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 root 3u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.747 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 root 4u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.747 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 root 5u unix 0xffff8dad09281680 0t0 19009 @irqbalance836.sock type=STREAM 2023-01-01T17:45:53.747 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 871 gmain root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.747 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 871 gmain root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.747 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 871 gmain root txt REG 8,1 63768 11145 /usr/sbin/irqbalance 2023-01-01T17:45:53.747 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 871 gmain root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-01-01T17:45:53.747 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 871 gmain root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-01-01T17:45:53.748 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 871 gmain root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-01-01T17:45:53.748 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 871 gmain root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-01-01T17:45:53.748 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 871 gmain root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-01-01T17:45:53.748 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 871 gmain root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-01-01T17:45:53.748 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 871 gmain root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-01-01T17:45:53.748 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 871 gmain root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-01-01T17:45:53.748 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 871 gmain root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:53.748 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 871 gmain root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:53.749 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 871 gmain root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-01-01T17:45:53.749 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 871 gmain root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-01-01T17:45:53.749 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 871 gmain root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.749 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 871 gmain root mem REG 8,1 187496 4713 /usr/lib64/libtinfo.so.6.1 2023-01-01T17:45:53.749 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 871 gmain root mem REG 8,1 255032 4705 /usr/lib64/libncursesw.so.6.1 2023-01-01T17:45:53.749 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 871 gmain root mem REG 8,1 51192 5937 /usr/lib64/libnuma.so.1.0.0 2023-01-01T17:45:53.749 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 871 gmain root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-01-01T17:45:53.750 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 871 gmain root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-01-01T17:45:53.750 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 871 gmain root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-01-01T17:45:53.750 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 871 gmain root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.750 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 871 gmain root 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.750 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 871 gmain root 1u unix 0xffff8dad402b8000 0t0 24281 type=STREAM 2023-01-01T17:45:53.750 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 871 gmain root 2u unix 0xffff8dad402b8000 0t0 24281 type=STREAM 2023-01-01T17:45:53.750 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 871 gmain root 3u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.750 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 871 gmain root 4u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.751 INFO:teuthology.orchestra.run.smithi149.stdout:irqbalanc 836 871 gmain root 5u unix 0xffff8dad09281680 0t0 19009 @irqbalance836.sock type=STREAM 2023-01-01T17:45:53.751 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.751 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.751 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus txt REG 8,1 245488 7368 /usr/bin/dbus-daemon 2023-01-01T17:45:53.751 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus DEL REG 8,1 72551 /var/lib/sss/mc/group 2023-01-01T17:45:53.751 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-01-01T17:45:53.751 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:53.751 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:53.752 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:53.752 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:53.752 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:53.752 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:53.752 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:53.752 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:53.752 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:53.753 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:53.753 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:53.753 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:53.753 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:53.753 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:53.753 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.753 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:53.754 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-01-01T17:45:53.754 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-01-01T17:45:53.754 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:53.754 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-01-01T17:45:53.754 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:53.754 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-01-01T17:45:53.754 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.755 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus 0u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.755 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus 1u unix 0xffff8dad40ced580 0t0 22326 type=STREAM 2023-01-01T17:45:53.755 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus 2u unix 0xffff8dad40ced580 0t0 22326 type=STREAM 2023-01-01T17:45:53.755 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus 3u unix 0xffff8dad40349f80 0t0 22568 /run/dbus/system_bus_socket type=STREAM 2023-01-01T17:45:53.755 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus 4u a_inode 0,14 0 11447 [eventpoll] 2023-01-01T17:45:53.755 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus 5u unix 0xffff8dad40242d00 0t0 39765 type=STREAM 2023-01-01T17:45:53.755 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus 7u sock 0,9 0t0 24719 protocol: NETLINK 2023-01-01T17:45:53.755 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus 8r REG 8,1 6940392 72551 /var/lib/sss/mc/group (deleted) 2023-01-01T17:45:53.756 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus 9u netlink 0t0 24720 SELINUX 2023-01-01T17:45:53.756 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus 10r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.756 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus 11u unix 0xffff8dad41993600 0t0 24725 type=STREAM 2023-01-01T17:45:53.756 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus 12u unix 0xffff8dad41995580 0t0 24726 type=STREAM 2023-01-01T17:45:53.756 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus 13u unix 0xffff8dad4034ec00 0t0 24727 /run/dbus/system_bus_socket type=STREAM 2023-01-01T17:45:53.756 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus 14u unix 0xffff8dad402be300 0t0 25685 /run/dbus/system_bus_socket type=STREAM 2023-01-01T17:45:53.756 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus 15u unix 0xffff8dad0403f500 0t0 20815 /run/dbus/system_bus_socket type=STREAM 2023-01-01T17:45:53.757 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus 16u unix 0xffff8dad427a3180 0t0 25706 type=DGRAM 2023-01-01T17:45:53.757 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus 17u unix 0xffff8dad40246780 0t0 25707 /run/dbus/system_bus_socket type=STREAM 2023-01-01T17:45:53.757 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus 18u unix 0xffff8dad40243180 0t0 31286 /run/dbus/system_bus_socket type=STREAM 2023-01-01T17:45:53.757 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus 21u unix 0xffff8dad09281200 0t0 25727 /run/dbus/system_bus_socket type=STREAM 2023-01-01T17:45:53.757 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus 22u unix 0xffff8dad402bd580 0t0 30451 /run/dbus/system_bus_socket type=STREAM 2023-01-01T17:45:53.757 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus 23u unix 0xffff8dad40ced100 0t0 31941 /run/dbus/system_bus_socket type=STREAM 2023-01-01T17:45:53.757 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus 24u unix 0xffff8dad40cea400 0t0 25884 /run/dbus/system_bus_socket type=STREAM 2023-01-01T17:45:53.758 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 dbus 25u unix 0xffff8dad41995a00 0t0 39764 /run/dbus/system_bus_socket type=STREAM 2023-01-01T17:45:53.758 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.758 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.758 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus txt REG 8,1 245488 7368 /usr/bin/dbus-daemon 2023-01-01T17:45:53.758 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus DEL REG 8,1 72551 /var/lib/sss/mc/group 2023-01-01T17:45:53.758 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-01-01T17:45:53.758 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:53.759 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:53.759 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:53.759 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:53.759 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:53.759 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:53.759 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:53.759 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:53.759 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:53.760 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:53.760 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:53.760 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:53.760 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:53.760 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:53.760 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.761 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:53.761 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-01-01T17:45:53.761 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-01-01T17:45:53.761 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:53.761 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-01-01T17:45:53.761 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:53.761 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-01-01T17:45:53.762 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.762 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus 0u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.762 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus 1u unix 0xffff8dad40ced580 0t0 22326 type=STREAM 2023-01-01T17:45:53.762 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus 2u unix 0xffff8dad40ced580 0t0 22326 type=STREAM 2023-01-01T17:45:53.762 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus 3u unix 0xffff8dad40349f80 0t0 22568 /run/dbus/system_bus_socket type=STREAM 2023-01-01T17:45:53.762 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus 4u a_inode 0,14 0 11447 [eventpoll] 2023-01-01T17:45:53.762 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus 5u unix 0xffff8dad40242d00 0t0 39765 type=STREAM 2023-01-01T17:45:53.762 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus 7u sock 0,9 0t0 24719 protocol: NETLINK 2023-01-01T17:45:53.763 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus 8r REG 8,1 6940392 72551 /var/lib/sss/mc/group (deleted) 2023-01-01T17:45:53.763 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus 9u netlink 0t0 24720 SELINUX 2023-01-01T17:45:53.763 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus 10r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.763 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus 11u unix 0xffff8dad41993600 0t0 24725 type=STREAM 2023-01-01T17:45:53.763 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus 12u unix 0xffff8dad41995580 0t0 24726 type=STREAM 2023-01-01T17:45:53.763 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus 13u unix 0xffff8dad4034ec00 0t0 24727 /run/dbus/system_bus_socket type=STREAM 2023-01-01T17:45:53.763 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus 14u unix 0xffff8dad402be300 0t0 25685 /run/dbus/system_bus_socket type=STREAM 2023-01-01T17:45:53.763 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus 15u unix 0xffff8dad0403f500 0t0 20815 /run/dbus/system_bus_socket type=STREAM 2023-01-01T17:45:53.764 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus 16u unix 0xffff8dad427a3180 0t0 25706 type=DGRAM 2023-01-01T17:45:53.764 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus 17u unix 0xffff8dad40246780 0t0 25707 /run/dbus/system_bus_socket type=STREAM 2023-01-01T17:45:53.764 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus 18u unix 0xffff8dad40243180 0t0 31286 /run/dbus/system_bus_socket type=STREAM 2023-01-01T17:45:53.764 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus 21u unix 0xffff8dad09281200 0t0 25727 /run/dbus/system_bus_socket type=STREAM 2023-01-01T17:45:53.764 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus 22u unix 0xffff8dad402bd580 0t0 30451 /run/dbus/system_bus_socket type=STREAM 2023-01-01T17:45:53.764 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus 23u unix 0xffff8dad40ced100 0t0 31941 /run/dbus/system_bus_socket type=STREAM 2023-01-01T17:45:53.764 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus 24u unix 0xffff8dad40cea400 0t0 25884 /run/dbus/system_bus_socket type=STREAM 2023-01-01T17:45:53.765 INFO:teuthology.orchestra.run.smithi149.stdout:dbus-daem 838 953 dbus-daem dbus 25u unix 0xffff8dad41995a00 0t0 39764 /run/dbus/system_bus_socket type=STREAM 2023-01-01T17:45:53.765 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.765 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.765 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root txt REG 8,1 3633568 8777 /usr/sbin/NetworkManager 2023-01-01T17:45:53.765 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 306528 15293 /usr/lib64/NetworkManager/1.36.0-4.el8/libnm-settings-plugin-ifcfg-rh.so 2023-01-01T17:45:53.765 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-01-01T17:45:53.765 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 58896 5593 /usr/lib64/libjansson.so.4.14.0 2023-01-01T17:45:53.766 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 24416 10513 /usr/lib64/libteamdctl.so.0.1.5 2023-01-01T17:45:53.766 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 45512 15451 /usr/lib64/NetworkManager/1.36.0-4.el8/libnm-device-plugin-team.so 2023-01-01T17:45:53.766 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:53.766 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root DEL REG 8,1 68024 /var/lib/sss/mc/passwd 2023-01-01T17:45:53.766 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:53.766 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-01-01T17:45:53.766 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 37336 6241 /usr/lib64/libmodman.so.1.0.0 2023-01-01T17:45:53.767 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 144768 6243 /usr/lib64/libproxy.so.1.0.0 2023-01-01T17:45:53.767 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-01-01T17:45:53.767 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-01-01T17:45:53.767 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 134872 6493 /usr/lib64/libbrotlicommon.so.1.0.6 2023-01-01T17:45:53.767 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-01-01T17:45:53.767 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 125440 6685 /usr/lib64/libsasl2.so.3.0.0 2023-01-01T17:45:53.767 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-01-01T17:45:53.767 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-01-01T17:45:53.768 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:53.768 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:53.768 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:53.768 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:53.768 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-01-01T17:45:53.768 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-01-01T17:45:53.768 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:53.769 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 53560 6495 /usr/lib64/libbrotlidec.so.1.0.6 2023-01-01T17:45:53.769 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 67232 6713 /usr/lib64/liblber-2.4.so.2.10.9 2023-01-01T17:45:53.769 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 329184 6715 /usr/lib64/libldap-2.4.so.2.10.9 2023-01-01T17:45:53.769 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-01-01T17:45:53.769 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-01-01T17:45:53.769 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-01-01T17:45:53.769 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-01-01T17:45:53.769 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-01-01T17:45:53.770 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-01-01T17:45:53.770 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 69672 6678 /usr/lib64/libpsl.so.5.3.1 2023-01-01T17:45:53.770 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 464632 6709 /usr/lib64/libssh.so.4.8.7 2023-01-01T17:45:53.770 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 166888 6517 /usr/lib64/libnghttp2.so.14.17.0 2023-01-01T17:45:53.770 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-01-01T17:45:53.770 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:53.770 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:53.770 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:53.771 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:53.771 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:53.771 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:53.771 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:53.771 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-01-01T17:45:53.771 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-01-01T17:45:53.771 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-01-01T17:45:53.771 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-01-01T17:45:53.772 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-01-01T17:45:53.772 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-01-01T17:45:53.772 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-01-01T17:45:53.772 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.772 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:53.772 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:53.772 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:53.772 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-01-01T17:45:53.773 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-01-01T17:45:53.773 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-01-01T17:45:53.773 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-01-01T17:45:53.773 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 592304 6774 /usr/lib64/libcurl.so.4.5.0 2023-01-01T17:45:53.773 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-01-01T17:45:53.773 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:53.773 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 29040 6515 /usr/lib64/libndp.so.0.1.1 2023-01-01T17:45:53.774 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:53.774 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-01-01T17:45:53.774 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-01-01T17:45:53.774 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.774 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-01-01T17:45:53.774 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-01-01T17:45:53.775 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-01-01T17:45:53.775 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-01-01T17:45:53.775 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-01-01T17:45:53.775 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-01-01T17:45:53.775 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-01-01T17:45:53.775 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-01-01T17:45:53.776 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-01-01T17:45:53.776 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-01-01T17:45:53.776 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:53.776 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-01-01T17:45:53.776 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.776 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root 1u unix 0xffff8dad41992400 0t0 24617 type=STREAM 2023-01-01T17:45:53.776 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root 2u unix 0xffff8dad41992400 0t0 24617 type=STREAM 2023-01-01T17:45:53.777 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root 3u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.777 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root 4u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.777 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root 5u unix 0xffff8dad04039200 0t0 22930 type=DGRAM 2023-01-01T17:45:53.777 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root 6u unix 0xffff8dad0403ec00 0t0 22931 type=STREAM 2023-01-01T17:45:53.777 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root 7u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.777 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root 8r REG 0,4 0 4026532000 net 2023-01-01T17:45:53.778 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root 9r REG 0,4 0 4026532489 mnt 2023-01-01T17:45:53.778 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root 10u netlink 0t0 23005 KOBJECT_UEVENT 2023-01-01T17:45:53.778 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root 11u netlink 0t0 23006 GENERIC 2023-01-01T17:45:53.778 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root 12u netlink 0t0 23007 ROUTE 2023-01-01T17:45:53.778 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root 13r REG 8,1 9253600 68024 /var/lib/sss/mc/passwd (deleted) 2023-01-01T17:45:53.778 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root 14r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.778 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root 15r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.779 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root 16u netlink 0t0 23190 KOBJECT_UEVENT 2023-01-01T17:45:53.779 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root 17u unix 0xffff8dad09287980 0t0 19183 type=STREAM 2023-01-01T17:45:53.779 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root 18u a_inode 0,14 0 11447 [eventpoll] 2023-01-01T17:45:53.779 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root 19u a_inode 0,14 0 11447 [eventpoll] 2023-01-01T17:45:53.779 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root 20w FIFO 0,24 0t0 31934 /run/systemd/inhibit/1.ref 2023-01-01T17:45:53.779 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root 21u a_inode 0,14 0 11447 [timerfd] 2023-01-01T17:45:53.780 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root 22u pack 25881 0t0 IP type=SOCK_DGRAM 2023-01-01T17:45:53.780 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root 23u raw6 0t0 23409 00000000000000000000000000000000:003A->00000000000000000000000000000000:0000 st=07 2023-01-01T17:45:53.780 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 root 27u IPv4 23412 0t0 UDP smithi149.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-01-01T17:45:53.780 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.780 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.780 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root txt REG 8,1 3633568 8777 /usr/sbin/NetworkManager 2023-01-01T17:45:53.780 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 306528 15293 /usr/lib64/NetworkManager/1.36.0-4.el8/libnm-settings-plugin-ifcfg-rh.so 2023-01-01T17:45:53.781 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-01-01T17:45:53.781 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 58896 5593 /usr/lib64/libjansson.so.4.14.0 2023-01-01T17:45:53.781 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 24416 10513 /usr/lib64/libteamdctl.so.0.1.5 2023-01-01T17:45:53.781 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 45512 15451 /usr/lib64/NetworkManager/1.36.0-4.el8/libnm-device-plugin-team.so 2023-01-01T17:45:53.781 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:53.781 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root DEL REG 8,1 68024 /var/lib/sss/mc/passwd 2023-01-01T17:45:53.781 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:53.782 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-01-01T17:45:53.782 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 37336 6241 /usr/lib64/libmodman.so.1.0.0 2023-01-01T17:45:53.782 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 144768 6243 /usr/lib64/libproxy.so.1.0.0 2023-01-01T17:45:53.782 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-01-01T17:45:53.782 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-01-01T17:45:53.782 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 134872 6493 /usr/lib64/libbrotlicommon.so.1.0.6 2023-01-01T17:45:53.782 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-01-01T17:45:53.782 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 125440 6685 /usr/lib64/libsasl2.so.3.0.0 2023-01-01T17:45:53.783 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-01-01T17:45:53.783 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-01-01T17:45:53.783 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:53.783 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:53.783 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:53.783 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:53.783 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-01-01T17:45:53.784 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-01-01T17:45:53.784 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:53.784 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 53560 6495 /usr/lib64/libbrotlidec.so.1.0.6 2023-01-01T17:45:53.784 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 67232 6713 /usr/lib64/liblber-2.4.so.2.10.9 2023-01-01T17:45:53.784 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 329184 6715 /usr/lib64/libldap-2.4.so.2.10.9 2023-01-01T17:45:53.784 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-01-01T17:45:53.784 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-01-01T17:45:53.784 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-01-01T17:45:53.785 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-01-01T17:45:53.785 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-01-01T17:45:53.785 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-01-01T17:45:53.785 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 69672 6678 /usr/lib64/libpsl.so.5.3.1 2023-01-01T17:45:53.785 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 464632 6709 /usr/lib64/libssh.so.4.8.7 2023-01-01T17:45:53.785 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 166888 6517 /usr/lib64/libnghttp2.so.14.17.0 2023-01-01T17:45:53.785 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-01-01T17:45:53.786 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:53.786 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:53.786 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:53.786 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:53.786 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:53.786 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:53.786 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:53.786 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-01-01T17:45:53.787 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-01-01T17:45:53.787 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-01-01T17:45:53.787 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-01-01T17:45:53.787 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-01-01T17:45:53.787 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-01-01T17:45:53.787 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-01-01T17:45:53.787 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.787 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:53.788 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:53.788 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:53.788 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-01-01T17:45:53.788 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-01-01T17:45:53.788 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-01-01T17:45:53.788 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-01-01T17:45:53.788 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 592304 6774 /usr/lib64/libcurl.so.4.5.0 2023-01-01T17:45:53.788 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-01-01T17:45:53.789 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:53.789 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 29040 6515 /usr/lib64/libndp.so.0.1.1 2023-01-01T17:45:53.789 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:53.789 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-01-01T17:45:53.789 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-01-01T17:45:53.789 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.789 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-01-01T17:45:53.790 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-01-01T17:45:53.790 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-01-01T17:45:53.790 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-01-01T17:45:53.790 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-01-01T17:45:53.790 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-01-01T17:45:53.790 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-01-01T17:45:53.790 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-01-01T17:45:53.791 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-01-01T17:45:53.791 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-01-01T17:45:53.791 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:53.791 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-01-01T17:45:53.791 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.791 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root 1u unix 0xffff8dad41992400 0t0 24617 type=STREAM 2023-01-01T17:45:53.791 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root 2u unix 0xffff8dad41992400 0t0 24617 type=STREAM 2023-01-01T17:45:53.791 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root 3u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.792 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root 4u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.792 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root 5u unix 0xffff8dad04039200 0t0 22930 type=DGRAM 2023-01-01T17:45:53.792 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root 6u unix 0xffff8dad0403ec00 0t0 22931 type=STREAM 2023-01-01T17:45:53.792 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root 7u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.792 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root 8r REG 0,4 0 4026532000 net 2023-01-01T17:45:53.792 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root 9r REG 0,4 0 4026532489 mnt 2023-01-01T17:45:53.792 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root 10u netlink 0t0 23005 KOBJECT_UEVENT 2023-01-01T17:45:53.793 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root 11u netlink 0t0 23006 GENERIC 2023-01-01T17:45:53.793 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root 12u netlink 0t0 23007 ROUTE 2023-01-01T17:45:53.793 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root 13r REG 8,1 9253600 68024 /var/lib/sss/mc/passwd (deleted) 2023-01-01T17:45:53.793 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root 14r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.793 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root 15r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.793 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root 16u netlink 0t0 23190 KOBJECT_UEVENT 2023-01-01T17:45:53.793 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root 17u unix 0xffff8dad09287980 0t0 19183 type=STREAM 2023-01-01T17:45:53.793 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root 18u a_inode 0,14 0 11447 [eventpoll] 2023-01-01T17:45:53.794 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root 19u a_inode 0,14 0 11447 [eventpoll] 2023-01-01T17:45:53.794 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root 20w FIFO 0,24 0t0 31934 /run/systemd/inhibit/1.ref 2023-01-01T17:45:53.794 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root 21u a_inode 0,14 0 11447 [timerfd] 2023-01-01T17:45:53.794 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root 22u pack 25881 0t0 IP type=SOCK_DGRAM 2023-01-01T17:45:53.794 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root 23u raw6 0t0 23409 00000000000000000000000000000000:003A->00000000000000000000000000000000:0000 st=07 2023-01-01T17:45:53.794 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 960 gmain root 27u IPv4 23412 0t0 UDP smithi149.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-01-01T17:45:53.794 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.795 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.795 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root txt REG 8,1 3633568 8777 /usr/sbin/NetworkManager 2023-01-01T17:45:53.795 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 306528 15293 /usr/lib64/NetworkManager/1.36.0-4.el8/libnm-settings-plugin-ifcfg-rh.so 2023-01-01T17:45:53.795 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-01-01T17:45:53.795 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 58896 5593 /usr/lib64/libjansson.so.4.14.0 2023-01-01T17:45:53.795 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 24416 10513 /usr/lib64/libteamdctl.so.0.1.5 2023-01-01T17:45:53.795 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 45512 15451 /usr/lib64/NetworkManager/1.36.0-4.el8/libnm-device-plugin-team.so 2023-01-01T17:45:53.796 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:53.796 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root DEL REG 8,1 68024 /var/lib/sss/mc/passwd 2023-01-01T17:45:53.796 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:53.796 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-01-01T17:45:53.796 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 37336 6241 /usr/lib64/libmodman.so.1.0.0 2023-01-01T17:45:53.796 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 144768 6243 /usr/lib64/libproxy.so.1.0.0 2023-01-01T17:45:53.796 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-01-01T17:45:53.796 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-01-01T17:45:53.797 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 134872 6493 /usr/lib64/libbrotlicommon.so.1.0.6 2023-01-01T17:45:53.797 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-01-01T17:45:53.797 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 125440 6685 /usr/lib64/libsasl2.so.3.0.0 2023-01-01T17:45:53.797 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-01-01T17:45:53.797 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-01-01T17:45:53.797 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:53.797 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:53.797 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:53.798 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:53.798 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-01-01T17:45:53.798 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-01-01T17:45:53.798 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:53.798 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 53560 6495 /usr/lib64/libbrotlidec.so.1.0.6 2023-01-01T17:45:53.798 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 67232 6713 /usr/lib64/liblber-2.4.so.2.10.9 2023-01-01T17:45:53.798 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 329184 6715 /usr/lib64/libldap-2.4.so.2.10.9 2023-01-01T17:45:53.799 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-01-01T17:45:53.799 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-01-01T17:45:53.799 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-01-01T17:45:53.799 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-01-01T17:45:53.799 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-01-01T17:45:53.799 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-01-01T17:45:53.799 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 69672 6678 /usr/lib64/libpsl.so.5.3.1 2023-01-01T17:45:53.799 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 464632 6709 /usr/lib64/libssh.so.4.8.7 2023-01-01T17:45:53.800 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 166888 6517 /usr/lib64/libnghttp2.so.14.17.0 2023-01-01T17:45:53.800 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-01-01T17:45:53.800 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:53.800 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:53.800 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:53.800 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:53.800 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:53.801 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:53.801 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:53.801 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-01-01T17:45:53.801 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-01-01T17:45:53.801 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-01-01T17:45:53.801 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-01-01T17:45:53.801 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-01-01T17:45:53.802 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-01-01T17:45:53.802 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-01-01T17:45:53.802 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.802 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:53.802 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:53.802 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:53.802 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-01-01T17:45:53.803 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-01-01T17:45:53.803 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-01-01T17:45:53.803 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-01-01T17:45:53.803 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 592304 6774 /usr/lib64/libcurl.so.4.5.0 2023-01-01T17:45:53.803 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-01-01T17:45:53.803 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:53.803 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 29040 6515 /usr/lib64/libndp.so.0.1.1 2023-01-01T17:45:53.804 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:53.804 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-01-01T17:45:53.804 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-01-01T17:45:53.804 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.804 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-01-01T17:45:53.804 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-01-01T17:45:53.804 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-01-01T17:45:53.805 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-01-01T17:45:53.805 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-01-01T17:45:53.805 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-01-01T17:45:53.805 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-01-01T17:45:53.805 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-01-01T17:45:53.805 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-01-01T17:45:53.805 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-01-01T17:45:53.806 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:53.806 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-01-01T17:45:53.806 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.806 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root 1u unix 0xffff8dad41992400 0t0 24617 type=STREAM 2023-01-01T17:45:53.806 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root 2u unix 0xffff8dad41992400 0t0 24617 type=STREAM 2023-01-01T17:45:53.806 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root 3u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.806 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root 4u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.807 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root 5u unix 0xffff8dad04039200 0t0 22930 type=DGRAM 2023-01-01T17:45:53.807 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root 6u unix 0xffff8dad0403ec00 0t0 22931 type=STREAM 2023-01-01T17:45:53.807 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root 7u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.807 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root 8r REG 0,4 0 4026532000 net 2023-01-01T17:45:53.807 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root 9r REG 0,4 0 4026532489 mnt 2023-01-01T17:45:53.808 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root 10u netlink 0t0 23005 KOBJECT_UEVENT 2023-01-01T17:45:53.808 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root 11u netlink 0t0 23006 GENERIC 2023-01-01T17:45:53.808 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root 12u netlink 0t0 23007 ROUTE 2023-01-01T17:45:53.808 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root 13r REG 8,1 9253600 68024 /var/lib/sss/mc/passwd (deleted) 2023-01-01T17:45:53.808 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root 14r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.808 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root 15r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.808 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root 16u netlink 0t0 23190 KOBJECT_UEVENT 2023-01-01T17:45:53.808 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root 17u unix 0xffff8dad09287980 0t0 19183 type=STREAM 2023-01-01T17:45:53.809 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root 18u a_inode 0,14 0 11447 [eventpoll] 2023-01-01T17:45:53.809 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root 19u a_inode 0,14 0 11447 [eventpoll] 2023-01-01T17:45:53.809 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root 20w FIFO 0,24 0t0 31934 /run/systemd/inhibit/1.ref 2023-01-01T17:45:53.809 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root 21u a_inode 0,14 0 11447 [timerfd] 2023-01-01T17:45:53.809 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root 22u pack 25881 0t0 IP type=SOCK_DGRAM 2023-01-01T17:45:53.809 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root 23u raw6 0t0 23409 00000000000000000000000000000000:003A->00000000000000000000000000000000:0000 st=07 2023-01-01T17:45:53.809 INFO:teuthology.orchestra.run.smithi149.stdout:NetworkMa 839 961 gdbus root 27u IPv4 23412 0t0 UDP smithi149.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-01-01T17:45:53.810 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.810 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.810 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph txt REG 8,1 11856 6728 /usr/libexec/platform-python3.6 2023-01-01T17:45:53.810 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph DEL REG 8,1 72551 /var/lib/sss/mc/group 2023-01-01T17:45:53.810 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph mem REG 8,1 20688 37502 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:53.810 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph mem REG 8,1 29256 37524 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:53.810 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph mem REG 8,1 63456 37516 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:53.811 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph mem REG 8,1 92992 37505 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:53.811 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph mem REG 8,1 13208 37515 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:53.811 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph mem REG 8,1 56768 37508 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:53.811 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph mem REG 8,1 27128 37493 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:53.811 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:53.811 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph DEL REG 8,1 68024 /var/lib/sss/mc/passwd 2023-01-01T17:45:53.811 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:53.812 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-01-01T17:45:53.812 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:53.812 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.812 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-01-01T17:45:53.812 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-01-01T17:45:53.812 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:53.813 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:53.813 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph mem REG 8,1 3285488 6697 /usr/lib64/libpython3.6m.so.1.0 2023-01-01T17:45:53.813 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-01-01T17:45:53.813 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.813 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-01-01T17:45:53.813 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-01-01T17:45:53.813 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-01-01T17:45:53.813 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-01-01T17:45:53.814 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-01-01T17:45:53.814 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-01-01T17:45:53.814 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-01-01T17:45:53.814 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-01-01T17:45:53.814 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-01-01T17:45:53.814 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-01-01T17:45:53.815 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:53.815 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-01-01T17:45:53.815 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.815 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph 1u unix 0xffff8dad403b8900 0t0 20671 type=STREAM 2023-01-01T17:45:53.815 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph 2u unix 0xffff8dad403b8900 0t0 20671 type=STREAM 2023-01-01T17:45:53.815 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph 3r REG 8,1 9253600 68024 /var/lib/sss/mc/passwd (deleted) 2023-01-01T17:45:53.815 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-cras 841 ceph 4r REG 8,1 6940392 72551 /var/lib/sss/mc/group (deleted) 2023-01-01T17:45:53.815 INFO:teuthology.orchestra.run.smithi149.stdout:mcelog 842 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.816 INFO:teuthology.orchestra.run.smithi149.stdout:mcelog 842 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.816 INFO:teuthology.orchestra.run.smithi149.stdout:mcelog 842 root txt REG 8,1 185992 11073 /usr/sbin/mcelog 2023-01-01T17:45:53.816 INFO:teuthology.orchestra.run.smithi149.stdout:mcelog 842 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:53.816 INFO:teuthology.orchestra.run.smithi149.stdout:mcelog 842 root DEL REG 8,1 68024 /var/lib/sss/mc/passwd 2023-01-01T17:45:53.816 INFO:teuthology.orchestra.run.smithi149.stdout:mcelog 842 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:53.816 INFO:teuthology.orchestra.run.smithi149.stdout:mcelog 842 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.816 INFO:teuthology.orchestra.run.smithi149.stdout:mcelog 842 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.817 INFO:teuthology.orchestra.run.smithi149.stdout:mcelog 842 root 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.817 INFO:teuthology.orchestra.run.smithi149.stdout:mcelog 842 root 1u unix 0xffff8dad4034f080 0t0 22701 type=STREAM 2023-01-01T17:45:53.817 INFO:teuthology.orchestra.run.smithi149.stdout:mcelog 842 root 2u unix 0xffff8dad4034f080 0t0 22701 type=STREAM 2023-01-01T17:45:53.817 INFO:teuthology.orchestra.run.smithi149.stdout:mcelog 842 root 3r CHR 10,227 0t0 16395 /dev/mcelog 2023-01-01T17:45:53.817 INFO:teuthology.orchestra.run.smithi149.stdout:mcelog 842 root 4r REG 8,1 9253600 68024 /var/lib/sss/mc/passwd (deleted) 2023-01-01T17:45:53.817 INFO:teuthology.orchestra.run.smithi149.stdout:mcelog 842 root 5u unix 0xffff8dad4034b180 0t0 22835 /var/run/mcelog-client type=STREAM 2023-01-01T17:45:53.817 INFO:teuthology.orchestra.run.smithi149.stdout:lsmd 849 libstoragemgmt cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.818 INFO:teuthology.orchestra.run.smithi149.stdout:lsmd 849 libstoragemgmt rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.818 INFO:teuthology.orchestra.run.smithi149.stdout:lsmd 849 libstoragemgmt txt REG 8,1 25472 9470 /usr/bin/lsmd 2023-01-01T17:45:53.818 INFO:teuthology.orchestra.run.smithi149.stdout:lsmd 849 libstoragemgmt mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:53.818 INFO:teuthology.orchestra.run.smithi149.stdout:lsmd 849 libstoragemgmt DEL REG 8,1 68024 /var/lib/sss/mc/passwd 2023-01-01T17:45:53.818 INFO:teuthology.orchestra.run.smithi149.stdout:lsmd 849 libstoragemgmt mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:53.818 INFO:teuthology.orchestra.run.smithi149.stdout:lsmd 849 libstoragemgmt mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.818 INFO:teuthology.orchestra.run.smithi149.stdout:lsmd 849 libstoragemgmt mem REG 8,1 54680 6239 /usr/lib64/libconfig.so.9.2.0 2023-01-01T17:45:53.818 INFO:teuthology.orchestra.run.smithi149.stdout:lsmd 849 libstoragemgmt mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.819 INFO:teuthology.orchestra.run.smithi149.stdout:lsmd 849 libstoragemgmt 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.819 INFO:teuthology.orchestra.run.smithi149.stdout:lsmd 849 libstoragemgmt 1u unix 0xffff8dad09283f00 0t0 18942 type=STREAM 2023-01-01T17:45:53.819 INFO:teuthology.orchestra.run.smithi149.stdout:lsmd 849 libstoragemgmt 2u unix 0xffff8dad09284800 0t0 18943 type=STREAM 2023-01-01T17:45:53.819 INFO:teuthology.orchestra.run.smithi149.stdout:lsmd 849 libstoragemgmt 3uW REG 0,24 0 22823 /run/lsm/ipc/.lsmd-ipc-lock 2023-01-01T17:45:53.819 INFO:teuthology.orchestra.run.smithi149.stdout:lsmd 849 libstoragemgmt 4r REG 8,1 9253600 68024 /var/lib/sss/mc/passwd (deleted) 2023-01-01T17:45:53.819 INFO:teuthology.orchestra.run.smithi149.stdout:lsmd 849 libstoragemgmt 5u unix 0xffff8dad4034ad00 0t0 22824 /var/run/lsm/ipc/sim type=STREAM 2023-01-01T17:45:53.819 INFO:teuthology.orchestra.run.smithi149.stdout:lsmd 849 libstoragemgmt 6u unix 0xffff8dad40348900 0t0 22826 /var/run/lsm/ipc/simc type=STREAM 2023-01-01T17:45:53.820 INFO:teuthology.orchestra.run.smithi149.stdout:smartd 850 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.820 INFO:teuthology.orchestra.run.smithi149.stdout:smartd 850 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.820 INFO:teuthology.orchestra.run.smithi149.stdout:smartd 850 root txt REG 8,1 718504 11142 /usr/sbin/smartd 2023-01-01T17:45:53.820 INFO:teuthology.orchestra.run.smithi149.stdout:smartd 850 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:53.820 INFO:teuthology.orchestra.run.smithi149.stdout:smartd 850 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:53.820 INFO:teuthology.orchestra.run.smithi149.stdout:smartd 850 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:53.820 INFO:teuthology.orchestra.run.smithi149.stdout:smartd 850 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:53.821 INFO:teuthology.orchestra.run.smithi149.stdout:smartd 850 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:53.821 INFO:teuthology.orchestra.run.smithi149.stdout:smartd 850 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:53.821 INFO:teuthology.orchestra.run.smithi149.stdout:smartd 850 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:53.821 INFO:teuthology.orchestra.run.smithi149.stdout:smartd 850 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:53.821 INFO:teuthology.orchestra.run.smithi149.stdout:smartd 850 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:53.821 INFO:teuthology.orchestra.run.smithi149.stdout:smartd 850 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:53.821 INFO:teuthology.orchestra.run.smithi149.stdout:smartd 850 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:53.822 INFO:teuthology.orchestra.run.smithi149.stdout:smartd 850 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:53.822 INFO:teuthology.orchestra.run.smithi149.stdout:smartd 850 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.822 INFO:teuthology.orchestra.run.smithi149.stdout:smartd 850 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:53.822 INFO:teuthology.orchestra.run.smithi149.stdout:smartd 850 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-01-01T17:45:53.822 INFO:teuthology.orchestra.run.smithi149.stdout:smartd 850 root mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-01-01T17:45:53.822 INFO:teuthology.orchestra.run.smithi149.stdout:smartd 850 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:53.822 INFO:teuthology.orchestra.run.smithi149.stdout:smartd 850 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:53.822 INFO:teuthology.orchestra.run.smithi149.stdout:smartd 850 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-01-01T17:45:53.823 INFO:teuthology.orchestra.run.smithi149.stdout:smartd 850 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.823 INFO:teuthology.orchestra.run.smithi149.stdout:smartd 850 root 0u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.823 INFO:teuthology.orchestra.run.smithi149.stdout:smartd 850 root 1u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.823 INFO:teuthology.orchestra.run.smithi149.stdout:smartd 850 root 2u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.823 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.823 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.823 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root txt REG 8,1 83544 10536 /usr/sbin/sssd 2023-01-01T17:45:53.824 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-01-01T17:45:53.824 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root DEL REG 8,1 68197 /var/lib/sss/mc/initgroups 2023-01-01T17:45:53.824 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root DEL REG 8,1 68024 /var/lib/sss/mc/passwd 2023-01-01T17:45:53.824 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:53.824 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 4644864 66476 /var/lib/sss/db/timestamps_implicit_files.ldb 2023-01-01T17:45:53.824 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 6459392 66474 /var/lib/sss/db/cache_implicit_files.ldb 2023-01-01T17:45:53.824 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-01-01T17:45:53.825 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:53.825 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 7536 40251 /usr/lib64/ldb/modules/ldb/tdb.so 2023-01-01T17:45:53.825 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 11816 40250 /usr/lib64/ldb/modules/ldb/skel.so 2023-01-01T17:45:53.825 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 15896 40249 /usr/lib64/ldb/modules/ldb/server_sort.so 2023-01-01T17:45:53.825 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 11992 40248 /usr/lib64/ldb/modules/ldb/sample.so 2023-01-01T17:45:53.825 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 15952 40247 /usr/lib64/ldb/modules/ldb/rdn_name.so 2023-01-01T17:45:53.825 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 16008 40246 /usr/lib64/ldb/modules/ldb/paged_searches.so 2023-01-01T17:45:53.826 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 71048 41592 /usr/lib64/ldb/modules/ldb/memberof.so 2023-01-01T17:45:53.826 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 7544 40245 /usr/lib64/ldb/modules/ldb/mdb.so 2023-01-01T17:45:53.826 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 91808 6558 /usr/lib64/liblmdb.so.0.0.0 2023-01-01T17:45:53.826 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 12440 40238 /usr/lib64/ldb/libldb-tdb-err-map.so 2023-01-01T17:45:53.826 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 95464 40236 /usr/lib64/ldb/libldb-key-value.so 2023-01-01T17:45:53.826 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 24744 40237 /usr/lib64/ldb/libldb-mdb-int.so 2023-01-01T17:45:53.827 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 25008 40239 /usr/lib64/ldb/libldb-tdb-int.so 2023-01-01T17:45:53.827 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 7648 40244 /usr/lib64/ldb/modules/ldb/ldb.so 2023-01-01T17:45:53.827 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-01-01T17:45:53.827 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-01-01T17:45:53.827 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-01-01T17:45:53.827 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-01-01T17:45:53.827 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-01-01T17:45:53.828 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-01-01T17:45:53.828 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-01-01T17:45:53.828 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 125440 6685 /usr/lib64/libsasl2.so.3.0.0 2023-01-01T17:45:53.828 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:53.828 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 67232 6713 /usr/lib64/liblber-2.4.so.2.10.9 2023-01-01T17:45:53.828 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 329184 6715 /usr/lib64/libldap-2.4.so.2.10.9 2023-01-01T17:45:53.828 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 28888 40243 /usr/lib64/ldb/modules/ldb/ldap.so 2023-01-01T17:45:53.829 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 15928 40242 /usr/lib64/ldb/modules/ldb/asq.so 2023-01-01T17:45:53.829 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:53.829 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:53.829 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:53.829 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:53.829 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:53.830 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:53.830 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:53.830 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:53.830 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:53.830 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:53.830 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 16160 5902 /usr/lib64/libpath_utils.so.1.0.1 2023-01-01T17:45:53.830 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:53.830 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:53.831 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.831 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-01-01T17:45:53.831 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-01-01T17:45:53.831 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 87544 5208 /usr/lib64/libtalloc.so.2.3.3 2023-01-01T17:45:53.831 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 87792 5290 /usr/lib64/libtevent.so.0.11.0 2023-01-01T17:45:53.831 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 16216 5346 /usr/lib64/libdhash.so.1.1.0 2023-01-01T17:45:53.831 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 262080 32126 /usr/lib64/sssd/libsss_sbus.so 2023-01-01T17:45:53.832 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 148360 32122 /usr/lib64/sssd/libsss_iface.so 2023-01-01T17:45:53.832 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:53.832 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 24880 32120 /usr/lib64/sssd/libsss_debug.so 2023-01-01T17:45:53.832 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-01-01T17:45:53.832 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 24240 32118 /usr/lib64/sssd/libsss_child.so 2023-01-01T17:45:53.832 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 24752 32119 /usr/lib64/sssd/libsss_crypt.so 2023-01-01T17:45:53.832 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 20440 32117 /usr/lib64/sssd/libsss_cert.so 2023-01-01T17:45:53.833 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 55560 5344 /usr/lib64/libcollection.so.4.1.1 2023-01-01T17:45:53.833 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 12024 5348 /usr/lib64/libref_array.so.1.2.1 2023-01-01T17:45:53.833 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 11848 5342 /usr/lib64/libbasicobjects.so.0.1.0 2023-01-01T17:45:53.833 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 117048 5904 /usr/lib64/libini_config.so.5.2.1 2023-01-01T17:45:53.833 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:53.833 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 100496 5296 /usr/lib64/libtdb.so.1.4.4 2023-01-01T17:45:53.833 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:53.834 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 220240 8334 /usr/lib64/libldb.so.2.4.1 2023-01-01T17:45:53.834 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-01-01T17:45:53.834 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:53.834 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 568304 32130 /usr/lib64/sssd/libsss_util.so 2023-01-01T17:45:53.834 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-01-01T17:45:53.834 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 147336 5439 /usr/lib64/libnl-3.so.200.26.0 2023-01-01T17:45:53.834 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 549824 5447 /usr/lib64/libnl-route-3.so.200.26.0 2023-01-01T17:45:53.834 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.835 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-01-01T17:45:53.835 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-01-01T17:45:53.835 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-01-01T17:45:53.835 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-01-01T17:45:53.835 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-01-01T17:45:53.835 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-01-01T17:45:53.835 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-01-01T17:45:53.836 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-01-01T17:45:53.836 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-01-01T17:45:53.836 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-01-01T17:45:53.836 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 1286144 66412 /var/lib/sss/db/config.ldb 2023-01-01T17:45:53.836 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-01-01T17:45:53.836 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:53.836 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root 0r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.836 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root 1u unix 0xffff8dad09285e80 0t0 19004 type=STREAM 2023-01-01T17:45:53.837 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root 2u unix 0xffff8dad09285e80 0t0 19004 type=STREAM 2023-01-01T17:45:53.837 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root 3w REG 8,1 7728 66780 /var/log/sssd/sssd.log 2023-01-01T17:45:53.837 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root 4u a_inode 0,14 0 11447 [eventpoll] 2023-01-01T17:45:53.837 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root 5u REG 8,1 1286144 66412 /var/lib/sss/db/config.ldb 2023-01-01T17:45:53.837 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root 6u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.837 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root 7u a_inode 0,14 0 11447 [eventpoll] 2023-01-01T17:45:53.838 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root 8u unix 0xffff8dad41997980 0t0 24749 type=DGRAM 2023-01-01T17:45:53.838 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root 9u REG 8,1 6459392 66474 /var/lib/sss/db/cache_implicit_files.ldb 2023-01-01T17:45:53.838 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root 10u a_inode 0,14 0 11447 [eventpoll] 2023-01-01T17:45:53.838 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root 11u REG 8,1 4644864 66476 /var/lib/sss/db/timestamps_implicit_files.ldb 2023-01-01T17:45:53.838 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root 12u unix 0xffff8dad41990900 0t0 24750 /var/lib/sss/pipes/private/sbus-monitor type=STREAM 2023-01-01T17:45:53.838 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root 13u unix 0xffff8dad41992d00 0t0 24751 type=STREAM 2023-01-01T17:45:53.838 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root 14u unix 0xffff8dad41996300 0t0 24752 /var/lib/sss/pipes/private/sbus-monitor type=STREAM 2023-01-01T17:45:53.839 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root 15r REG 8,1 9253600 68024 /var/lib/sss/mc/passwd (deleted) 2023-01-01T17:45:53.839 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root 16r REG 8,1 11567160 68197 /var/lib/sss/mc/initgroups (deleted) 2023-01-01T17:45:53.839 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root 17u netlink 0t0 24758 ROUTE 2023-01-01T17:45:53.839 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root 18u unix 0xffff8dad41990d80 0t0 14332 /var/lib/sss/pipes/private/sbus-monitor type=STREAM 2023-01-01T17:45:53.839 INFO:teuthology.orchestra.run.smithi149.stdout:sssd 851 root 19u unix 0xffff8dad40241200 0t0 30767 /var/lib/sss/pipes/private/sbus-monitor type=STREAM 2023-01-01T17:45:53.839 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.839 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.839 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-01-01T17:45:53.840 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-01-01T17:45:53.840 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd DEL REG 8,1 68197 /var/lib/sss/mc/initgroups 2023-01-01T17:45:53.840 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:53.840 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd DEL REG 8,1 68024 /var/lib/sss/mc/passwd 2023-01-01T17:45:53.840 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:53.840 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:53.840 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:53.840 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:53.841 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:53.841 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-01-01T17:45:53.841 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-01-01T17:45:53.841 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-01-01T17:45:53.841 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-01-01T17:45:53.841 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-01-01T17:45:53.841 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-01-01T17:45:53.842 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-01-01T17:45:53.842 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-01-01T17:45:53.842 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:53.842 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:53.842 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:53.842 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:53.842 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:53.843 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:53.843 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:53.843 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:53.843 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:53.843 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-01-01T17:45:53.843 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-01-01T17:45:53.843 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:53.844 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-01-01T17:45:53.844 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-01-01T17:45:53.844 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.844 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:53.844 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:53.844 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-01-01T17:45:53.844 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-01-01T17:45:53.844 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-01-01T17:45:53.845 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:53.845 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-01-01T17:45:53.845 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-01-01T17:45:53.845 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-01-01T17:45:53.845 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-01-01T17:45:53.845 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.845 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:53.845 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd 0u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.846 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd 1u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.846 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd 2u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.846 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd 3r REG 8,1 9253600 68024 /var/lib/sss/mc/passwd (deleted) 2023-01-01T17:45:53.846 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd 4r REG 8,1 11567160 68197 /var/lib/sss/mc/initgroups (deleted) 2023-01-01T17:45:53.846 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd 5r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.846 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd 6u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.846 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd 7u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.847 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd 8u unix 0xffff8dad40240000 0t0 14240 type=STREAM 2023-01-01T17:45:53.847 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd 9u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.847 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd 10r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.847 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd 11u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.847 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 polkitd 12u unix 0xffff8dad0403de80 0t0 23191 type=DGRAM 2023-01-01T17:45:53.847 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.847 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.847 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-01-01T17:45:53.848 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-01-01T17:45:53.848 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd DEL REG 8,1 68197 /var/lib/sss/mc/initgroups 2023-01-01T17:45:53.848 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:53.848 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd DEL REG 8,1 68024 /var/lib/sss/mc/passwd 2023-01-01T17:45:53.848 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:53.848 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:53.848 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:53.848 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:53.849 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:53.849 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-01-01T17:45:53.849 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-01-01T17:45:53.849 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-01-01T17:45:53.849 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-01-01T17:45:53.849 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-01-01T17:45:53.849 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-01-01T17:45:53.850 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-01-01T17:45:53.850 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-01-01T17:45:53.850 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:53.850 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:53.850 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:53.850 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:53.852 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:53.852 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:53.852 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:53.852 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:53.853 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:53.853 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-01-01T17:45:53.853 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-01-01T17:45:53.853 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:53.853 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-01-01T17:45:53.853 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-01-01T17:45:53.853 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.854 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:53.854 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:53.854 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-01-01T17:45:53.854 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-01-01T17:45:53.854 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-01-01T17:45:53.854 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:53.854 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-01-01T17:45:53.854 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-01-01T17:45:53.855 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-01-01T17:45:53.855 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-01-01T17:45:53.855 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.855 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:53.855 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd 0u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.855 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd 1u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.855 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd 2u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.856 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd 3r REG 8,1 9253600 68024 /var/lib/sss/mc/passwd (deleted) 2023-01-01T17:45:53.856 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd 4r REG 8,1 11567160 68197 /var/lib/sss/mc/initgroups (deleted) 2023-01-01T17:45:53.856 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd 5r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.856 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd 6u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.856 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd 7u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.856 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd 8u unix 0xffff8dad40240000 0t0 14240 type=STREAM 2023-01-01T17:45:53.857 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd 9u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.857 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd 10r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.857 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd 11u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.857 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 970 gmain polkitd 12u unix 0xffff8dad0403de80 0t0 23191 type=DGRAM 2023-01-01T17:45:53.857 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.857 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.857 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-01-01T17:45:53.858 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-01-01T17:45:53.858 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd DEL REG 8,1 68197 /var/lib/sss/mc/initgroups 2023-01-01T17:45:53.858 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:53.858 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd DEL REG 8,1 68024 /var/lib/sss/mc/passwd 2023-01-01T17:45:53.858 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:53.858 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:53.858 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:53.858 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:53.859 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:53.859 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-01-01T17:45:53.859 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-01-01T17:45:53.859 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-01-01T17:45:53.859 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-01-01T17:45:53.859 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-01-01T17:45:53.859 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-01-01T17:45:53.860 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-01-01T17:45:53.860 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-01-01T17:45:53.860 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:53.860 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:53.860 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:53.860 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:53.860 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:53.860 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:53.861 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:53.861 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:53.861 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:53.861 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-01-01T17:45:53.861 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-01-01T17:45:53.861 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:53.862 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-01-01T17:45:53.862 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-01-01T17:45:53.862 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.862 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:53.862 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:53.862 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-01-01T17:45:53.862 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-01-01T17:45:53.862 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-01-01T17:45:53.863 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:53.863 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-01-01T17:45:53.863 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-01-01T17:45:53.863 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-01-01T17:45:53.863 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-01-01T17:45:53.863 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.863 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:53.864 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd 0u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.864 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd 1u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.864 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd 2u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.864 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd 3r REG 8,1 9253600 68024 /var/lib/sss/mc/passwd (deleted) 2023-01-01T17:45:53.864 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd 4r REG 8,1 11567160 68197 /var/lib/sss/mc/initgroups (deleted) 2023-01-01T17:45:53.864 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd 5r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.864 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd 6u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.865 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd 7u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.865 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd 8u unix 0xffff8dad40240000 0t0 14240 type=STREAM 2023-01-01T17:45:53.865 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd 9u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.865 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd 10r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.865 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd 11u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.865 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 971 gdbus polkitd 12u unix 0xffff8dad0403de80 0t0 23191 type=DGRAM 2023-01-01T17:45:53.865 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.865 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.866 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-01-01T17:45:53.866 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-01-01T17:45:53.866 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd DEL REG 8,1 68197 /var/lib/sss/mc/initgroups 2023-01-01T17:45:53.866 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:53.866 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd DEL REG 8,1 68024 /var/lib/sss/mc/passwd 2023-01-01T17:45:53.866 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:53.867 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:53.867 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:53.867 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:53.867 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:53.867 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-01-01T17:45:53.867 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-01-01T17:45:53.867 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-01-01T17:45:53.868 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-01-01T17:45:53.868 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-01-01T17:45:53.868 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-01-01T17:45:53.868 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-01-01T17:45:53.868 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-01-01T17:45:53.868 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:53.868 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:53.868 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:53.869 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:53.869 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:53.869 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:53.869 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:53.869 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:53.869 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:53.869 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-01-01T17:45:53.870 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-01-01T17:45:53.870 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:53.870 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-01-01T17:45:53.870 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-01-01T17:45:53.870 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.870 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:53.870 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:53.870 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-01-01T17:45:53.871 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-01-01T17:45:53.871 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-01-01T17:45:53.871 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:53.871 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-01-01T17:45:53.871 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-01-01T17:45:53.871 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-01-01T17:45:53.871 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-01-01T17:45:53.871 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.872 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:53.872 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd 0u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.872 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd 1u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.872 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd 2u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.872 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd 3r REG 8,1 9253600 68024 /var/lib/sss/mc/passwd (deleted) 2023-01-01T17:45:53.872 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd 4r REG 8,1 11567160 68197 /var/lib/sss/mc/initgroups (deleted) 2023-01-01T17:45:53.872 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd 5r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.873 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd 6u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.873 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd 7u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.873 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd 8u unix 0xffff8dad40240000 0t0 14240 type=STREAM 2023-01-01T17:45:53.873 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd 9u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.873 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd 10r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.873 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd 11u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.873 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 976 JS\x20Hel polkitd 12u unix 0xffff8dad0403de80 0t0 23191 type=DGRAM 2023-01-01T17:45:53.874 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.874 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.874 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-01-01T17:45:53.874 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-01-01T17:45:53.874 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd DEL REG 8,1 68197 /var/lib/sss/mc/initgroups 2023-01-01T17:45:53.874 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:53.874 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd DEL REG 8,1 68024 /var/lib/sss/mc/passwd 2023-01-01T17:45:53.875 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:53.875 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:53.875 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:53.875 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:53.875 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:53.875 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-01-01T17:45:53.875 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-01-01T17:45:53.876 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-01-01T17:45:53.876 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-01-01T17:45:53.876 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-01-01T17:45:53.876 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-01-01T17:45:53.876 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-01-01T17:45:53.876 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-01-01T17:45:53.876 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:53.877 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:53.877 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:53.877 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:53.877 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:53.877 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:53.877 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:53.877 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:53.878 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:53.878 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-01-01T17:45:53.878 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-01-01T17:45:53.878 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:53.878 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-01-01T17:45:53.878 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-01-01T17:45:53.878 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.879 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:53.879 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:53.879 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-01-01T17:45:53.879 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-01-01T17:45:53.879 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-01-01T17:45:53.879 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:53.880 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-01-01T17:45:53.880 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-01-01T17:45:53.880 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-01-01T17:45:53.880 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-01-01T17:45:53.880 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.880 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:53.880 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd 0u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.881 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd 1u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.881 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd 2u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.881 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd 3r REG 8,1 9253600 68024 /var/lib/sss/mc/passwd (deleted) 2023-01-01T17:45:53.881 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd 4r REG 8,1 11567160 68197 /var/lib/sss/mc/initgroups (deleted) 2023-01-01T17:45:53.881 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd 5r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.881 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd 6u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.881 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd 7u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.882 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd 8u unix 0xffff8dad40240000 0t0 14240 type=STREAM 2023-01-01T17:45:53.882 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd 9u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.882 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd 10r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.882 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd 11u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.882 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 977 JS\x20Hel polkitd 12u unix 0xffff8dad0403de80 0t0 23191 type=DGRAM 2023-01-01T17:45:53.882 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.882 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.883 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-01-01T17:45:53.883 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-01-01T17:45:53.883 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd DEL REG 8,1 68197 /var/lib/sss/mc/initgroups 2023-01-01T17:45:53.883 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:53.883 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd DEL REG 8,1 68024 /var/lib/sss/mc/passwd 2023-01-01T17:45:53.883 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:53.883 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:53.883 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:53.884 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:53.884 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:53.884 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-01-01T17:45:53.884 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-01-01T17:45:53.884 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-01-01T17:45:53.884 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-01-01T17:45:53.884 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-01-01T17:45:53.885 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-01-01T17:45:53.885 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-01-01T17:45:53.885 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-01-01T17:45:53.885 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:53.885 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:53.885 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:53.885 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:53.886 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:53.886 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:53.886 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:53.886 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:53.886 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:53.886 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-01-01T17:45:53.886 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-01-01T17:45:53.887 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:53.887 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-01-01T17:45:53.887 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-01-01T17:45:53.887 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.887 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:53.887 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:53.887 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-01-01T17:45:53.888 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-01-01T17:45:53.888 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-01-01T17:45:53.888 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:53.888 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-01-01T17:45:53.888 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-01-01T17:45:53.888 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-01-01T17:45:53.888 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-01-01T17:45:53.888 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.889 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:53.889 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd 0u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.889 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd 1u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.889 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd 2u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.889 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd 3r REG 8,1 9253600 68024 /var/lib/sss/mc/passwd (deleted) 2023-01-01T17:45:53.889 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd 4r REG 8,1 11567160 68197 /var/lib/sss/mc/initgroups (deleted) 2023-01-01T17:45:53.889 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd 5r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.890 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd 6u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.890 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd 7u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.890 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd 8u unix 0xffff8dad40240000 0t0 14240 type=STREAM 2023-01-01T17:45:53.890 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd 9u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.890 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd 10r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.890 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd 11u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.890 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 978 JS\x20Hel polkitd 12u unix 0xffff8dad0403de80 0t0 23191 type=DGRAM 2023-01-01T17:45:53.891 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.891 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.891 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-01-01T17:45:53.891 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-01-01T17:45:53.891 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd DEL REG 8,1 68197 /var/lib/sss/mc/initgroups 2023-01-01T17:45:53.891 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:53.891 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd DEL REG 8,1 68024 /var/lib/sss/mc/passwd 2023-01-01T17:45:53.891 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:53.892 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:53.892 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:53.892 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:53.892 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:53.892 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-01-01T17:45:53.892 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-01-01T17:45:53.892 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-01-01T17:45:53.893 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-01-01T17:45:53.893 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-01-01T17:45:53.893 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-01-01T17:45:53.893 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-01-01T17:45:53.893 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-01-01T17:45:53.893 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:53.894 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:53.894 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:53.894 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:53.894 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:53.894 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:53.894 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:53.894 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:53.894 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:53.895 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-01-01T17:45:53.895 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-01-01T17:45:53.895 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:53.895 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-01-01T17:45:53.895 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-01-01T17:45:53.895 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.895 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:53.896 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:53.896 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-01-01T17:45:53.896 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-01-01T17:45:53.896 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-01-01T17:45:53.896 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:53.896 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-01-01T17:45:53.896 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-01-01T17:45:53.897 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-01-01T17:45:53.897 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-01-01T17:45:53.897 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.897 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:53.897 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd 0u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.897 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd 1u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.897 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd 2u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.898 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd 3r REG 8,1 9253600 68024 /var/lib/sss/mc/passwd (deleted) 2023-01-01T17:45:53.898 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd 4r REG 8,1 11567160 68197 /var/lib/sss/mc/initgroups (deleted) 2023-01-01T17:45:53.898 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd 5r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.898 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd 6u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.898 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd 7u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.898 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd 8u unix 0xffff8dad40240000 0t0 14240 type=STREAM 2023-01-01T17:45:53.899 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd 9u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.899 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd 10r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.899 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd 11u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.899 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 979 JS\x20Hel polkitd 12u unix 0xffff8dad0403de80 0t0 23191 type=DGRAM 2023-01-01T17:45:53.899 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.899 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.899 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-01-01T17:45:53.900 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-01-01T17:45:53.900 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd DEL REG 8,1 68197 /var/lib/sss/mc/initgroups 2023-01-01T17:45:53.900 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:53.900 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd DEL REG 8,1 68024 /var/lib/sss/mc/passwd 2023-01-01T17:45:53.900 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:53.900 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:53.900 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:53.900 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:53.901 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:53.901 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-01-01T17:45:53.901 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-01-01T17:45:53.901 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-01-01T17:45:53.901 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-01-01T17:45:53.901 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-01-01T17:45:53.902 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-01-01T17:45:53.902 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-01-01T17:45:53.902 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-01-01T17:45:53.902 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:53.902 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:53.902 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:53.902 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:53.903 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:53.903 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:53.903 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:53.903 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:53.903 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:53.903 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-01-01T17:45:53.903 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-01-01T17:45:53.903 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:53.904 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-01-01T17:45:53.904 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-01-01T17:45:53.904 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.904 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:53.904 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:53.904 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-01-01T17:45:53.904 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-01-01T17:45:53.905 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-01-01T17:45:53.905 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:53.905 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-01-01T17:45:53.905 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-01-01T17:45:53.905 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-01-01T17:45:53.905 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-01-01T17:45:53.906 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.906 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:53.906 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd 0u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.906 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd 1u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.906 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd 2u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.906 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd 3r REG 8,1 9253600 68024 /var/lib/sss/mc/passwd (deleted) 2023-01-01T17:45:53.906 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd 4r REG 8,1 11567160 68197 /var/lib/sss/mc/initgroups (deleted) 2023-01-01T17:45:53.907 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd 5r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.907 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd 6u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.907 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd 7u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.907 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd 8u unix 0xffff8dad40240000 0t0 14240 type=STREAM 2023-01-01T17:45:53.907 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd 9u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.907 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd 10r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.907 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd 11u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.908 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 980 JS\x20Hel polkitd 12u unix 0xffff8dad0403de80 0t0 23191 type=DGRAM 2023-01-01T17:45:53.908 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.908 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.908 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-01-01T17:45:53.908 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-01-01T17:45:53.908 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd DEL REG 8,1 68197 /var/lib/sss/mc/initgroups 2023-01-01T17:45:53.908 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:53.909 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd DEL REG 8,1 68024 /var/lib/sss/mc/passwd 2023-01-01T17:45:53.909 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:53.909 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:53.909 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:53.909 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:53.909 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:53.910 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-01-01T17:45:53.910 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-01-01T17:45:53.910 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-01-01T17:45:53.910 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-01-01T17:45:53.910 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-01-01T17:45:53.910 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-01-01T17:45:53.910 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-01-01T17:45:53.910 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-01-01T17:45:53.911 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:53.911 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:53.911 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:53.911 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:53.911 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:53.911 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:53.911 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:53.912 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:53.912 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:53.912 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-01-01T17:45:53.912 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-01-01T17:45:53.912 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:53.912 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-01-01T17:45:53.912 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-01-01T17:45:53.913 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.913 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:53.913 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:53.913 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-01-01T17:45:53.913 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-01-01T17:45:53.913 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-01-01T17:45:53.913 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:53.914 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-01-01T17:45:53.914 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-01-01T17:45:53.914 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-01-01T17:45:53.914 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-01-01T17:45:53.914 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.914 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:53.915 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd 0u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.915 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd 1u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.915 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd 2u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.915 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd 3r REG 8,1 9253600 68024 /var/lib/sss/mc/passwd (deleted) 2023-01-01T17:45:53.915 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd 4r REG 8,1 11567160 68197 /var/lib/sss/mc/initgroups (deleted) 2023-01-01T17:45:53.915 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd 5r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.916 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd 6u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.916 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd 7u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.916 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd 8u unix 0xffff8dad40240000 0t0 14240 type=STREAM 2023-01-01T17:45:53.916 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd 9u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.916 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd 10r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.916 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd 11u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.916 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 981 JS\x20Hel polkitd 12u unix 0xffff8dad0403de80 0t0 23191 type=DGRAM 2023-01-01T17:45:53.917 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.917 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.917 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-01-01T17:45:53.917 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-01-01T17:45:53.917 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd DEL REG 8,1 68197 /var/lib/sss/mc/initgroups 2023-01-01T17:45:53.917 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:53.918 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd DEL REG 8,1 68024 /var/lib/sss/mc/passwd 2023-01-01T17:45:53.918 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:53.918 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:53.918 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:53.918 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:53.918 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:53.918 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-01-01T17:45:53.919 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-01-01T17:45:53.919 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-01-01T17:45:53.919 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-01-01T17:45:53.919 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-01-01T17:45:53.919 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-01-01T17:45:53.919 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-01-01T17:45:53.919 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-01-01T17:45:53.920 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:53.920 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:53.920 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:53.920 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:53.920 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:53.920 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:53.920 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:53.921 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:53.921 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:53.921 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-01-01T17:45:53.921 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-01-01T17:45:53.921 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:53.921 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-01-01T17:45:53.921 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-01-01T17:45:53.922 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.922 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:53.922 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:53.922 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-01-01T17:45:53.922 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-01-01T17:45:53.922 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-01-01T17:45:53.923 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:53.923 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-01-01T17:45:53.923 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-01-01T17:45:53.923 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-01-01T17:45:53.923 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-01-01T17:45:53.923 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.923 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:53.923 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd 0u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.924 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd 1u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.924 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd 2u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.924 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd 3r REG 8,1 9253600 68024 /var/lib/sss/mc/passwd (deleted) 2023-01-01T17:45:53.924 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd 4r REG 8,1 11567160 68197 /var/lib/sss/mc/initgroups (deleted) 2023-01-01T17:45:53.924 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd 5r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.924 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd 6u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.924 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd 7u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.925 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd 8u unix 0xffff8dad40240000 0t0 14240 type=STREAM 2023-01-01T17:45:53.925 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd 9u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.925 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd 10r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.925 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd 11u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.925 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 982 JS\x20Hel polkitd 12u unix 0xffff8dad0403de80 0t0 23191 type=DGRAM 2023-01-01T17:45:53.925 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.925 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.926 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-01-01T17:45:53.926 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-01-01T17:45:53.926 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd DEL REG 8,1 68197 /var/lib/sss/mc/initgroups 2023-01-01T17:45:53.926 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:53.926 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd DEL REG 8,1 68024 /var/lib/sss/mc/passwd 2023-01-01T17:45:53.926 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:53.926 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:53.927 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:53.927 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:53.927 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:53.927 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-01-01T17:45:53.927 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-01-01T17:45:53.927 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-01-01T17:45:53.927 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-01-01T17:45:53.928 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-01-01T17:45:53.928 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-01-01T17:45:53.928 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-01-01T17:45:53.928 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-01-01T17:45:53.928 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:53.928 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:53.928 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:53.929 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:53.929 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:53.929 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:53.929 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:53.929 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:53.929 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:53.929 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-01-01T17:45:53.929 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-01-01T17:45:53.930 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:53.930 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-01-01T17:45:53.930 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-01-01T17:45:53.930 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.930 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:53.930 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:53.930 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-01-01T17:45:53.931 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-01-01T17:45:53.931 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-01-01T17:45:53.931 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:53.931 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-01-01T17:45:53.931 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-01-01T17:45:53.931 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-01-01T17:45:53.931 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-01-01T17:45:53.932 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.932 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:53.932 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd 0u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.932 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd 1u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.932 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd 2u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.932 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd 3r REG 8,1 9253600 68024 /var/lib/sss/mc/passwd (deleted) 2023-01-01T17:45:53.932 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd 4r REG 8,1 11567160 68197 /var/lib/sss/mc/initgroups (deleted) 2023-01-01T17:45:53.933 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd 5r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.933 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd 6u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.933 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd 7u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.933 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd 8u unix 0xffff8dad40240000 0t0 14240 type=STREAM 2023-01-01T17:45:53.933 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd 9u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.933 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd 10r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.933 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd 11u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.934 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 983 JS\x20Hel polkitd 12u unix 0xffff8dad0403de80 0t0 23191 type=DGRAM 2023-01-01T17:45:53.934 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.934 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.934 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd txt REG 8,1 142960 40262 /usr/lib/polkit-1/polkitd 2023-01-01T17:45:53.934 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-01-01T17:45:53.934 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd DEL REG 8,1 68197 /var/lib/sss/mc/initgroups 2023-01-01T17:45:53.934 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:53.935 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd DEL REG 8,1 68024 /var/lib/sss/mc/passwd 2023-01-01T17:45:53.935 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:53.935 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:53.935 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:53.935 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:53.935 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:53.935 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-01-01T17:45:53.936 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-01-01T17:45:53.936 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-01-01T17:45:53.936 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-01-01T17:45:53.936 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-01-01T17:45:53.936 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-01-01T17:45:53.936 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-01-01T17:45:53.936 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-01-01T17:45:53.937 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:53.937 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:53.937 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:53.937 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:53.937 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:53.937 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:53.937 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:53.938 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:53.938 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:53.938 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-01-01T17:45:53.938 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-01-01T17:45:53.938 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:53.938 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-01-01T17:45:53.938 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-01-01T17:45:53.938 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.939 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:53.939 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:53.939 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 1661408 5186 /usr/lib64/libstdc++.so.6.0.25 2023-01-01T17:45:53.939 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 23727960 6245 /usr/lib64/libmozjs-60.so.0.0.0 2023-01-01T17:45:53.939 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-01-01T17:45:53.939 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:53.939 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-01-01T17:45:53.940 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-01-01T17:45:53.940 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-01-01T17:45:53.940 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 128128 8377 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-01-01T17:45:53.940 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.940 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:53.940 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd 0u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.940 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd 1u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.941 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd 2u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.941 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd 3r REG 8,1 9253600 68024 /var/lib/sss/mc/passwd (deleted) 2023-01-01T17:45:53.941 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd 4r REG 8,1 11567160 68197 /var/lib/sss/mc/initgroups (deleted) 2023-01-01T17:45:53.941 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd 5r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.941 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd 6u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.941 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd 7u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.941 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd 8u unix 0xffff8dad40240000 0t0 14240 type=STREAM 2023-01-01T17:45:53.942 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd 9u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.942 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd 10r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.942 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd 11u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:53.942 INFO:teuthology.orchestra.run.smithi149.stdout:polkitd 854 984 polkitd polkitd 12u unix 0xffff8dad0403de80 0t0 23191 type=DGRAM 2023-01-01T17:45:53.942 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi cwd DIR 8,1 4096 1974 /etc/avahi 2023-01-01T17:45:53.942 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi rtd DIR 8,1 4096 1974 /etc/avahi 2023-01-01T17:45:53.943 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi txt REG 8,1 146208 13959 /usr/sbin/avahi-daemon 2023-01-01T17:45:53.943 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-01-01T17:45:53.943 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi DEL REG 8,1 68197 /var/lib/sss/mc/initgroups 2023-01-01T17:45:53.943 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi DEL REG 8,1 72551 /var/lib/sss/mc/group 2023-01-01T17:45:53.943 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:53.943 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi DEL REG 8,1 68024 /var/lib/sss/mc/passwd 2023-01-01T17:45:53.943 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:53.944 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:53.944 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:53.944 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:53.944 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:53.944 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:53.944 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:53.944 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:53.944 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:53.945 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:53.945 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:53.945 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:53.945 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:53.952 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.953 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:53.953 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-01-01T17:45:53.953 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:53.953 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:53.953 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-01-01T17:45:53.953 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi mem REG 8,1 30264 6512 /usr/lib64/libdaemon.so.0.5.0 2023-01-01T17:45:53.954 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi mem REG 8,1 231504 13958 /usr/lib64/libavahi-core.so.7.0.2 2023-01-01T17:45:53.954 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi mem REG 8,1 54208 8598 /usr/lib64/libavahi-common.so.3.5.3 2023-01-01T17:45:53.954 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.954 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.954 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi 1u unix 0xffff8dad40348d80 0t0 22822 type=STREAM 2023-01-01T17:45:53.954 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi 2u unix 0xffff8dad40348d80 0t0 22822 type=STREAM 2023-01-01T17:45:53.954 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi 3u unix 0xffff8dad4034bf00 0t0 22600 /run/avahi-daemon/socket type=STREAM 2023-01-01T17:45:53.955 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi 4r REG 8,1 9253600 68024 /var/lib/sss/mc/passwd (deleted) 2023-01-01T17:45:53.955 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi 5r REG 8,1 6940392 72551 /var/lib/sss/mc/group (deleted) 2023-01-01T17:45:53.955 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi 6u unix 0xffff8dad402b9680 0t0 24513 type=DGRAM 2023-01-01T17:45:53.955 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi 7r REG 8,1 11567160 68197 /var/lib/sss/mc/initgroups (deleted) 2023-01-01T17:45:53.955 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi 8u unix 0xffff8dad402ba400 0t0 24557 type=STREAM 2023-01-01T17:45:53.955 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi 9r FIFO 0,13 0t0 24560 pipe 2023-01-01T17:45:53.955 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi 10w FIFO 0,13 0t0 24560 pipe 2023-01-01T17:45:53.955 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi 11r FIFO 0,13 0t0 24561 pipe 2023-01-01T17:45:53.956 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi 12w FIFO 0,13 0t0 24561 pipe 2023-01-01T17:45:53.956 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi 13u unix 0xffff8dad402b8d80 0t0 24562 type=STREAM 2023-01-01T17:45:53.956 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi 14r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:53.956 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi 15u IPv4 22917 0t0 UDP *:mdns 2023-01-01T17:45:53.956 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi 16u IPv6 22918 0t0 UDP *:mdns 2023-01-01T17:45:53.956 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi 17u IPv4 22919 0t0 UDP *:56917 2023-01-01T17:45:53.956 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi 18u IPv6 22920 0t0 UDP *:53262 2023-01-01T17:45:53.957 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 855 avahi 19u netlink 0t0 22921 ROUTE 2023-01-01T17:45:53.957 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.957 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.957 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony txt REG 8,1 351352 11027 /usr/sbin/chronyd 2023-01-01T17:45:53.957 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:53.957 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:53.957 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:53.958 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:53.958 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:53.958 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:53.958 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:53.958 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony mem REG 8,1 695184 7235 /usr/lib64/libnss_myhostname.so.2 2023-01-01T17:45:53.958 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:53.958 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony mem REG 8,1 29256 4996 /usr/lib64/libnss_dns-2.28.so 2023-01-01T17:45:53.958 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:53.959 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony DEL REG 8,1 68024 /var/lib/sss/mc/passwd 2023-01-01T17:45:53.959 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:53.959 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-01-01T17:45:53.959 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-01-01T17:45:53.959 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-01-01T17:45:53.959 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-01-01T17:45:53.959 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:53.960 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-01-01T17:45:53.960 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-01-01T17:45:53.960 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-01-01T17:45:53.960 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.960 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:53.960 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony mem REG 8,1 128784 5906 /usr/lib64/libseccomp.so.2.5.2 2023-01-01T17:45:53.960 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:53.961 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-01-01T17:45:53.961 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-01-01T17:45:53.961 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-01-01T17:45:53.961 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.961 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.961 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony 1w CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.961 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony 2u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.962 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony 3u unix 0xffff8dad402bde80 0t0 24406 type=DGRAM 2023-01-01T17:45:53.962 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony 5r REG 8,1 9253600 68024 /var/lib/sss/mc/passwd (deleted) 2023-01-01T17:45:53.962 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony 6u IPv4 24417 0t0 UDP localhost:323 2023-01-01T17:45:53.962 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony 7u IPv6 24418 0t0 UDP localhost:323 2023-01-01T17:45:53.962 INFO:teuthology.orchestra.run.smithi149.stdout:chronyd 870 chrony 8u unix 0xffff8dad4034a400 0t0 22843 /run/chrony/chronyd.sock type=DGRAM 2023-01-01T17:45:53.962 INFO:teuthology.orchestra.run.smithi149.stdout:ksmtuned 893 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.963 INFO:teuthology.orchestra.run.smithi149.stdout:ksmtuned 893 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.963 INFO:teuthology.orchestra.run.smithi149.stdout:ksmtuned 893 root txt REG 8,1 1150584 5025 /usr/bin/bash 2023-01-01T17:45:53.963 INFO:teuthology.orchestra.run.smithi149.stdout:ksmtuned 893 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:53.963 INFO:teuthology.orchestra.run.smithi149.stdout:ksmtuned 893 root DEL REG 8,1 68024 /var/lib/sss/mc/passwd 2023-01-01T17:45:53.964 INFO:teuthology.orchestra.run.smithi149.stdout:ksmtuned 893 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:53.964 INFO:teuthology.orchestra.run.smithi149.stdout:ksmtuned 893 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-01-01T17:45:53.964 INFO:teuthology.orchestra.run.smithi149.stdout:ksmtuned 893 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.964 INFO:teuthology.orchestra.run.smithi149.stdout:ksmtuned 893 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:53.964 INFO:teuthology.orchestra.run.smithi149.stdout:ksmtuned 893 root mem REG 8,1 187496 4713 /usr/lib64/libtinfo.so.6.1 2023-01-01T17:45:53.965 INFO:teuthology.orchestra.run.smithi149.stdout:ksmtuned 893 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.965 INFO:teuthology.orchestra.run.smithi149.stdout:ksmtuned 893 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-01-01T17:45:53.965 INFO:teuthology.orchestra.run.smithi149.stdout:ksmtuned 893 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-01-01T17:45:53.966 INFO:teuthology.orchestra.run.smithi149.stdout:ksmtuned 893 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-01-01T17:45:53.966 INFO:teuthology.orchestra.run.smithi149.stdout:ksmtuned 893 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-01-01T17:45:53.966 INFO:teuthology.orchestra.run.smithi149.stdout:ksmtuned 893 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-01-01T17:45:53.966 INFO:teuthology.orchestra.run.smithi149.stdout:ksmtuned 893 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-01-01T17:45:53.967 INFO:teuthology.orchestra.run.smithi149.stdout:ksmtuned 893 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-01-01T17:45:53.967 INFO:teuthology.orchestra.run.smithi149.stdout:ksmtuned 893 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-01-01T17:45:53.967 INFO:teuthology.orchestra.run.smithi149.stdout:ksmtuned 893 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-01-01T17:45:53.967 INFO:teuthology.orchestra.run.smithi149.stdout:ksmtuned 893 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-01-01T17:45:53.967 INFO:teuthology.orchestra.run.smithi149.stdout:ksmtuned 893 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:53.967 INFO:teuthology.orchestra.run.smithi149.stdout:ksmtuned 893 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-01-01T17:45:53.967 INFO:teuthology.orchestra.run.smithi149.stdout:ksmtuned 893 root 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.968 INFO:teuthology.orchestra.run.smithi149.stdout:ksmtuned 893 root 1u unix 0xffff8dad402bc380 0t0 24494 type=STREAM 2023-01-01T17:45:53.968 INFO:teuthology.orchestra.run.smithi149.stdout:ksmtuned 893 root 2u unix 0xffff8dad402bc380 0t0 24494 type=STREAM 2023-01-01T17:45:53.968 INFO:teuthology.orchestra.run.smithi149.stdout:ksmtuned 893 root 3r REG 8,1 9253600 68024 /var/lib/sss/mc/passwd (deleted) 2023-01-01T17:45:53.968 INFO:teuthology.orchestra.run.smithi149.stdout:xfsalloc 898 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.968 INFO:teuthology.orchestra.run.smithi149.stdout:xfsalloc 898 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.968 INFO:teuthology.orchestra.run.smithi149.stdout:xfsalloc 898 root txt unknown /proc/898/exe 2023-01-01T17:45:53.968 INFO:teuthology.orchestra.run.smithi149.stdout:xfs_mru_c 899 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.969 INFO:teuthology.orchestra.run.smithi149.stdout:xfs_mru_c 899 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.970 INFO:teuthology.orchestra.run.smithi149.stdout:xfs_mru_c 899 root txt unknown /proc/899/exe 2023-01-01T17:45:53.970 INFO:teuthology.orchestra.run.smithi149.stdout:xfs-buf/d 901 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.970 INFO:teuthology.orchestra.run.smithi149.stdout:xfs-buf/d 901 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.970 INFO:teuthology.orchestra.run.smithi149.stdout:xfs-buf/d 901 root txt unknown /proc/901/exe 2023-01-01T17:45:53.970 INFO:teuthology.orchestra.run.smithi149.stdout:xfs-conv/ 903 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.971 INFO:teuthology.orchestra.run.smithi149.stdout:xfs-conv/ 903 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.971 INFO:teuthology.orchestra.run.smithi149.stdout:xfs-conv/ 903 root txt unknown /proc/903/exe 2023-01-01T17:45:53.971 INFO:teuthology.orchestra.run.smithi149.stdout:xfs-cil/d 904 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.971 INFO:teuthology.orchestra.run.smithi149.stdout:xfs-cil/d 904 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.971 INFO:teuthology.orchestra.run.smithi149.stdout:xfs-cil/d 904 root txt unknown /proc/904/exe 2023-01-01T17:45:53.971 INFO:teuthology.orchestra.run.smithi149.stdout:xfs-recla 905 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.971 INFO:teuthology.orchestra.run.smithi149.stdout:xfs-recla 905 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.972 INFO:teuthology.orchestra.run.smithi149.stdout:xfs-recla 905 root txt unknown /proc/905/exe 2023-01-01T17:45:53.972 INFO:teuthology.orchestra.run.smithi149.stdout:xfs-block 906 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.972 INFO:teuthology.orchestra.run.smithi149.stdout:xfs-block 906 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.972 INFO:teuthology.orchestra.run.smithi149.stdout:xfs-block 906 root txt unknown /proc/906/exe 2023-01-01T17:45:53.972 INFO:teuthology.orchestra.run.smithi149.stdout:xfs-log/d 909 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.972 INFO:teuthology.orchestra.run.smithi149.stdout:xfs-log/d 909 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.972 INFO:teuthology.orchestra.run.smithi149.stdout:xfs-log/d 909 root txt unknown /proc/909/exe 2023-01-01T17:45:53.973 INFO:teuthology.orchestra.run.smithi149.stdout:xfsaild/d 910 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.973 INFO:teuthology.orchestra.run.smithi149.stdout:xfsaild/d 910 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.973 INFO:teuthology.orchestra.run.smithi149.stdout:xfsaild/d 910 root txt unknown /proc/910/exe 2023-01-01T17:45:53.974 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.974 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.974 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi txt REG 8,1 146208 13959 /usr/sbin/avahi-daemon 2023-01-01T17:45:53.974 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-01-01T17:45:53.974 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi DEL REG 8,1 68197 /var/lib/sss/mc/initgroups 2023-01-01T17:45:53.974 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi DEL REG 8,1 72551 /var/lib/sss/mc/group 2023-01-01T17:45:53.974 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:53.975 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi DEL REG 8,1 68024 /var/lib/sss/mc/passwd 2023-01-01T17:45:53.975 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:53.975 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:53.975 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:53.975 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:53.975 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:53.976 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:53.976 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:53.976 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:53.976 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:53.976 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:53.976 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:53.976 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:53.977 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:53.977 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.977 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:53.977 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-01-01T17:45:53.977 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:53.977 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:53.978 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-01-01T17:45:53.978 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi mem REG 8,1 30264 6512 /usr/lib64/libdaemon.so.0.5.0 2023-01-01T17:45:53.978 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi mem REG 8,1 231504 13958 /usr/lib64/libavahi-core.so.7.0.2 2023-01-01T17:45:53.978 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi mem REG 8,1 54208 8598 /usr/lib64/libavahi-common.so.3.5.3 2023-01-01T17:45:53.978 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.978 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.978 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi 1u unix 0xffff8dad40348d80 0t0 22822 type=STREAM 2023-01-01T17:45:53.979 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi 2u unix 0xffff8dad40348d80 0t0 22822 type=STREAM 2023-01-01T17:45:53.979 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi 3u unix 0xffff8dad4034bf00 0t0 22600 /run/avahi-daemon/socket type=STREAM 2023-01-01T17:45:53.979 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi 4r REG 8,1 9253600 68024 /var/lib/sss/mc/passwd (deleted) 2023-01-01T17:45:53.979 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi 5r REG 8,1 6940392 72551 /var/lib/sss/mc/group (deleted) 2023-01-01T17:45:53.979 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi 6u unix 0xffff8dad402b9680 0t0 24513 type=DGRAM 2023-01-01T17:45:53.979 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi 7r REG 8,1 11567160 68197 /var/lib/sss/mc/initgroups (deleted) 2023-01-01T17:45:53.979 INFO:teuthology.orchestra.run.smithi149.stdout:avahi-dae 955 avahi 9u unix 0xffff8dad402b9200 0t0 24558 type=STREAM 2023-01-01T17:45:53.980 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.980 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.980 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root txt REG 8,1 886344 11056 /usr/sbin/sshd 2023-01-01T17:45:53.980 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root DEL REG 8,1 72551 /var/lib/sss/mc/group 2023-01-01T17:45:53.980 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:53.980 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root DEL REG 8,1 68024 /var/lib/sss/mc/passwd 2023-01-01T17:45:53.980 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:53.980 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:53.981 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:53.981 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:53.981 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-01-01T17:45:53.981 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-01-01T17:45:53.981 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:53.981 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:53.981 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:53.982 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:53.982 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:53.982 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:53.982 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:53.982 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:53.982 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:53.982 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-01-01T17:45:53.982 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.983 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-01-01T17:45:53.983 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-01-01T17:45:53.983 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-01-01T17:45:53.983 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-01-01T17:45:53.983 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:53.983 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:53.983 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-01-01T17:45:53.983 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:53.984 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-01-01T17:45:53.984 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:53.984 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-01-01T17:45:53.984 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:53.984 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-01-01T17:45:53.984 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-01-01T17:45:53.984 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.985 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.985 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root 1u unix 0xffff8dad40244c80 0t0 14238 type=STREAM 2023-01-01T17:45:53.985 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root 2u unix 0xffff8dad40244c80 0t0 14238 type=STREAM 2023-01-01T17:45:53.985 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root 3r REG 8,1 9253600 68024 /var/lib/sss/mc/passwd (deleted) 2023-01-01T17:45:53.985 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root 4u IPv4 14254 0t0 TCP *:ssh (LISTEN) 2023-01-01T17:45:53.985 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root 5r REG 8,1 6940392 72551 /var/lib/sss/mc/group (deleted) 2023-01-01T17:45:53.985 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 963 root 6u IPv6 14256 0t0 TCP *:ssh (LISTEN) 2023-01-01T17:45:53.986 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:53.986 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:53.986 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root txt REG 8,1 11856 6728 /usr/libexec/platform-python3.6 2023-01-01T17:45:53.986 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 0,14 11447 anon_inode:[perf_event] (stat: No such file or directory) 2023-01-01T17:45:53.986 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 51192 5937 /usr/lib64/libnuma.so.1.0.0 2023-01-01T17:45:53.986 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 380552 38920 /usr/lib64/python3.6/site-packages/perf.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:53.986 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-01-01T17:45:53.987 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 80112 37495 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:53.987 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 19464 37514 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:53.987 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 115216 37487 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:53.987 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 133472 37484 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:53.987 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 185712 41111 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-01-01T17:45:53.987 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 239416 8479 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-01-01T17:45:53.987 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 340928 38787 /usr/lib64/python3.6/site-packages/gi/_gi.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:53.988 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-01-01T17:45:53.988 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-01-01T17:45:53.988 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-01-01T17:45:53.988 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-01-01T17:45:53.988 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-01-01T17:45:53.988 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-01-01T17:45:53.989 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-01-01T17:45:53.989 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:53.989 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-01-01T17:45:53.989 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-01-01T17:45:53.989 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-01-01T17:45:53.989 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-01-01T17:45:53.989 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-01-01T17:45:53.990 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-01-01T17:45:53.990 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-01-01T17:45:53.990 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 198680 9494 /usr/lib64/libdbus-glib-1.so.2.3.4 2023-01-01T17:45:53.990 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 14264 38868 /usr/lib64/python3.6/site-packages/_dbus_glib_bindings.so 2023-01-01T17:45:53.990 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-01-01T17:45:53.990 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 66904 37521 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:53.990 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:53.990 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:53.991 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:53.991 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:53.991 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:53.991 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:53.991 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:53.991 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:53.991 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:53.991 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:53.992 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:53.992 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:53.992 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-01-01T17:45:53.992 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 214536 38867 /usr/lib64/python3.6/site-packages/_dbus_bindings.so 2023-01-01T17:45:53.992 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 20688 37502 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:53.992 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 13208 37515 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:53.992 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:53.993 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 42856 37497 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:53.993 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 74744 5188 /usr/lib64/libbz2.so.1.0.6 2023-01-01T17:45:53.993 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 23032 37475 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:53.993 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 34392 37530 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:53.993 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 20528 37503 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:53.993 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 13688 37473 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:53.993 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 110640 37504 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:53.994 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 129528 37474 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:53.994 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-01-01T17:45:53.994 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 47928 37492 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:53.994 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 11592 37500 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:53.994 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 131592 37501 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:53.994 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 29256 37524 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:53.994 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 63456 37516 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:53.995 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 92992 37505 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:53.995 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 56768 37508 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:53.995 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 27128 37493 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:53.995 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:53.995 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root DEL REG 8,1 68024 /var/lib/sss/mc/passwd 2023-01-01T17:45:53.995 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:53.995 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-01-01T17:45:53.996 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:53.996 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:53.996 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-01-01T17:45:53.996 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-01-01T17:45:53.996 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:53.996 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:53.996 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 3285488 6697 /usr/lib64/libpython3.6m.so.1.0 2023-01-01T17:45:53.997 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-01-01T17:45:53.997 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:53.997 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-01-01T17:45:53.997 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-01-01T17:45:53.997 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-01-01T17:45:53.997 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-01-01T17:45:53.997 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-01-01T17:45:53.998 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-01-01T17:45:53.998 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-01-01T17:45:53.998 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-01-01T17:45:53.998 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-01-01T17:45:53.998 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-01-01T17:45:53.998 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:53.998 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-01-01T17:45:53.999 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:53.999 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root 1u unix 0xffff8dad403be300 0t0 20958 type=STREAM 2023-01-01T17:45:53.999 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root 2u unix 0xffff8dad403be300 0t0 20958 type=STREAM 2023-01-01T17:45:53.999 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root 3r REG 8,1 9253600 68024 /var/lib/sss/mc/passwd (deleted) 2023-01-01T17:45:53.999 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root 4w REG 8,1 30854 66484 /var/log/tuned/tuned.log 2023-01-01T17:45:53.999 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root 5u netlink 0t0 31946 KOBJECT_UEVENT 2023-01-01T17:45:53.999 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root 6u unix 0xffff8dad40cebf00 0t0 30490 type=STREAM 2023-01-01T17:45:54.000 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root 7u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:54.000 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root 8w CHR 10,62 0t0 16397 /dev/cpu_dma_latency 2023-01-01T17:45:54.000 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root 9u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.000 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root 10u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.000 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root 11u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.000 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root 12u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.000 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root 13u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.001 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root 14u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.001 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root 15u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.001 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root 16u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.001 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root 17r FIFO 0,13 0t0 19350 pipe 2023-01-01T17:45:54.001 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root 18w FIFO 0,13 0t0 19350 pipe 2023-01-01T17:45:54.001 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root 19u unix 0xffff8dad04038d80 0t0 23402 type=STREAM 2023-01-01T17:45:54.001 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 root 20u unix 0xffff8dad0403da00 0t0 23403 type=STREAM 2023-01-01T17:45:54.002 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:54.002 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:54.002 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root txt REG 8,1 11856 6728 /usr/libexec/platform-python3.6 2023-01-01T17:45:54.002 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 0,14 11447 anon_inode:[perf_event] (stat: No such file or directory) 2023-01-01T17:45:54.002 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 51192 5937 /usr/lib64/libnuma.so.1.0.0 2023-01-01T17:45:54.002 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 380552 38920 /usr/lib64/python3.6/site-packages/perf.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.002 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-01-01T17:45:54.003 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 80112 37495 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.003 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 19464 37514 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.003 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 115216 37487 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.003 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 133472 37484 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.003 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 185712 41111 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-01-01T17:45:54.003 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 239416 8479 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-01-01T17:45:54.003 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 340928 38787 /usr/lib64/python3.6/site-packages/gi/_gi.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.004 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-01-01T17:45:54.004 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-01-01T17:45:54.004 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-01-01T17:45:54.004 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-01-01T17:45:54.004 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-01-01T17:45:54.004 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-01-01T17:45:54.004 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-01-01T17:45:54.005 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:54.005 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-01-01T17:45:54.005 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-01-01T17:45:54.005 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-01-01T17:45:54.005 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-01-01T17:45:54.005 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-01-01T17:45:54.005 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-01-01T17:45:54.006 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-01-01T17:45:54.006 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 198680 9494 /usr/lib64/libdbus-glib-1.so.2.3.4 2023-01-01T17:45:54.006 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 14264 38868 /usr/lib64/python3.6/site-packages/_dbus_glib_bindings.so 2023-01-01T17:45:54.006 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-01-01T17:45:54.006 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 66904 37521 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.006 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:54.006 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:54.007 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:54.007 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:54.007 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:54.007 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:54.007 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:54.007 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:54.007 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:54.007 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:54.008 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:54.008 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:54.008 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-01-01T17:45:54.008 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 214536 38867 /usr/lib64/python3.6/site-packages/_dbus_bindings.so 2023-01-01T17:45:54.008 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 20688 37502 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.008 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 13208 37515 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.009 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:54.009 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 42856 37497 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.009 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 74744 5188 /usr/lib64/libbz2.so.1.0.6 2023-01-01T17:45:54.009 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 23032 37475 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.009 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 34392 37530 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.009 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 20528 37503 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.009 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 13688 37473 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.010 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 110640 37504 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.010 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 129528 37474 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.010 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-01-01T17:45:54.010 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 47928 37492 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.010 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 11592 37500 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.010 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 131592 37501 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.010 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 29256 37524 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.011 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 63456 37516 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.011 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 92992 37505 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.011 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 56768 37508 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.011 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 27128 37493 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.011 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:54.011 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root DEL REG 8,1 68024 /var/lib/sss/mc/passwd 2023-01-01T17:45:54.011 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:54.011 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-01-01T17:45:54.012 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:54.012 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:54.012 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-01-01T17:45:54.012 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-01-01T17:45:54.012 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:54.012 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:54.012 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 3285488 6697 /usr/lib64/libpython3.6m.so.1.0 2023-01-01T17:45:54.013 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-01-01T17:45:54.013 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:54.013 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-01-01T17:45:54.013 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-01-01T17:45:54.013 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-01-01T17:45:54.013 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-01-01T17:45:54.013 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-01-01T17:45:54.014 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-01-01T17:45:54.014 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-01-01T17:45:54.014 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-01-01T17:45:54.014 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-01-01T17:45:54.014 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-01-01T17:45:54.014 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:54.014 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-01-01T17:45:54.015 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.015 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root 1u unix 0xffff8dad403be300 0t0 20958 type=STREAM 2023-01-01T17:45:54.015 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root 2u unix 0xffff8dad403be300 0t0 20958 type=STREAM 2023-01-01T17:45:54.015 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root 3r REG 8,1 9253600 68024 /var/lib/sss/mc/passwd (deleted) 2023-01-01T17:45:54.015 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root 4w REG 8,1 30854 66484 /var/log/tuned/tuned.log 2023-01-01T17:45:54.015 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root 5u netlink 0t0 31946 KOBJECT_UEVENT 2023-01-01T17:45:54.015 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root 6u unix 0xffff8dad40cebf00 0t0 30490 type=STREAM 2023-01-01T17:45:54.016 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root 7u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:54.016 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root 8w CHR 10,62 0t0 16397 /dev/cpu_dma_latency 2023-01-01T17:45:54.016 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root 9u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.016 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root 10u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.016 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root 11u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.016 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root 12u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.017 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root 13u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.018 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root 14u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.018 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root 15u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.018 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root 16u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.018 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root 17r FIFO 0,13 0t0 19350 pipe 2023-01-01T17:45:54.018 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root 18w FIFO 0,13 0t0 19350 pipe 2023-01-01T17:45:54.018 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root 19u unix 0xffff8dad04038d80 0t0 23402 type=STREAM 2023-01-01T17:45:54.018 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1206 tuned root 20u unix 0xffff8dad0403da00 0t0 23403 type=STREAM 2023-01-01T17:45:54.019 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:54.019 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:54.019 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root txt REG 8,1 11856 6728 /usr/libexec/platform-python3.6 2023-01-01T17:45:54.019 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 0,14 11447 anon_inode:[perf_event] (stat: No such file or directory) 2023-01-01T17:45:54.019 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 51192 5937 /usr/lib64/libnuma.so.1.0.0 2023-01-01T17:45:54.019 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 380552 38920 /usr/lib64/python3.6/site-packages/perf.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.019 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-01-01T17:45:54.020 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 80112 37495 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.020 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 19464 37514 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.020 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 115216 37487 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.020 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 133472 37484 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.020 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 185712 41111 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-01-01T17:45:54.020 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 239416 8479 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-01-01T17:45:54.020 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 340928 38787 /usr/lib64/python3.6/site-packages/gi/_gi.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.021 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-01-01T17:45:54.021 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-01-01T17:45:54.021 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-01-01T17:45:54.021 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-01-01T17:45:54.021 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-01-01T17:45:54.021 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-01-01T17:45:54.021 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-01-01T17:45:54.022 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:54.022 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-01-01T17:45:54.022 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-01-01T17:45:54.022 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-01-01T17:45:54.022 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-01-01T17:45:54.022 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-01-01T17:45:54.022 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-01-01T17:45:54.023 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-01-01T17:45:54.023 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 198680 9494 /usr/lib64/libdbus-glib-1.so.2.3.4 2023-01-01T17:45:54.023 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 14264 38868 /usr/lib64/python3.6/site-packages/_dbus_glib_bindings.so 2023-01-01T17:45:54.023 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-01-01T17:45:54.023 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 66904 37521 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.023 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:54.023 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:54.024 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:54.024 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:54.024 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:54.024 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:54.024 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:54.024 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:54.025 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:54.025 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:54.025 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:54.025 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:54.025 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-01-01T17:45:54.025 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 214536 38867 /usr/lib64/python3.6/site-packages/_dbus_bindings.so 2023-01-01T17:45:54.025 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 20688 37502 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.026 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 13208 37515 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.026 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:54.026 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 42856 37497 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.026 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 74744 5188 /usr/lib64/libbz2.so.1.0.6 2023-01-01T17:45:54.026 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 23032 37475 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.026 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 34392 37530 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.026 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 20528 37503 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.027 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 13688 37473 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.027 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 110640 37504 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.027 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 129528 37474 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.027 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-01-01T17:45:54.027 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 47928 37492 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.027 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 11592 37500 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.027 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 131592 37501 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.028 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 29256 37524 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.028 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 63456 37516 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.028 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 92992 37505 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.028 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 56768 37508 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.028 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 27128 37493 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.028 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:54.028 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root DEL REG 8,1 68024 /var/lib/sss/mc/passwd 2023-01-01T17:45:54.029 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:54.029 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-01-01T17:45:54.029 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:54.029 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:54.029 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-01-01T17:45:54.029 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-01-01T17:45:54.029 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:54.030 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:54.030 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 3285488 6697 /usr/lib64/libpython3.6m.so.1.0 2023-01-01T17:45:54.030 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-01-01T17:45:54.030 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:54.030 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-01-01T17:45:54.030 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-01-01T17:45:54.030 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-01-01T17:45:54.031 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-01-01T17:45:54.031 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-01-01T17:45:54.031 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-01-01T17:45:54.031 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-01-01T17:45:54.031 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-01-01T17:45:54.031 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-01-01T17:45:54.031 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-01-01T17:45:54.032 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:54.032 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-01-01T17:45:54.032 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.032 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root 1u unix 0xffff8dad403be300 0t0 20958 type=STREAM 2023-01-01T17:45:54.032 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root 2u unix 0xffff8dad403be300 0t0 20958 type=STREAM 2023-01-01T17:45:54.032 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root 3r REG 8,1 9253600 68024 /var/lib/sss/mc/passwd (deleted) 2023-01-01T17:45:54.032 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root 4w REG 8,1 30854 66484 /var/log/tuned/tuned.log 2023-01-01T17:45:54.033 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root 5u netlink 0t0 31946 KOBJECT_UEVENT 2023-01-01T17:45:54.033 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root 6u unix 0xffff8dad40cebf00 0t0 30490 type=STREAM 2023-01-01T17:45:54.033 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root 7u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:54.033 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root 8w CHR 10,62 0t0 16397 /dev/cpu_dma_latency 2023-01-01T17:45:54.033 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root 9u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.033 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root 10u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.033 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root 11u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.034 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root 12u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.034 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root 13u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.034 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root 14u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.034 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root 15u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.034 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root 16u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.034 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root 17r FIFO 0,13 0t0 19350 pipe 2023-01-01T17:45:54.034 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root 18w FIFO 0,13 0t0 19350 pipe 2023-01-01T17:45:54.035 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root 19u unix 0xffff8dad04038d80 0t0 23402 type=STREAM 2023-01-01T17:45:54.035 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1211 tuned root 20u unix 0xffff8dad0403da00 0t0 23403 type=STREAM 2023-01-01T17:45:54.035 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:54.035 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:54.035 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root txt REG 8,1 11856 6728 /usr/libexec/platform-python3.6 2023-01-01T17:45:54.035 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 0,14 11447 anon_inode:[perf_event] (stat: No such file or directory) 2023-01-01T17:45:54.036 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 51192 5937 /usr/lib64/libnuma.so.1.0.0 2023-01-01T17:45:54.036 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 380552 38920 /usr/lib64/python3.6/site-packages/perf.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.036 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-01-01T17:45:54.036 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 80112 37495 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.036 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 19464 37514 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.036 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 115216 37487 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.036 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 133472 37484 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.036 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 185712 41111 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-01-01T17:45:54.037 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 239416 8479 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-01-01T17:45:54.037 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 340928 38787 /usr/lib64/python3.6/site-packages/gi/_gi.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.037 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-01-01T17:45:54.037 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-01-01T17:45:54.037 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-01-01T17:45:54.037 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-01-01T17:45:54.037 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-01-01T17:45:54.038 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-01-01T17:45:54.038 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-01-01T17:45:54.038 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:54.038 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-01-01T17:45:54.038 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-01-01T17:45:54.038 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-01-01T17:45:54.038 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-01-01T17:45:54.039 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-01-01T17:45:54.039 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-01-01T17:45:54.039 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-01-01T17:45:54.039 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 198680 9494 /usr/lib64/libdbus-glib-1.so.2.3.4 2023-01-01T17:45:54.039 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 14264 38868 /usr/lib64/python3.6/site-packages/_dbus_glib_bindings.so 2023-01-01T17:45:54.039 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-01-01T17:45:54.039 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 66904 37521 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.040 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:54.040 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:54.040 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:54.040 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:54.040 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:54.040 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:54.040 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:54.040 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:54.041 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:54.041 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:54.041 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:54.041 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:54.041 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-01-01T17:45:54.041 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 214536 38867 /usr/lib64/python3.6/site-packages/_dbus_bindings.so 2023-01-01T17:45:54.041 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 20688 37502 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.042 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 13208 37515 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.042 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:54.042 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 42856 37497 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.042 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 74744 5188 /usr/lib64/libbz2.so.1.0.6 2023-01-01T17:45:54.042 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 23032 37475 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.042 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 34392 37530 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.043 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 20528 37503 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.043 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 13688 37473 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.043 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 110640 37504 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.043 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 129528 37474 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.043 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-01-01T17:45:54.043 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 47928 37492 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.044 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 11592 37500 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.044 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 131592 37501 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.044 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 29256 37524 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.044 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 63456 37516 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.044 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 92992 37505 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.044 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 56768 37508 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.044 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 27128 37493 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.044 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:54.045 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root DEL REG 8,1 68024 /var/lib/sss/mc/passwd 2023-01-01T17:45:54.045 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:54.045 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-01-01T17:45:54.045 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:54.045 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:54.045 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-01-01T17:45:54.045 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-01-01T17:45:54.046 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:54.046 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:54.046 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 3285488 6697 /usr/lib64/libpython3.6m.so.1.0 2023-01-01T17:45:54.046 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-01-01T17:45:54.046 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:54.046 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-01-01T17:45:54.047 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-01-01T17:45:54.047 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-01-01T17:45:54.047 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-01-01T17:45:54.047 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-01-01T17:45:54.047 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-01-01T17:45:54.047 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-01-01T17:45:54.047 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-01-01T17:45:54.048 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-01-01T17:45:54.048 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-01-01T17:45:54.048 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:54.048 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-01-01T17:45:54.048 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.048 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root 1u unix 0xffff8dad403be300 0t0 20958 type=STREAM 2023-01-01T17:45:54.048 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root 2u unix 0xffff8dad403be300 0t0 20958 type=STREAM 2023-01-01T17:45:54.049 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root 3r REG 8,1 9253600 68024 /var/lib/sss/mc/passwd (deleted) 2023-01-01T17:45:54.049 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root 4w REG 8,1 30854 66484 /var/log/tuned/tuned.log 2023-01-01T17:45:54.049 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root 5u netlink 0t0 31946 KOBJECT_UEVENT 2023-01-01T17:45:54.049 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root 6u unix 0xffff8dad40cebf00 0t0 30490 type=STREAM 2023-01-01T17:45:54.049 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root 7u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:54.049 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root 8w CHR 10,62 0t0 16397 /dev/cpu_dma_latency 2023-01-01T17:45:54.049 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root 9u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.049 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root 10u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.050 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root 11u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.050 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root 12u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.050 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root 13u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.050 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root 14u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.050 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root 15u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.050 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root 16u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.050 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root 17r FIFO 0,13 0t0 19350 pipe 2023-01-01T17:45:54.051 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root 18w FIFO 0,13 0t0 19350 pipe 2023-01-01T17:45:54.051 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root 19u unix 0xffff8dad04038d80 0t0 23402 type=STREAM 2023-01-01T17:45:54.051 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1228 tuned root 20u unix 0xffff8dad0403da00 0t0 23403 type=STREAM 2023-01-01T17:45:54.051 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:54.051 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:54.051 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root txt REG 8,1 11856 6728 /usr/libexec/platform-python3.6 2023-01-01T17:45:54.051 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 0,14 11447 anon_inode:[perf_event] (stat: No such file or directory) 2023-01-01T17:45:54.052 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 51192 5937 /usr/lib64/libnuma.so.1.0.0 2023-01-01T17:45:54.052 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 380552 38920 /usr/lib64/python3.6/site-packages/perf.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.052 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-01-01T17:45:54.052 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 80112 37495 /usr/lib64/python3.6/lib-dynload/_json.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.053 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 19464 37514 /usr/lib64/python3.6/lib-dynload/fcntl.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.053 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 115216 37487 /usr/lib64/python3.6/lib-dynload/_datetime.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.053 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 133472 37484 /usr/lib64/python3.6/lib-dynload/_ctypes.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.053 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 185712 41111 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-01-01T17:45:54.053 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 239416 8479 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-01-01T17:45:54.053 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 340928 38787 /usr/lib64/python3.6/site-packages/gi/_gi.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.053 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-01-01T17:45:54.053 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-01-01T17:45:54.054 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-01-01T17:45:54.054 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-01-01T17:45:54.054 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-01-01T17:45:54.054 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-01-01T17:45:54.054 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-01-01T17:45:54.054 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:54.055 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 16056 7996 /usr/lib64/libgmodule-2.0.so.0.5600.4 2023-01-01T17:45:54.055 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-01-01T17:45:54.055 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-01-01T17:45:54.055 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-01-01T17:45:54.055 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 1770240 7992 /usr/lib64/libgio-2.0.so.0.5600.4 2023-01-01T17:45:54.055 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-01-01T17:45:54.056 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 347416 7998 /usr/lib64/libgobject-2.0.so.0.5600.4 2023-01-01T17:45:54.056 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 198680 9494 /usr/lib64/libdbus-glib-1.so.2.3.4 2023-01-01T17:45:54.056 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 14264 38868 /usr/lib64/python3.6/site-packages/_dbus_glib_bindings.so 2023-01-01T17:45:54.056 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 248256 5293 /usr/lib64/libexpat.so.1.6.7 2023-01-01T17:45:54.056 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 66904 37521 /usr/lib64/python3.6/lib-dynload/pyexpat.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.056 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:54.057 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:54.057 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:54.057 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:54.057 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:54.057 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:54.058 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:54.058 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:54.058 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:54.058 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:54.058 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:54.058 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:54.058 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-01-01T17:45:54.059 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 214536 38867 /usr/lib64/python3.6/site-packages/_dbus_bindings.so 2023-01-01T17:45:54.059 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 20688 37502 /usr/lib64/python3.6/lib-dynload/_posixsubprocess.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.059 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 13208 37515 /usr/lib64/python3.6/lib-dynload/grp.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.059 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:54.059 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 42856 37497 /usr/lib64/python3.6/lib-dynload/_lzma.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.059 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 74744 5188 /usr/lib64/libbz2.so.1.0.6 2023-01-01T17:45:54.059 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 23032 37475 /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.060 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 34392 37530 /usr/lib64/python3.6/lib-dynload/zlib.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.060 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 20528 37503 /usr/lib64/python3.6/lib-dynload/_random.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.060 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 13688 37473 /usr/lib64/python3.6/lib-dynload/_bisect.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.060 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 110640 37504 /usr/lib64/python3.6/lib-dynload/_sha3.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.060 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 129528 37474 /usr/lib64/python3.6/lib-dynload/_blake2.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.060 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-01-01T17:45:54.061 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 47928 37492 /usr/lib64/python3.6/lib-dynload/_hashlib.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.061 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 11592 37500 /usr/lib64/python3.6/lib-dynload/_opcode.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.061 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 131592 37501 /usr/lib64/python3.6/lib-dynload/_pickle.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.061 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 29256 37524 /usr/lib64/python3.6/lib-dynload/select.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.061 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 63456 37516 /usr/lib64/python3.6/lib-dynload/math.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.061 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 92992 37505 /usr/lib64/python3.6/lib-dynload/_socket.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.061 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 56768 37508 /usr/lib64/python3.6/lib-dynload/_struct.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.062 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 27128 37493 /usr/lib64/python3.6/lib-dynload/_heapq.cpython-36m-x86_64-linux-gnu.so 2023-01-01T17:45:54.062 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:54.062 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root DEL REG 8,1 68024 /var/lib/sss/mc/passwd 2023-01-01T17:45:54.062 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:54.062 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-01-01T17:45:54.062 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:54.062 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:54.063 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-01-01T17:45:54.063 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-01-01T17:45:54.063 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:54.063 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:54.063 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 3285488 6697 /usr/lib64/libpython3.6m.so.1.0 2023-01-01T17:45:54.063 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-01-01T17:45:54.063 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:54.064 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-01-01T17:45:54.064 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-01-01T17:45:54.064 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-01-01T17:45:54.064 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-01-01T17:45:54.064 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-01-01T17:45:54.064 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-01-01T17:45:54.065 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-01-01T17:45:54.065 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-01-01T17:45:54.065 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-01-01T17:45:54.065 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-01-01T17:45:54.065 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:54.065 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-01-01T17:45:54.066 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.066 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root 1u unix 0xffff8dad403be300 0t0 20958 type=STREAM 2023-01-01T17:45:54.066 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root 2u unix 0xffff8dad403be300 0t0 20958 type=STREAM 2023-01-01T17:45:54.067 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root 3r REG 8,1 9253600 68024 /var/lib/sss/mc/passwd (deleted) 2023-01-01T17:45:54.067 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root 4w REG 8,1 30854 66484 /var/log/tuned/tuned.log 2023-01-01T17:45:54.067 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root 5u netlink 0t0 31946 KOBJECT_UEVENT 2023-01-01T17:45:54.068 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root 6u unix 0xffff8dad40cebf00 0t0 30490 type=STREAM 2023-01-01T17:45:54.068 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root 7u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:54.068 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root 8w CHR 10,62 0t0 16397 /dev/cpu_dma_latency 2023-01-01T17:45:54.068 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root 9u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.068 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root 10u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.068 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root 11u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.068 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root 12u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.069 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root 13u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.069 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root 14u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.069 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root 15u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.069 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root 16u a_inode 0,14 0 11447 [perf_event] 2023-01-01T17:45:54.069 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root 17r FIFO 0,13 0t0 19350 pipe 2023-01-01T17:45:54.070 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root 18w FIFO 0,13 0t0 19350 pipe 2023-01-01T17:45:54.070 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root 19u unix 0xffff8dad04038d80 0t0 23402 type=STREAM 2023-01-01T17:45:54.070 INFO:teuthology.orchestra.run.smithi149.stdout:tuned 965 1229 tuned root 20u unix 0xffff8dad0403da00 0t0 23403 type=STREAM 2023-01-01T17:45:54.070 INFO:teuthology.orchestra.run.smithi149.stdout:rhsmcertd 967 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:54.070 INFO:teuthology.orchestra.run.smithi149.stdout:rhsmcertd 967 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:54.070 INFO:teuthology.orchestra.run.smithi149.stdout:rhsmcertd 967 root txt REG 8,1 25704 10732 /usr/bin/rhsmcertd 2023-01-01T17:45:54.070 INFO:teuthology.orchestra.run.smithi149.stdout:rhsmcertd 967 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-01-01T17:45:54.071 INFO:teuthology.orchestra.run.smithi149.stdout:rhsmcertd 967 root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-01-01T17:45:54.071 INFO:teuthology.orchestra.run.smithi149.stdout:rhsmcertd 967 root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-01-01T17:45:54.071 INFO:teuthology.orchestra.run.smithi149.stdout:rhsmcertd 967 root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-01-01T17:45:54.071 INFO:teuthology.orchestra.run.smithi149.stdout:rhsmcertd 967 root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-01-01T17:45:54.071 INFO:teuthology.orchestra.run.smithi149.stdout:rhsmcertd 967 root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-01-01T17:45:54.071 INFO:teuthology.orchestra.run.smithi149.stdout:rhsmcertd 967 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:54.071 INFO:teuthology.orchestra.run.smithi149.stdout:rhsmcertd 967 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-01-01T17:45:54.072 INFO:teuthology.orchestra.run.smithi149.stdout:rhsmcertd 967 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-01-01T17:45:54.072 INFO:teuthology.orchestra.run.smithi149.stdout:rhsmcertd 967 root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-01-01T17:45:54.072 INFO:teuthology.orchestra.run.smithi149.stdout:rhsmcertd 967 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:54.072 INFO:teuthology.orchestra.run.smithi149.stdout:rhsmcertd 967 root mem REG 8,1 464936 5939 /usr/lib64/libpcre.so.1.2.10 2023-01-01T17:45:54.072 INFO:teuthology.orchestra.run.smithi149.stdout:rhsmcertd 967 root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-01-01T17:45:54.072 INFO:teuthology.orchestra.run.smithi149.stdout:rhsmcertd 967 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:54.072 INFO:teuthology.orchestra.run.smithi149.stdout:rhsmcertd 967 root mem REG 8,1 1167792 7994 /usr/lib64/libglib-2.0.so.0.5600.4 2023-01-01T17:45:54.073 INFO:teuthology.orchestra.run.smithi149.stdout:rhsmcertd 967 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:54.073 INFO:teuthology.orchestra.run.smithi149.stdout:rhsmcertd 967 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-01-01T17:45:54.073 INFO:teuthology.orchestra.run.smithi149.stdout:rhsmcertd 967 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-01-01T17:45:54.073 INFO:teuthology.orchestra.run.smithi149.stdout:rhsmcertd 967 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-01-01T17:45:54.073 INFO:teuthology.orchestra.run.smithi149.stdout:rhsmcertd 967 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-01-01T17:45:54.073 INFO:teuthology.orchestra.run.smithi149.stdout:rhsmcertd 967 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-01-01T17:45:54.073 INFO:teuthology.orchestra.run.smithi149.stdout:rhsmcertd 967 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-01-01T17:45:54.074 INFO:teuthology.orchestra.run.smithi149.stdout:rhsmcertd 967 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-01-01T17:45:54.074 INFO:teuthology.orchestra.run.smithi149.stdout:rhsmcertd 967 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-01-01T17:45:54.074 INFO:teuthology.orchestra.run.smithi149.stdout:rhsmcertd 967 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-01-01T17:45:54.074 INFO:teuthology.orchestra.run.smithi149.stdout:rhsmcertd 967 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-01-01T17:45:54.074 INFO:teuthology.orchestra.run.smithi149.stdout:rhsmcertd 967 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:54.074 INFO:teuthology.orchestra.run.smithi149.stdout:rhsmcertd 967 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-01-01T17:45:54.074 INFO:teuthology.orchestra.run.smithi149.stdout:rhsmcertd 967 root 0u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.075 INFO:teuthology.orchestra.run.smithi149.stdout:rhsmcertd 967 root 1u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.075 INFO:teuthology.orchestra.run.smithi149.stdout:rhsmcertd 967 root 2u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.075 INFO:teuthology.orchestra.run.smithi149.stdout:rhsmcertd 967 root 3wW REG 0,24 0 23039 /run/lock/subsys/rhsmcertd 2023-01-01T17:45:54.075 INFO:teuthology.orchestra.run.smithi149.stdout:rhsmcertd 967 root 4u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:54.075 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:54.075 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:54.075 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root txt REG 8,1 135320 13427 /usr/sbin/gssproxy 2023-01-01T17:45:54.075 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 379136 8865 /usr/lib64/libevent-2.1.so.6.0.2 2023-01-01T17:45:54.076 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 12136 13426 /usr/lib64/libverto-libevent.so.1.0.0 2023-01-01T17:45:54.076 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-01-01T17:45:54.076 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:54.076 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:54.076 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 16160 5902 /usr/lib64/libpath_utils.so.1.0.1 2023-01-01T17:45:54.076 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:54.076 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:54.077 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-01-01T17:45:54.077 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-01-01T17:45:54.077 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-01-01T17:45:54.077 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:54.078 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:54.078 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-01-01T17:45:54.078 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 138832 7014 /usr/lib64/libgssrpc.so.4.2 2023-01-01T17:45:54.078 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:54.078 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 55560 5344 /usr/lib64/libcollection.so.4.1.1 2023-01-01T17:45:54.079 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 12024 5348 /usr/lib64/libref_array.so.1.2.1 2023-01-01T17:45:54.079 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 11848 5342 /usr/lib64/libbasicobjects.so.0.1.0 2023-01-01T17:45:54.079 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 117048 5904 /usr/lib64/libini_config.so.5.2.1 2023-01-01T17:45:54.079 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 24872 6557 /usr/lib64/libverto.so.1.0.0 2023-01-01T17:45:54.079 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-01-01T17:45:54.079 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-01-01T17:45:54.080 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-01-01T17:45:54.080 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-01-01T17:45:54.080 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:54.080 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-01-01T17:45:54.080 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-01-01T17:45:54.080 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-01-01T17:45:54.081 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-01-01T17:45:54.081 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-01-01T17:45:54.081 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-01-01T17:45:54.081 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-01-01T17:45:54.081 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-01-01T17:45:54.081 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-01-01T17:45:54.081 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-01-01T17:45:54.081 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-01-01T17:45:54.082 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:54.082 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.082 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root 1u unix 0xffff8dad403bf980 0t0 20889 type=STREAM 2023-01-01T17:45:54.082 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root 2u unix 0xffff8dad403bf980 0t0 20889 type=STREAM 2023-01-01T17:45:54.082 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root 3u unix 0xffff8dad40241f80 0t0 14241 type=DGRAM 2023-01-01T17:45:54.082 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root 4r FIFO 0,13 0t0 25719 pipe 2023-01-01T17:45:54.082 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root 5u a_inode 0,14 0 11447 [eventpoll] 2023-01-01T17:45:54.082 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root 6r FIFO 0,13 0t0 25713 pipe 2023-01-01T17:45:54.083 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root 7w FIFO 0,13 0t0 25713 pipe 2023-01-01T17:45:54.083 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root 8u unix 0xffff8dad427a3600 0t0 25714 /var/lib/gssproxy/default.sock type=STREAM 2023-01-01T17:45:54.083 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root 9u unix 0xffff8dad427a7980 0t0 25715 /run/gssproxy.sock type=STREAM 2023-01-01T17:45:54.083 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 root 10w FIFO 0,13 0t0 25719 pipe 2023-01-01T17:45:54.083 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:54.083 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:54.083 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root txt REG 8,1 135320 13427 /usr/sbin/gssproxy 2023-01-01T17:45:54.084 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 379136 8865 /usr/lib64/libevent-2.1.so.6.0.2 2023-01-01T17:45:54.084 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 12136 13426 /usr/lib64/libverto-libevent.so.1.0.0 2023-01-01T17:45:54.084 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-01-01T17:45:54.084 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:54.084 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:54.084 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 16160 5902 /usr/lib64/libpath_utils.so.1.0.1 2023-01-01T17:45:54.084 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:54.085 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:54.085 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-01-01T17:45:54.085 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-01-01T17:45:54.085 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-01-01T17:45:54.085 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:54.085 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:54.085 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-01-01T17:45:54.085 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 138832 7014 /usr/lib64/libgssrpc.so.4.2 2023-01-01T17:45:54.086 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:54.086 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 55560 5344 /usr/lib64/libcollection.so.4.1.1 2023-01-01T17:45:54.086 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 12024 5348 /usr/lib64/libref_array.so.1.2.1 2023-01-01T17:45:54.086 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 11848 5342 /usr/lib64/libbasicobjects.so.0.1.0 2023-01-01T17:45:54.086 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 117048 5904 /usr/lib64/libini_config.so.5.2.1 2023-01-01T17:45:54.086 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 24872 6557 /usr/lib64/libverto.so.1.0.0 2023-01-01T17:45:54.086 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-01-01T17:45:54.087 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-01-01T17:45:54.087 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-01-01T17:45:54.087 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-01-01T17:45:54.087 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:54.087 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-01-01T17:45:54.087 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-01-01T17:45:54.087 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-01-01T17:45:54.088 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-01-01T17:45:54.088 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-01-01T17:45:54.088 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-01-01T17:45:54.088 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-01-01T17:45:54.088 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-01-01T17:45:54.088 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-01-01T17:45:54.088 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-01-01T17:45:54.089 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-01-01T17:45:54.089 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:54.089 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.090 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root 1u unix 0xffff8dad403bf980 0t0 20889 type=STREAM 2023-01-01T17:45:54.090 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root 2u unix 0xffff8dad403bf980 0t0 20889 type=STREAM 2023-01-01T17:45:54.090 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root 3u unix 0xffff8dad40241f80 0t0 14241 type=DGRAM 2023-01-01T17:45:54.090 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root 4r FIFO 0,13 0t0 25719 pipe 2023-01-01T17:45:54.090 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root 5u a_inode 0,14 0 11447 [eventpoll] 2023-01-01T17:45:54.091 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root 6r FIFO 0,13 0t0 25713 pipe 2023-01-01T17:45:54.091 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root 7w FIFO 0,13 0t0 25713 pipe 2023-01-01T17:45:54.091 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root 8u unix 0xffff8dad427a3600 0t0 25714 /var/lib/gssproxy/default.sock type=STREAM 2023-01-01T17:45:54.091 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root 9u unix 0xffff8dad427a7980 0t0 25715 /run/gssproxy.sock type=STREAM 2023-01-01T17:45:54.091 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 986 gssproxy root 10w FIFO 0,13 0t0 25719 pipe 2023-01-01T17:45:54.091 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:54.091 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:54.092 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root txt REG 8,1 135320 13427 /usr/sbin/gssproxy 2023-01-01T17:45:54.092 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 379136 8865 /usr/lib64/libevent-2.1.so.6.0.2 2023-01-01T17:45:54.092 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 12136 13426 /usr/lib64/libverto-libevent.so.1.0.0 2023-01-01T17:45:54.092 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-01-01T17:45:54.092 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:54.092 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:54.092 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 16160 5902 /usr/lib64/libpath_utils.so.1.0.1 2023-01-01T17:45:54.093 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:54.093 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:54.093 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-01-01T17:45:54.093 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-01-01T17:45:54.093 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-01-01T17:45:54.093 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:54.094 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:54.094 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-01-01T17:45:54.094 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 138832 7014 /usr/lib64/libgssrpc.so.4.2 2023-01-01T17:45:54.094 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:54.094 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 55560 5344 /usr/lib64/libcollection.so.4.1.1 2023-01-01T17:45:54.094 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 12024 5348 /usr/lib64/libref_array.so.1.2.1 2023-01-01T17:45:54.094 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 11848 5342 /usr/lib64/libbasicobjects.so.0.1.0 2023-01-01T17:45:54.095 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 117048 5904 /usr/lib64/libini_config.so.5.2.1 2023-01-01T17:45:54.095 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 24872 6557 /usr/lib64/libverto.so.1.0.0 2023-01-01T17:45:54.095 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-01-01T17:45:54.095 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-01-01T17:45:54.095 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-01-01T17:45:54.095 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-01-01T17:45:54.095 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:54.096 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-01-01T17:45:54.096 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-01-01T17:45:54.096 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-01-01T17:45:54.096 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-01-01T17:45:54.096 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-01-01T17:45:54.096 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-01-01T17:45:54.096 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-01-01T17:45:54.097 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-01-01T17:45:54.097 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-01-01T17:45:54.097 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-01-01T17:45:54.097 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-01-01T17:45:54.097 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:54.097 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.097 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root 1u unix 0xffff8dad403bf980 0t0 20889 type=STREAM 2023-01-01T17:45:54.098 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root 2u unix 0xffff8dad403bf980 0t0 20889 type=STREAM 2023-01-01T17:45:54.098 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root 3u unix 0xffff8dad40241f80 0t0 14241 type=DGRAM 2023-01-01T17:45:54.098 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root 4r FIFO 0,13 0t0 25719 pipe 2023-01-01T17:45:54.098 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root 5u a_inode 0,14 0 11447 [eventpoll] 2023-01-01T17:45:54.098 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root 6r FIFO 0,13 0t0 25713 pipe 2023-01-01T17:45:54.098 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root 7w FIFO 0,13 0t0 25713 pipe 2023-01-01T17:45:54.098 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root 8u unix 0xffff8dad427a3600 0t0 25714 /var/lib/gssproxy/default.sock type=STREAM 2023-01-01T17:45:54.098 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root 9u unix 0xffff8dad427a7980 0t0 25715 /run/gssproxy.sock type=STREAM 2023-01-01T17:45:54.099 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 987 gssproxy root 10w FIFO 0,13 0t0 25719 pipe 2023-01-01T17:45:54.099 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:54.099 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:54.099 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root txt REG 8,1 135320 13427 /usr/sbin/gssproxy 2023-01-01T17:45:54.099 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 379136 8865 /usr/lib64/libevent-2.1.so.6.0.2 2023-01-01T17:45:54.099 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 12136 13426 /usr/lib64/libverto-libevent.so.1.0.0 2023-01-01T17:45:54.099 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-01-01T17:45:54.100 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:54.100 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:54.100 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 16160 5902 /usr/lib64/libpath_utils.so.1.0.1 2023-01-01T17:45:54.100 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:54.100 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:54.100 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-01-01T17:45:54.100 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-01-01T17:45:54.101 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-01-01T17:45:54.101 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:54.101 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:54.101 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-01-01T17:45:54.101 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 138832 7014 /usr/lib64/libgssrpc.so.4.2 2023-01-01T17:45:54.101 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:54.101 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 55560 5344 /usr/lib64/libcollection.so.4.1.1 2023-01-01T17:45:54.101 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 12024 5348 /usr/lib64/libref_array.so.1.2.1 2023-01-01T17:45:54.102 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 11848 5342 /usr/lib64/libbasicobjects.so.0.1.0 2023-01-01T17:45:54.102 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 117048 5904 /usr/lib64/libini_config.so.5.2.1 2023-01-01T17:45:54.102 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 24872 6557 /usr/lib64/libverto.so.1.0.0 2023-01-01T17:45:54.102 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-01-01T17:45:54.102 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-01-01T17:45:54.102 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-01-01T17:45:54.102 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-01-01T17:45:54.102 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:54.103 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-01-01T17:45:54.103 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-01-01T17:45:54.103 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-01-01T17:45:54.103 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-01-01T17:45:54.103 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-01-01T17:45:54.103 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-01-01T17:45:54.103 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-01-01T17:45:54.104 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-01-01T17:45:54.104 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-01-01T17:45:54.104 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-01-01T17:45:54.104 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-01-01T17:45:54.104 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:54.104 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.104 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root 1u unix 0xffff8dad403bf980 0t0 20889 type=STREAM 2023-01-01T17:45:54.104 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root 2u unix 0xffff8dad403bf980 0t0 20889 type=STREAM 2023-01-01T17:45:54.105 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root 3u unix 0xffff8dad40241f80 0t0 14241 type=DGRAM 2023-01-01T17:45:54.105 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root 4r FIFO 0,13 0t0 25719 pipe 2023-01-01T17:45:54.105 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root 5u a_inode 0,14 0 11447 [eventpoll] 2023-01-01T17:45:54.105 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root 6r FIFO 0,13 0t0 25713 pipe 2023-01-01T17:45:54.105 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root 7w FIFO 0,13 0t0 25713 pipe 2023-01-01T17:45:54.105 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root 8u unix 0xffff8dad427a3600 0t0 25714 /var/lib/gssproxy/default.sock type=STREAM 2023-01-01T17:45:54.105 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root 9u unix 0xffff8dad427a7980 0t0 25715 /run/gssproxy.sock type=STREAM 2023-01-01T17:45:54.106 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 988 gssproxy root 10w FIFO 0,13 0t0 25719 pipe 2023-01-01T17:45:54.106 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:54.106 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:54.106 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root txt REG 8,1 135320 13427 /usr/sbin/gssproxy 2023-01-01T17:45:54.106 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 379136 8865 /usr/lib64/libevent-2.1.so.6.0.2 2023-01-01T17:45:54.106 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 12136 13426 /usr/lib64/libverto-libevent.so.1.0.0 2023-01-01T17:45:54.106 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-01-01T17:45:54.107 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:54.107 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:54.107 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 16160 5902 /usr/lib64/libpath_utils.so.1.0.1 2023-01-01T17:45:54.107 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:54.107 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:54.107 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-01-01T17:45:54.108 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-01-01T17:45:54.108 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-01-01T17:45:54.108 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:54.108 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:54.108 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-01-01T17:45:54.108 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 138832 7014 /usr/lib64/libgssrpc.so.4.2 2023-01-01T17:45:54.108 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:54.108 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 55560 5344 /usr/lib64/libcollection.so.4.1.1 2023-01-01T17:45:54.109 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 12024 5348 /usr/lib64/libref_array.so.1.2.1 2023-01-01T17:45:54.109 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 11848 5342 /usr/lib64/libbasicobjects.so.0.1.0 2023-01-01T17:45:54.109 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 117048 5904 /usr/lib64/libini_config.so.5.2.1 2023-01-01T17:45:54.109 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 24872 6557 /usr/lib64/libverto.so.1.0.0 2023-01-01T17:45:54.109 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-01-01T17:45:54.109 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-01-01T17:45:54.109 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-01-01T17:45:54.110 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-01-01T17:45:54.110 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:54.110 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-01-01T17:45:54.110 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-01-01T17:45:54.110 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-01-01T17:45:54.110 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-01-01T17:45:54.110 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-01-01T17:45:54.110 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-01-01T17:45:54.111 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-01-01T17:45:54.111 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-01-01T17:45:54.111 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-01-01T17:45:54.111 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-01-01T17:45:54.111 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-01-01T17:45:54.111 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:54.111 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.111 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root 1u unix 0xffff8dad403bf980 0t0 20889 type=STREAM 2023-01-01T17:45:54.112 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root 2u unix 0xffff8dad403bf980 0t0 20889 type=STREAM 2023-01-01T17:45:54.112 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root 3u unix 0xffff8dad40241f80 0t0 14241 type=DGRAM 2023-01-01T17:45:54.112 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root 4r FIFO 0,13 0t0 25719 pipe 2023-01-01T17:45:54.112 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root 5u a_inode 0,14 0 11447 [eventpoll] 2023-01-01T17:45:54.112 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root 6r FIFO 0,13 0t0 25713 pipe 2023-01-01T17:45:54.112 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root 7w FIFO 0,13 0t0 25713 pipe 2023-01-01T17:45:54.112 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root 8u unix 0xffff8dad427a3600 0t0 25714 /var/lib/gssproxy/default.sock type=STREAM 2023-01-01T17:45:54.113 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root 9u unix 0xffff8dad427a7980 0t0 25715 /run/gssproxy.sock type=STREAM 2023-01-01T17:45:54.113 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 989 gssproxy root 10w FIFO 0,13 0t0 25719 pipe 2023-01-01T17:45:54.113 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:54.113 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:54.113 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root txt REG 8,1 135320 13427 /usr/sbin/gssproxy 2023-01-01T17:45:54.113 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 379136 8865 /usr/lib64/libevent-2.1.so.6.0.2 2023-01-01T17:45:54.113 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 12136 13426 /usr/lib64/libverto-libevent.so.1.0.0 2023-01-01T17:45:54.114 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-01-01T17:45:54.114 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:54.114 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:54.114 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 16160 5902 /usr/lib64/libpath_utils.so.1.0.1 2023-01-01T17:45:54.114 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:54.114 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:54.114 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-01-01T17:45:54.114 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-01-01T17:45:54.115 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-01-01T17:45:54.115 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:54.115 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:54.115 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-01-01T17:45:54.115 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 138832 7014 /usr/lib64/libgssrpc.so.4.2 2023-01-01T17:45:54.115 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:54.115 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 55560 5344 /usr/lib64/libcollection.so.4.1.1 2023-01-01T17:45:54.116 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 12024 5348 /usr/lib64/libref_array.so.1.2.1 2023-01-01T17:45:54.116 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 11848 5342 /usr/lib64/libbasicobjects.so.0.1.0 2023-01-01T17:45:54.116 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 117048 5904 /usr/lib64/libini_config.so.5.2.1 2023-01-01T17:45:54.116 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 24872 6557 /usr/lib64/libverto.so.1.0.0 2023-01-01T17:45:54.116 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-01-01T17:45:54.116 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-01-01T17:45:54.117 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-01-01T17:45:54.117 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-01-01T17:45:54.117 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:54.117 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-01-01T17:45:54.117 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-01-01T17:45:54.117 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-01-01T17:45:54.117 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-01-01T17:45:54.118 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-01-01T17:45:54.118 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-01-01T17:45:54.118 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-01-01T17:45:54.118 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-01-01T17:45:54.118 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-01-01T17:45:54.118 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-01-01T17:45:54.118 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-01-01T17:45:54.119 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:54.119 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.119 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root 1u unix 0xffff8dad403bf980 0t0 20889 type=STREAM 2023-01-01T17:45:54.119 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root 2u unix 0xffff8dad403bf980 0t0 20889 type=STREAM 2023-01-01T17:45:54.119 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root 3u unix 0xffff8dad40241f80 0t0 14241 type=DGRAM 2023-01-01T17:45:54.119 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root 4r FIFO 0,13 0t0 25719 pipe 2023-01-01T17:45:54.119 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root 5u a_inode 0,14 0 11447 [eventpoll] 2023-01-01T17:45:54.119 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root 6r FIFO 0,13 0t0 25713 pipe 2023-01-01T17:45:54.120 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root 7w FIFO 0,13 0t0 25713 pipe 2023-01-01T17:45:54.120 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root 8u unix 0xffff8dad427a3600 0t0 25714 /var/lib/gssproxy/default.sock type=STREAM 2023-01-01T17:45:54.120 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root 9u unix 0xffff8dad427a7980 0t0 25715 /run/gssproxy.sock type=STREAM 2023-01-01T17:45:54.120 INFO:teuthology.orchestra.run.smithi149.stdout:gssproxy 975 990 gssproxy root 10w FIFO 0,13 0t0 25719 pipe 2023-01-01T17:45:54.120 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:54.120 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:54.120 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root txt REG 8,1 237976 50943 /usr/libexec/sssd/sssd_be 2023-01-01T17:45:54.120 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 68288 8465 /usr/lib64/libsss_certmap.so.0.2.0 2023-01-01T17:45:54.121 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 58096 32121 /usr/lib64/sssd/libsss_files.so 2023-01-01T17:45:54.121 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-01-01T17:45:54.121 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root DEL REG 8,1 68197 /var/lib/sss/mc/initgroups 2023-01-01T17:45:54.121 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root DEL REG 8,1 68024 /var/lib/sss/mc/passwd 2023-01-01T17:45:54.121 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:54.121 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 4644864 66476 /var/lib/sss/db/timestamps_implicit_files.ldb 2023-01-01T17:45:54.121 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 6459392 66474 /var/lib/sss/db/cache_implicit_files.ldb 2023-01-01T17:45:54.122 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:54.122 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 7536 40251 /usr/lib64/ldb/modules/ldb/tdb.so 2023-01-01T17:45:54.122 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 11816 40250 /usr/lib64/ldb/modules/ldb/skel.so 2023-01-01T17:45:54.122 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 15896 40249 /usr/lib64/ldb/modules/ldb/server_sort.so 2023-01-01T17:45:54.122 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 11992 40248 /usr/lib64/ldb/modules/ldb/sample.so 2023-01-01T17:45:54.122 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 15952 40247 /usr/lib64/ldb/modules/ldb/rdn_name.so 2023-01-01T17:45:54.122 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 16008 40246 /usr/lib64/ldb/modules/ldb/paged_searches.so 2023-01-01T17:45:54.122 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 71048 41592 /usr/lib64/ldb/modules/ldb/memberof.so 2023-01-01T17:45:54.123 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 7544 40245 /usr/lib64/ldb/modules/ldb/mdb.so 2023-01-01T17:45:54.123 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 91808 6558 /usr/lib64/liblmdb.so.0.0.0 2023-01-01T17:45:54.123 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 12440 40238 /usr/lib64/ldb/libldb-tdb-err-map.so 2023-01-01T17:45:54.123 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 95464 40236 /usr/lib64/ldb/libldb-key-value.so 2023-01-01T17:45:54.123 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 24744 40237 /usr/lib64/ldb/libldb-mdb-int.so 2023-01-01T17:45:54.123 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 25008 40239 /usr/lib64/ldb/libldb-tdb-int.so 2023-01-01T17:45:54.123 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 7648 40244 /usr/lib64/ldb/modules/ldb/ldb.so 2023-01-01T17:45:54.123 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-01-01T17:45:54.124 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-01-01T17:45:54.124 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-01-01T17:45:54.124 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-01-01T17:45:54.124 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-01-01T17:45:54.124 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-01-01T17:45:54.124 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-01-01T17:45:54.124 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-01-01T17:45:54.124 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 125440 6685 /usr/lib64/libsasl2.so.3.0.0 2023-01-01T17:45:54.125 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:54.125 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 67232 6713 /usr/lib64/liblber-2.4.so.2.10.9 2023-01-01T17:45:54.125 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 329184 6715 /usr/lib64/libldap-2.4.so.2.10.9 2023-01-01T17:45:54.125 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 28888 40243 /usr/lib64/ldb/modules/ldb/ldap.so 2023-01-01T17:45:54.125 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 15928 40242 /usr/lib64/ldb/modules/ldb/asq.so 2023-01-01T17:45:54.125 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-01-01T17:45:54.125 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:54.126 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:54.126 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:54.126 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-01-01T17:45:54.126 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:54.126 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:54.126 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:54.126 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:54.127 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:54.127 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:54.127 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:54.127 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 16160 5902 /usr/lib64/libpath_utils.so.1.0.1 2023-01-01T17:45:54.127 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:54.127 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-01-01T17:45:54.127 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:54.128 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-01-01T17:45:54.128 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-01-01T17:45:54.128 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 87544 5208 /usr/lib64/libtalloc.so.2.3.3 2023-01-01T17:45:54.128 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 87792 5290 /usr/lib64/libtevent.so.0.11.0 2023-01-01T17:45:54.128 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 16216 5346 /usr/lib64/libdhash.so.1.1.0 2023-01-01T17:45:54.128 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 262080 32126 /usr/lib64/sssd/libsss_sbus.so 2023-01-01T17:45:54.128 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 148360 32122 /usr/lib64/sssd/libsss_iface.so 2023-01-01T17:45:54.129 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:54.129 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 24880 32120 /usr/lib64/sssd/libsss_debug.so 2023-01-01T17:45:54.129 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-01-01T17:45:54.129 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 24240 32118 /usr/lib64/sssd/libsss_child.so 2023-01-01T17:45:54.129 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 24752 32119 /usr/lib64/sssd/libsss_crypt.so 2023-01-01T17:45:54.129 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 20440 32117 /usr/lib64/sssd/libsss_cert.so 2023-01-01T17:45:54.129 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 55560 5344 /usr/lib64/libcollection.so.4.1.1 2023-01-01T17:45:54.130 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 12024 5348 /usr/lib64/libref_array.so.1.2.1 2023-01-01T17:45:54.130 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 11848 5342 /usr/lib64/libbasicobjects.so.0.1.0 2023-01-01T17:45:54.130 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 117048 5904 /usr/lib64/libini_config.so.5.2.1 2023-01-01T17:45:54.130 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:54.130 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 100496 5296 /usr/lib64/libtdb.so.1.4.4 2023-01-01T17:45:54.130 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:54.131 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 220240 8334 /usr/lib64/libldb.so.2.4.1 2023-01-01T17:45:54.131 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-01-01T17:45:54.131 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:54.131 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 568304 32130 /usr/lib64/sssd/libsss_util.so 2023-01-01T17:45:54.131 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-01-01T17:45:54.131 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 79176 6499 /usr/lib64/libcares.so.2.2.0 2023-01-01T17:45:54.131 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:54.132 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:54.132 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 1286144 66412 /var/lib/sss/db/config.ldb 2023-01-01T17:45:54.132 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-01-01T17:45:54.132 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-01-01T17:45:54.132 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-01-01T17:45:54.132 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-01-01T17:45:54.132 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-01-01T17:45:54.132 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-01-01T17:45:54.133 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-01-01T17:45:54.133 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-01-01T17:45:54.133 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-01-01T17:45:54.133 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-01-01T17:45:54.133 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:54.133 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-01-01T17:45:54.133 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root 0w REG 8,1 102928 66778 /var/log/sssd/sssd_implicit_files.log 2023-01-01T17:45:54.134 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root 1u unix 0xffff8dad09285e80 0t0 19004 type=STREAM 2023-01-01T17:45:54.134 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root 2u unix 0xffff8dad09285e80 0t0 19004 type=STREAM 2023-01-01T17:45:54.134 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root 3u a_inode 0,14 0 11447 [eventpoll] 2023-01-01T17:45:54.134 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root 4u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:54.134 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root 5u a_inode 0,14 0 11447 [eventpoll] 2023-01-01T17:45:54.134 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root 6u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:54.134 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root 7u REG 8,1 1286144 66412 /var/lib/sss/db/config.ldb 2023-01-01T17:45:54.134 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root 8r FIFO 0,13 0t0 24768 pipe 2023-01-01T17:45:54.134 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root 9w FIFO 0,13 0t0 24768 pipe 2023-01-01T17:45:54.135 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root 10u unix 0xffff8dad41991200 0t0 24769 type=DGRAM 2023-01-01T17:45:54.135 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root 11u a_inode 0,14 0 11447 [eventpoll] 2023-01-01T17:45:54.135 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root 12u REG 8,1 6459392 66474 /var/lib/sss/db/cache_implicit_files.ldb 2023-01-01T17:45:54.135 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root 13u a_inode 0,14 0 11447 [eventpoll] 2023-01-01T17:45:54.135 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root 14u REG 8,1 4644864 66476 /var/lib/sss/db/timestamps_implicit_files.ldb 2023-01-01T17:45:54.135 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root 15u unix 0xffff8dad41996c00 0t0 24770 /var/lib/sss/pipes/private/sbus-dp_implicit_files.991 type=STREAM 2023-01-01T17:45:54.135 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root 16u unix 0xffff8dad0403c380 0t0 23200 type=STREAM 2023-01-01T17:45:54.135 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root 17u unix 0xffff8dad04039680 0t0 23201 /var/lib/sss/pipes/private/sbus-dp_implicit_files.991 type=STREAM 2023-01-01T17:45:54.136 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root 18r REG 8,1 9253600 68024 /var/lib/sss/mc/passwd (deleted) 2023-01-01T17:45:54.136 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root 19r REG 8,1 11567160 68197 /var/lib/sss/mc/initgroups (deleted) 2023-01-01T17:45:54.136 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root 20r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:54.136 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root 21r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:54.136 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root 22u unix 0xffff8dad41997080 0t0 24785 type=STREAM 2023-01-01T17:45:54.136 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_be 991 root 23u unix 0xffff8dad40247980 0t0 24786 /var/lib/sss/pipes/private/sbus-dp_implicit_files.991 type=STREAM 2023-01-01T17:45:54.136 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:54.137 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:54.137 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root txt REG 8,1 305856 50945 /usr/libexec/sssd/sssd_nss 2023-01-01T17:45:54.137 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem-w REG 8,1 11567160 66904 /var/lib/sss/mc/initgroups 2023-01-01T17:45:54.137 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem-w REG 8,1 6940392 20342 /var/lib/sss/mc/group 2023-01-01T17:45:54.137 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem-w REG 8,1 9253600 20335 /var/lib/sss/mc/passwd 2023-01-01T17:45:54.137 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 4644864 66476 /var/lib/sss/db/timestamps_implicit_files.ldb 2023-01-01T17:45:54.137 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 6459392 66474 /var/lib/sss/db/cache_implicit_files.ldb 2023-01-01T17:45:54.138 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:54.138 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 7536 40251 /usr/lib64/ldb/modules/ldb/tdb.so 2023-01-01T17:45:54.138 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 11816 40250 /usr/lib64/ldb/modules/ldb/skel.so 2023-01-01T17:45:54.138 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 15896 40249 /usr/lib64/ldb/modules/ldb/server_sort.so 2023-01-01T17:45:54.138 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 11992 40248 /usr/lib64/ldb/modules/ldb/sample.so 2023-01-01T17:45:54.138 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 15952 40247 /usr/lib64/ldb/modules/ldb/rdn_name.so 2023-01-01T17:45:54.138 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 16008 40246 /usr/lib64/ldb/modules/ldb/paged_searches.so 2023-01-01T17:45:54.139 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 71048 41592 /usr/lib64/ldb/modules/ldb/memberof.so 2023-01-01T17:45:54.139 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 7544 40245 /usr/lib64/ldb/modules/ldb/mdb.so 2023-01-01T17:45:54.139 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 91808 6558 /usr/lib64/liblmdb.so.0.0.0 2023-01-01T17:45:54.139 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 12440 40238 /usr/lib64/ldb/libldb-tdb-err-map.so 2023-01-01T17:45:54.139 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 95464 40236 /usr/lib64/ldb/libldb-key-value.so 2023-01-01T17:45:54.139 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 24744 40237 /usr/lib64/ldb/libldb-mdb-int.so 2023-01-01T17:45:54.139 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 25008 40239 /usr/lib64/ldb/libldb-tdb-int.so 2023-01-01T17:45:54.140 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 7648 40244 /usr/lib64/ldb/modules/ldb/ldb.so 2023-01-01T17:45:54.140 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-01-01T17:45:54.140 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-01-01T17:45:54.140 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-01-01T17:45:54.140 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-01-01T17:45:54.140 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-01-01T17:45:54.140 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-01-01T17:45:54.141 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-01-01T17:45:54.141 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-01-01T17:45:54.141 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 125440 6685 /usr/lib64/libsasl2.so.3.0.0 2023-01-01T17:45:54.141 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:54.141 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 67232 6713 /usr/lib64/liblber-2.4.so.2.10.9 2023-01-01T17:45:54.141 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 329184 6715 /usr/lib64/libldap-2.4.so.2.10.9 2023-01-01T17:45:54.141 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 28888 40243 /usr/lib64/ldb/modules/ldb/ldap.so 2023-01-01T17:45:54.142 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 15928 40242 /usr/lib64/ldb/modules/ldb/asq.so 2023-01-01T17:45:54.142 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-01-01T17:45:54.142 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:54.142 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:54.142 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:54.142 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:54.142 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:54.142 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:54.143 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:54.143 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:54.144 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:54.144 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:54.144 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 16160 5902 /usr/lib64/libpath_utils.so.1.0.1 2023-01-01T17:45:54.144 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:54.144 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:54.144 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-01-01T17:45:54.145 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-01-01T17:45:54.145 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 87544 5208 /usr/lib64/libtalloc.so.2.3.3 2023-01-01T17:45:54.145 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 87792 5290 /usr/lib64/libtevent.so.0.11.0 2023-01-01T17:45:54.145 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 16216 5346 /usr/lib64/libdhash.so.1.1.0 2023-01-01T17:45:54.145 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 262080 32126 /usr/lib64/sssd/libsss_sbus.so 2023-01-01T17:45:54.145 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 148360 32122 /usr/lib64/sssd/libsss_iface.so 2023-01-01T17:45:54.145 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:54.146 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 24880 32120 /usr/lib64/sssd/libsss_debug.so 2023-01-01T17:45:54.146 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-01-01T17:45:54.146 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 24240 32118 /usr/lib64/sssd/libsss_child.so 2023-01-01T17:45:54.146 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 24752 32119 /usr/lib64/sssd/libsss_crypt.so 2023-01-01T17:45:54.146 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 55560 5344 /usr/lib64/libcollection.so.4.1.1 2023-01-01T17:45:54.147 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 12024 5348 /usr/lib64/libref_array.so.1.2.1 2023-01-01T17:45:54.147 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 11848 5342 /usr/lib64/libbasicobjects.so.0.1.0 2023-01-01T17:45:54.147 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 117048 5904 /usr/lib64/libini_config.so.5.2.1 2023-01-01T17:45:54.147 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:54.147 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 100496 5296 /usr/lib64/libtdb.so.1.4.4 2023-01-01T17:45:54.147 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:54.147 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 220240 8334 /usr/lib64/libldb.so.2.4.1 2023-01-01T17:45:54.148 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 54688 5141 /usr/lib64/libpopt.so.0.0.1 2023-01-01T17:45:54.148 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:54.148 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 568304 32130 /usr/lib64/sssd/libsss_util.so 2023-01-01T17:45:54.148 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 20440 32117 /usr/lib64/sssd/libsss_cert.so 2023-01-01T17:45:54.148 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 28888 5451 /usr/lib64/libsss_idmap.so.0.5.1 2023-01-01T17:45:54.148 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:54.148 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:54.149 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 1286144 66412 /var/lib/sss/db/config.ldb 2023-01-01T17:45:54.149 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-01-01T17:45:54.149 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-01-01T17:45:54.149 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-01-01T17:45:54.149 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-01-01T17:45:54.149 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-01-01T17:45:54.149 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-01-01T17:45:54.150 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-01-01T17:45:54.150 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-01-01T17:45:54.150 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-01-01T17:45:54.150 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-01-01T17:45:54.150 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:54.150 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-01-01T17:45:54.150 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root 0w REG 8,1 281152 66816 /var/log/sssd/sssd_nss.log 2023-01-01T17:45:54.151 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root 1u unix 0xffff8dad09285e80 0t0 19004 type=STREAM 2023-01-01T17:45:54.151 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root 2u unix 0xffff8dad09285e80 0t0 19004 type=STREAM 2023-01-01T17:45:54.151 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root 3u a_inode 0,14 0 11447 [eventpoll] 2023-01-01T17:45:54.151 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root 4u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:54.151 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root 5u a_inode 0,14 0 11447 [eventpoll] 2023-01-01T17:45:54.151 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root 6u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:54.151 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root 7u REG 8,1 1286144 66412 /var/lib/sss/db/config.ldb 2023-01-01T17:45:54.152 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root 8r FIFO 0,13 0t0 14333 pipe 2023-01-01T17:45:54.152 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root 9w FIFO 0,13 0t0 14333 pipe 2023-01-01T17:45:54.152 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root 10u unix 0xffff8dad40243600 0t0 14334 type=DGRAM 2023-01-01T17:45:54.152 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root 11u unix 0xffff8dad40245580 0t0 14335 type=STREAM 2023-01-01T17:45:54.152 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root 12u a_inode 0,14 0 11447 [eventpoll] 2023-01-01T17:45:54.153 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root 13u REG 8,1 6459392 66474 /var/lib/sss/db/cache_implicit_files.ldb 2023-01-01T17:45:54.153 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root 14u a_inode 0,14 0 11447 [eventpoll] 2023-01-01T17:45:54.153 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root 15u REG 8,1 4644864 66476 /var/lib/sss/db/timestamps_implicit_files.ldb 2023-01-01T17:45:54.153 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root 16u unix 0xffff8dad40246300 0t0 31761 /var/lib/sss/pipes/nss type=STREAM 2023-01-01T17:45:54.153 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root 17uw REG 8,1 9253600 20335 /var/lib/sss/mc/passwd 2023-01-01T17:45:54.153 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root 18uw REG 8,1 6940392 20342 /var/lib/sss/mc/group 2023-01-01T17:45:54.153 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root 19uw REG 8,1 11567160 66904 /var/lib/sss/mc/initgroups 2023-01-01T17:45:54.154 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root 20u unix 0xffff8dad40240d80 0t0 31762 type=STREAM 2023-01-01T17:45:54.154 INFO:teuthology.orchestra.run.smithi149.stdout:sssd_nss 1015 root 21u unix 0xffff8dad403bda00 0t0 42434 /var/lib/sss/pipes/nss type=STREAM 2023-01-01T17:45:54.154 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:54.154 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:54.154 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root txt REG 8,1 467608 14012 /usr/sbin/cupsd 2023-01-01T17:45:54.155 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:54.155 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 6940392 20342 /var/lib/sss/mc/group 2023-01-01T17:45:54.155 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 9253600 20335 /var/lib/sss/mc/passwd 2023-01-01T17:45:54.155 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:54.155 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:54.155 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:54.155 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:54.155 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:54.156 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:54.156 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-01-01T17:45:54.156 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 37232 5493 /usr/lib64/libffi.so.6.0.2 2023-01-01T17:45:54.156 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:54.156 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-01-01T17:45:54.156 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-01-01T17:45:54.156 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-01-01T17:45:54.156 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:54.157 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:54.157 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:54.157 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:54.157 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:54.158 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:54.158 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:54.158 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 26192 5300 /usr/lib64/libattr.so.1.1.2448 2023-01-01T17:45:54.158 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-01-01T17:45:54.158 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 1503456 5437 /usr/lib64/libgmp.so.10.3.2 2023-01-01T17:45:54.158 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 197728 5648 /usr/lib64/libhogweed.so.4.5 2023-01-01T17:45:54.159 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 239360 5650 /usr/lib64/libnettle.so.6.5 2023-01-01T17:45:54.159 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 81408 5680 /usr/lib64/libtasn1.so.6.5.5 2023-01-01T17:45:54.159 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-01-01T17:45:54.159 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-01-01T17:45:54.159 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 1246520 5496 /usr/lib64/libp11-kit.so.0.3.0 2023-01-01T17:45:54.159 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:54.159 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-01-01T17:45:54.160 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-01-01T17:45:54.160 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:54.160 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-01-01T17:45:54.160 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-01-01T17:45:54.160 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-01-01T17:45:54.160 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-01-01T17:45:54.160 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 629504 8599 /usr/lib64/libcups.so.2 2023-01-01T17:45:54.160 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 74352 8596 /usr/lib64/libavahi-client.so.3.2.9 2023-01-01T17:45:54.161 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 54208 8598 /usr/lib64/libavahi-common.so.3.5.3 2023-01-01T17:45:54.161 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:54.161 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 351576 7119 /usr/lib64/libdbus-1.so.3.19.7 2023-01-01T17:45:54.161 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 54816 5302 /usr/lib64/libacl.so.1.1.2253 2023-01-01T17:45:54.161 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:54.161 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-01-01T17:45:54.161 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 2051656 8063 /usr/lib64/libgnutls.so.30.28.2 2023-01-01T17:45:54.161 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:54.162 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 28936 8602 /usr/lib64/libcupsmime.so.1 2023-01-01T17:45:54.162 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:54.162 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:54.162 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-01-01T17:45:54.162 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.162 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root 1u unix 0xffff8dad40246c00 0t0 31838 type=STREAM 2023-01-01T17:45:54.162 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root 2u unix 0xffff8dad40246c00 0t0 31838 type=STREAM 2023-01-01T17:45:54.163 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root 3u unix 0xffff8dad40348000 0t0 22572 /var/run/cups/cups.sock type=STREAM 2023-01-01T17:45:54.163 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root 4u a_inode 0,14 0 11447 [eventpoll] 2023-01-01T17:45:54.163 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root 5r REG 8,1 9253600 20335 /var/lib/sss/mc/passwd 2023-01-01T17:45:54.163 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root 6u unix 0xffff8dad40ce9680 0t0 30476 type=STREAM 2023-01-01T17:45:54.163 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root 7r REG 8,1 6940392 20342 /var/lib/sss/mc/group 2023-01-01T17:45:54.163 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root 8u unix 0xffff8dad40cecc80 0t0 30484 type=STREAM 2023-01-01T17:45:54.163 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root 9u IPv6 30485 0t0 TCP localhost:ipp (LISTEN) 2023-01-01T17:45:54.163 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root 10u IPv4 30486 0t0 TCP localhost:ipp (LISTEN) 2023-01-01T17:45:54.164 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root 11r FIFO 0,13 0t0 30487 pipe 2023-01-01T17:45:54.164 INFO:teuthology.orchestra.run.smithi149.stdout:cupsd 1037 root 12w FIFO 0,13 0t0 30487 pipe 2023-01-01T17:45:54.164 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:54.164 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:54.164 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root txt REG 8,1 259272 8128 /usr/lib/systemd/systemd-logind 2023-01-01T17:45:54.164 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root mem REG 8,1 9253600 20335 /var/lib/sss/mc/passwd 2023-01-01T17:45:54.165 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:54.165 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:54.165 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-01-01T17:45:54.165 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-01-01T17:45:54.165 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root mem REG 8,1 735192 5135 /usr/lib64/libsepol.so.1 2023-01-01T17:45:54.166 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-01-01T17:45:54.166 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:54.166 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:54.166 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:54.166 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root mem REG 8,1 66912 5393 /usr/lib64/libjson-c.so.4.0.0 2023-01-01T17:45:54.166 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-01-01T17:45:54.166 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-01-01T17:45:54.167 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root mem REG 8,1 371240 32501 /usr/lib64/libdevmapper.so.1.02 2023-01-01T17:45:54.167 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:54.167 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root mem REG 8,1 26192 5300 /usr/lib64/libattr.so.1.1.2448 2023-01-01T17:45:54.167 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:54.167 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:54.167 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:54.167 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:54.167 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-01-01T17:45:54.168 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:54.168 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root mem REG 8,1 128784 5906 /usr/lib64/libseccomp.so.2.5.2 2023-01-01T17:45:54.168 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:54.168 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root mem REG 8,1 526360 7346 /usr/lib64/libcryptsetup.so.12.6.0 2023-01-01T17:45:54.168 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:54.168 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:54.168 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:54.169 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:54.169 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:54.169 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root mem REG 8,1 54816 5302 /usr/lib64/libacl.so.1.1.2253 2023-01-01T17:45:54.169 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root mem REG 8,1 2740672 8111 /usr/lib/systemd/libsystemd-shared-239.so 2023-01-01T17:45:54.169 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:54.169 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root mem REG 8,1 576141 1062 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-01-01T17:45:54.169 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root mem REG 8,1 19983 1966 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-01-01T17:45:54.170 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.170 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root 1u unix 0xffff8dad402bad00 0t0 30845 type=STREAM 2023-01-01T17:45:54.170 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root 2u unix 0xffff8dad402bad00 0t0 30845 type=STREAM 2023-01-01T17:45:54.170 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root 3u unix 0xffff8dad402ba880 0t0 30846 type=DGRAM 2023-01-01T17:45:54.170 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root 4u a_inode 0,14 0 11447 [eventpoll] 2023-01-01T17:45:54.170 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root 5u a_inode 0,14 0 11447 [signalfd] 2023-01-01T17:45:54.170 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root 6u a_inode 0,14 0 11447 [timerfd] 2023-01-01T17:45:54.171 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root 7r REG 0,21 4096 19879 /sys/devices/virtual/tty/tty0/active 2023-01-01T17:45:54.171 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root 8u netlink 0t0 30852 KOBJECT_UEVENT 2023-01-01T17:45:54.171 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root 9u netlink 0t0 30853 KOBJECT_UEVENT 2023-01-01T17:45:54.171 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root 10u netlink 0t0 30854 KOBJECT_UEVENT 2023-01-01T17:45:54.171 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root 11u netlink 0t0 30855 KOBJECT_UEVENT 2023-01-01T17:45:54.171 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root 12u unix 0xffff8dad402bf980 0t0 30856 type=STREAM 2023-01-01T17:45:54.171 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root 13u a_inode 0,14 0 11447 [timerfd] 2023-01-01T17:45:54.171 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root 14u CHR 13,65 0t0 16393 /dev/input/event1 2023-01-01T17:45:54.172 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root 15u CHR 13,64 0t0 16392 /dev/input/event0 2023-01-01T17:45:54.172 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root 16u CHR 13,66 0t0 2291 /dev/input/event2 2023-01-01T17:45:54.172 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root 17u CHR 4,6 0t0 2070 /dev/tty6 2023-01-01T17:45:54.172 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root 18r FIFO 0,24 0t0 31934 /run/systemd/inhibit/1.ref 2023-01-01T17:45:54.172 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root 19r REG 8,1 9253600 20335 /var/lib/sss/mc/passwd 2023-01-01T17:45:54.172 INFO:teuthology.orchestra.run.smithi149.stdout:systemd-l 1038 root 20r FIFO 0,24 0t0 41880 /run/systemd/sessions/1.ref 2023-01-01T17:45:54.172 INFO:teuthology.orchestra.run.smithi149.stdout:atd 1043 root cwd DIR 8,1 4096 66695 /var/spool/at 2023-01-01T17:45:54.173 INFO:teuthology.orchestra.run.smithi149.stdout:atd 1043 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:54.173 INFO:teuthology.orchestra.run.smithi149.stdout:atd 1043 root txt REG 8,1 34144 9429 /usr/sbin/atd 2023-01-01T17:45:54.173 INFO:teuthology.orchestra.run.smithi149.stdout:atd 1043 root mem REG 8,1 6940392 20342 /var/lib/sss/mc/group 2023-01-01T17:45:54.173 INFO:teuthology.orchestra.run.smithi149.stdout:atd 1043 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:54.173 INFO:teuthology.orchestra.run.smithi149.stdout:atd 1043 root mem REG 8,1 9253600 20335 /var/lib/sss/mc/passwd 2023-01-01T17:45:54.173 INFO:teuthology.orchestra.run.smithi149.stdout:atd 1043 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:54.173 INFO:teuthology.orchestra.run.smithi149.stdout:atd 1043 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-01-01T17:45:54.174 INFO:teuthology.orchestra.run.smithi149.stdout:atd 1043 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:54.174 INFO:teuthology.orchestra.run.smithi149.stdout:atd 1043 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:54.174 INFO:teuthology.orchestra.run.smithi149.stdout:atd 1043 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-01-01T17:45:54.174 INFO:teuthology.orchestra.run.smithi149.stdout:atd 1043 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:54.174 INFO:teuthology.orchestra.run.smithi149.stdout:atd 1043 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:54.174 INFO:teuthology.orchestra.run.smithi149.stdout:atd 1043 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:54.174 INFO:teuthology.orchestra.run.smithi149.stdout:atd 1043 root mem REG 8,1 16608 7487 /usr/lib64/libpam_misc.so.0.82.1 2023-01-01T17:45:54.174 INFO:teuthology.orchestra.run.smithi149.stdout:atd 1043 root mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-01-01T17:45:54.175 INFO:teuthology.orchestra.run.smithi149.stdout:atd 1043 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:54.175 INFO:teuthology.orchestra.run.smithi149.stdout:atd 1043 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:54.175 INFO:teuthology.orchestra.run.smithi149.stdout:atd 1043 root 0u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.175 INFO:teuthology.orchestra.run.smithi149.stdout:atd 1043 root 1u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.175 INFO:teuthology.orchestra.run.smithi149.stdout:atd 1043 root 2u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.175 INFO:teuthology.orchestra.run.smithi149.stdout:atd 1043 root 3r REG 8,1 9253600 20335 /var/lib/sss/mc/passwd 2023-01-01T17:45:54.175 INFO:teuthology.orchestra.run.smithi149.stdout:atd 1043 root 4u unix 0xffff8dad0403e780 0t0 23245 type=STREAM 2023-01-01T17:45:54.175 INFO:teuthology.orchestra.run.smithi149.stdout:atd 1043 root 5r REG 8,1 6940392 20342 /var/lib/sss/mc/group 2023-01-01T17:45:54.176 INFO:teuthology.orchestra.run.smithi149.stdout:atd 1043 root 6uW REG 0,24 5 23248 /run/atd.pid 2023-01-01T17:45:54.176 INFO:teuthology.orchestra.run.smithi149.stdout:crond 1049 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:54.176 INFO:teuthology.orchestra.run.smithi149.stdout:crond 1049 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:54.176 INFO:teuthology.orchestra.run.smithi149.stdout:crond 1049 root txt REG 8,1 75704 8472 /usr/sbin/crond 2023-01-01T17:45:54.176 INFO:teuthology.orchestra.run.smithi149.stdout:crond 1049 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:54.176 INFO:teuthology.orchestra.run.smithi149.stdout:crond 1049 root mem REG 8,1 9253600 20335 /var/lib/sss/mc/passwd 2023-01-01T17:45:54.177 INFO:teuthology.orchestra.run.smithi149.stdout:crond 1049 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:54.177 INFO:teuthology.orchestra.run.smithi149.stdout:crond 1049 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-01-01T17:45:54.177 INFO:teuthology.orchestra.run.smithi149.stdout:crond 1049 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:54.177 INFO:teuthology.orchestra.run.smithi149.stdout:crond 1049 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-01-01T17:45:54.177 INFO:teuthology.orchestra.run.smithi149.stdout:crond 1049 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:54.177 INFO:teuthology.orchestra.run.smithi149.stdout:crond 1049 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:54.177 INFO:teuthology.orchestra.run.smithi149.stdout:crond 1049 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-01-01T17:45:54.178 INFO:teuthology.orchestra.run.smithi149.stdout:crond 1049 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:54.178 INFO:teuthology.orchestra.run.smithi149.stdout:crond 1049 root mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-01-01T17:45:54.178 INFO:teuthology.orchestra.run.smithi149.stdout:crond 1049 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:54.178 INFO:teuthology.orchestra.run.smithi149.stdout:crond 1049 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:54.178 INFO:teuthology.orchestra.run.smithi149.stdout:crond 1049 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-01-01T17:45:54.178 INFO:teuthology.orchestra.run.smithi149.stdout:crond 1049 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-01-01T17:45:54.179 INFO:teuthology.orchestra.run.smithi149.stdout:crond 1049 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-01-01T17:45:54.179 INFO:teuthology.orchestra.run.smithi149.stdout:crond 1049 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-01-01T17:45:54.179 INFO:teuthology.orchestra.run.smithi149.stdout:crond 1049 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-01-01T17:45:54.179 INFO:teuthology.orchestra.run.smithi149.stdout:crond 1049 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-01-01T17:45:54.179 INFO:teuthology.orchestra.run.smithi149.stdout:crond 1049 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-01-01T17:45:54.179 INFO:teuthology.orchestra.run.smithi149.stdout:crond 1049 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-01-01T17:45:54.179 INFO:teuthology.orchestra.run.smithi149.stdout:crond 1049 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-01-01T17:45:54.179 INFO:teuthology.orchestra.run.smithi149.stdout:crond 1049 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-01-01T17:45:54.180 INFO:teuthology.orchestra.run.smithi149.stdout:crond 1049 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:54.180 INFO:teuthology.orchestra.run.smithi149.stdout:crond 1049 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-01-01T17:45:54.180 INFO:teuthology.orchestra.run.smithi149.stdout:crond 1049 root 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.180 INFO:teuthology.orchestra.run.smithi149.stdout:crond 1049 root 1u unix 0xffff8dad09286c00 0t0 19318 type=STREAM 2023-01-01T17:45:54.180 INFO:teuthology.orchestra.run.smithi149.stdout:crond 1049 root 2u unix 0xffff8dad09286c00 0t0 19318 type=STREAM 2023-01-01T17:45:54.180 INFO:teuthology.orchestra.run.smithi149.stdout:crond 1049 root 3uW REG 0,24 5 19319 /run/crond.pid 2023-01-01T17:45:54.181 INFO:teuthology.orchestra.run.smithi149.stdout:crond 1049 root 4u unix 0xffff8dad09281b00 0t0 19320 type=DGRAM 2023-01-01T17:45:54.181 INFO:teuthology.orchestra.run.smithi149.stdout:crond 1049 root 5r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:54.181 INFO:teuthology.orchestra.run.smithi149.stdout:crond 1049 root 7r REG 8,1 9253600 20335 /var/lib/sss/mc/passwd 2023-01-01T17:45:54.181 INFO:teuthology.orchestra.run.smithi149.stdout:crond 1049 root 8u unix 0xffff8dad09287080 0t0 19327 type=STREAM 2023-01-01T17:45:54.181 INFO:teuthology.orchestra.run.smithi149.stdout:nrpe 1258 nrpe cwd DIR 8,1 4096 2 / 2023-01-01T17:45:54.181 INFO:teuthology.orchestra.run.smithi149.stdout:nrpe 1258 nrpe rtd DIR 8,1 4096 2 / 2023-01-01T17:45:54.182 INFO:teuthology.orchestra.run.smithi149.stdout:nrpe 1258 nrpe txt REG 8,1 82312 32484 /usr/sbin/nrpe 2023-01-01T17:45:54.182 INFO:teuthology.orchestra.run.smithi149.stdout:nrpe 1258 nrpe mem REG 8,1 6940392 20342 /var/lib/sss/mc/group 2023-01-01T17:45:54.182 INFO:teuthology.orchestra.run.smithi149.stdout:nrpe 1258 nrpe mem REG 8,1 9253600 20335 /var/lib/sss/mc/passwd 2023-01-01T17:45:54.182 INFO:teuthology.orchestra.run.smithi149.stdout:nrpe 1258 nrpe mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:54.182 INFO:teuthology.orchestra.run.smithi149.stdout:nrpe 1258 nrpe mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:54.182 INFO:teuthology.orchestra.run.smithi149.stdout:nrpe 1258 nrpe mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:54.183 INFO:teuthology.orchestra.run.smithi149.stdout:nrpe 1258 nrpe mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:54.183 INFO:teuthology.orchestra.run.smithi149.stdout:nrpe 1258 nrpe mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:54.183 INFO:teuthology.orchestra.run.smithi149.stdout:nrpe 1258 nrpe mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-01-01T17:45:54.183 INFO:teuthology.orchestra.run.smithi149.stdout:nrpe 1258 nrpe mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-01-01T17:45:54.183 INFO:teuthology.orchestra.run.smithi149.stdout:nrpe 1258 nrpe mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:54.183 INFO:teuthology.orchestra.run.smithi149.stdout:nrpe 1258 nrpe 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.183 INFO:teuthology.orchestra.run.smithi149.stdout:nrpe 1258 nrpe 1w CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.184 INFO:teuthology.orchestra.run.smithi149.stdout:nrpe 1258 nrpe 2w CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.184 INFO:teuthology.orchestra.run.smithi149.stdout:nrpe 1258 nrpe 3r REG 8,1 9253600 20335 /var/lib/sss/mc/passwd 2023-01-01T17:45:54.184 INFO:teuthology.orchestra.run.smithi149.stdout:nrpe 1258 nrpe 4u unix 0xffff8dad427a2d00 0t0 26025 type=DGRAM 2023-01-01T17:45:54.184 INFO:teuthology.orchestra.run.smithi149.stdout:nrpe 1258 nrpe 5r REG 8,1 6940392 20342 /var/lib/sss/mc/group 2023-01-01T17:45:54.184 INFO:teuthology.orchestra.run.smithi149.stdout:nrpe 1258 nrpe 6u IPv4 26034 0t0 TCP *:nrpe (LISTEN) 2023-01-01T17:45:54.184 INFO:teuthology.orchestra.run.smithi149.stdout:nrpe 1258 nrpe 7u IPv6 26035 0t0 TCP *:nrpe (LISTEN) 2023-01-01T17:45:54.184 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:54.185 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:54.185 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root txt REG 8,1 741608 8593 /usr/sbin/rsyslogd 2023-01-01T17:45:54.185 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root mem REG 0,24 8388608 2270 /run/log/journal/5a84457b7b52416e95d47d02e2e4a60f/system.journal 2023-01-01T17:45:54.185 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root mem REG 8,1 34240 8563 /usr/lib64/rsyslog/imjournal.so 2023-01-01T17:45:54.185 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root mem REG 8,1 38824 8570 /usr/lib64/rsyslog/imuxsock.so 2023-01-01T17:45:54.185 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:54.185 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root mem REG 8,1 29376 8571 /usr/lib64/rsyslog/lmnet.so 2023-01-01T17:45:54.186 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:54.186 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:54.186 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:54.186 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:54.186 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:54.186 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:54.186 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:54.186 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:54.187 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:54.187 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:54.187 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:54.187 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:54.187 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:54.187 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root mem REG 8,1 50392 6670 /usr/lib64/libfastjson.so.4.3.0 2023-01-01T17:45:54.187 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root mem REG 8,1 16448 6668 /usr/lib64/libestr.so.0.0.0 2023-01-01T17:45:54.188 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:54.188 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:54.188 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:54.188 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:54.188 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:54.188 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.188 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root 1w CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.188 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root 2w CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.189 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root 3r CHR 1,9 0t0 2056 /dev/urandom 2023-01-01T17:45:54.189 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root 4u unix 0xffff8dad40241680 0t0 32044 type=DGRAM 2023-01-01T17:45:54.189 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root 5w REG 8,1 1012630 262329 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-01T17:45:54.189 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root 6r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:54.189 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root 7w REG 8,1 109976 262328 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-01T17:45:54.189 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root 8w REG 8,1 1540922 66911 /var/log/messages 2023-01-01T17:45:54.189 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root 9w REG 8,1 836104 66912 /var/log/secure 2023-01-01T17:45:54.190 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root 10r REG 0,24 8388608 2270 /run/log/journal/5a84457b7b52416e95d47d02e2e4a60f/system.journal 2023-01-01T17:45:54.190 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 root 11w REG 8,1 5093 66853 /var/log/cron 2023-01-01T17:45:54.190 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:54.190 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:54.190 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root txt REG 8,1 741608 8593 /usr/sbin/rsyslogd 2023-01-01T17:45:54.190 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root mem REG 0,24 8388608 2270 /run/log/journal/5a84457b7b52416e95d47d02e2e4a60f/system.journal 2023-01-01T17:45:54.190 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root mem REG 8,1 34240 8563 /usr/lib64/rsyslog/imjournal.so 2023-01-01T17:45:54.191 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root mem REG 8,1 38824 8570 /usr/lib64/rsyslog/imuxsock.so 2023-01-01T17:45:54.191 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:54.191 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root mem REG 8,1 29376 8571 /usr/lib64/rsyslog/lmnet.so 2023-01-01T17:45:54.191 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:54.191 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:54.191 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:54.191 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:54.192 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:54.192 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:54.192 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:54.192 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:54.192 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:54.192 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:54.192 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:54.192 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:54.193 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:54.193 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root mem REG 8,1 50392 6670 /usr/lib64/libfastjson.so.4.3.0 2023-01-01T17:45:54.193 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root mem REG 8,1 16448 6668 /usr/lib64/libestr.so.0.0.0 2023-01-01T17:45:54.193 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:54.193 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:54.193 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:54.193 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:54.193 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:54.194 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.194 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root 1w CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.194 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root 2w CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.194 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root 3r CHR 1,9 0t0 2056 /dev/urandom 2023-01-01T17:45:54.194 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root 4u unix 0xffff8dad40241680 0t0 32044 type=DGRAM 2023-01-01T17:45:54.194 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root 5w REG 8,1 1012630 262329 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-01T17:45:54.194 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root 6r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:54.195 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root 7w REG 8,1 109976 262328 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-01T17:45:54.195 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root 8w REG 8,1 1540922 66911 /var/log/messages 2023-01-01T17:45:54.195 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root 9w REG 8,1 836104 66912 /var/log/secure 2023-01-01T17:45:54.195 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root 10r REG 0,24 8388608 2270 /run/log/journal/5a84457b7b52416e95d47d02e2e4a60f/system.journal 2023-01-01T17:45:54.195 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1289 in:imjour root 11w REG 8,1 5093 66853 /var/log/cron 2023-01-01T17:45:54.195 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:54.195 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:54.195 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root txt REG 8,1 741608 8593 /usr/sbin/rsyslogd 2023-01-01T17:45:54.196 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root mem REG 0,24 8388608 2270 /run/log/journal/5a84457b7b52416e95d47d02e2e4a60f/system.journal 2023-01-01T17:45:54.196 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root mem REG 8,1 34240 8563 /usr/lib64/rsyslog/imjournal.so 2023-01-01T17:45:54.196 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root mem REG 8,1 38824 8570 /usr/lib64/rsyslog/imuxsock.so 2023-01-01T17:45:54.196 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:54.196 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root mem REG 8,1 29376 8571 /usr/lib64/rsyslog/lmnet.so 2023-01-01T17:45:54.196 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:54.196 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:54.197 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:54.197 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:54.197 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:54.197 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:54.197 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:54.197 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:54.197 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:54.198 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:54.198 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:54.198 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:54.198 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:54.198 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root mem REG 8,1 50392 6670 /usr/lib64/libfastjson.so.4.3.0 2023-01-01T17:45:54.198 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root mem REG 8,1 16448 6668 /usr/lib64/libestr.so.0.0.0 2023-01-01T17:45:54.198 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:54.199 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:54.199 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:54.199 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:54.199 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:54.199 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.199 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root 1w CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.199 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root 2w CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.199 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root 3r CHR 1,9 0t0 2056 /dev/urandom 2023-01-01T17:45:54.200 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root 4u unix 0xffff8dad40241680 0t0 32044 type=DGRAM 2023-01-01T17:45:54.200 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root 5w REG 8,1 1012630 262329 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-01T17:45:54.200 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root 6r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:54.200 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root 7w REG 8,1 109976 262328 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-01T17:45:54.200 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root 8w REG 8,1 1540922 66911 /var/log/messages 2023-01-01T17:45:54.200 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root 9w REG 8,1 836104 66912 /var/log/secure 2023-01-01T17:45:54.200 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root 10r REG 0,24 8388608 2270 /run/log/journal/5a84457b7b52416e95d47d02e2e4a60f/system.journal 2023-01-01T17:45:54.200 INFO:teuthology.orchestra.run.smithi149.stdout:rsyslogd 1259 1301 rs:main root 11w REG 8,1 5093 66853 /var/log/cron 2023-01-01T17:45:54.201 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2362 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:54.201 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2362 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:54.201 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2362 root txt REG 8,1 63872 7630 /usr/sbin/agetty 2023-01-01T17:45:54.201 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2362 root mem REG 8,1 6940392 20342 /var/lib/sss/mc/group 2023-01-01T17:45:54.201 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2362 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:54.201 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2362 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:54.201 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2362 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:54.202 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2362 root mem REG 8,1 337024 17652 /usr/lib/locale/C.utf8/LC_CTYPE 2023-01-01T17:45:54.202 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2362 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:54.202 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2362 root 0u CHR 4,1 0t0 2065 /dev/tty1 2023-01-01T17:45:54.202 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2362 root 1u CHR 4,1 0t0 2065 /dev/tty1 2023-01-01T17:45:54.202 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2362 root 2u CHR 4,1 0t0 2065 /dev/tty1 2023-01-01T17:45:54.202 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2362 root 3r REG 8,1 6940392 20342 /var/lib/sss/mc/group 2023-01-01T17:45:54.202 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2362 root 4u unix 0xffff8dad427a5100 0t0 43216 type=STREAM 2023-01-01T17:45:54.203 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2362 root 6r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:54.203 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2363 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:54.203 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2363 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:54.203 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2363 root txt REG 8,1 63872 7630 /usr/sbin/agetty 2023-01-01T17:45:54.203 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2363 root mem REG 8,1 6940392 20342 /var/lib/sss/mc/group 2023-01-01T17:45:54.203 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2363 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:54.203 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2363 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-01-01T17:45:54.204 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2363 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:54.204 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2363 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:54.204 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2363 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-01-01T17:45:54.204 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2363 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-01-01T17:45:54.204 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2363 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-01-01T17:45:54.204 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2363 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-01-01T17:45:54.204 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2363 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-01-01T17:45:54.205 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2363 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-01-01T17:45:54.205 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2363 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-01-01T17:45:54.205 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2363 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-01-01T17:45:54.205 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2363 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-01-01T17:45:54.205 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2363 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-01-01T17:45:54.205 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2363 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:54.205 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2363 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-01-01T17:45:54.206 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2363 root 0u CHR 4,65 0t0 2157 /dev/ttyS1 2023-01-01T17:45:54.206 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2363 root 1u CHR 4,65 0t0 2157 /dev/ttyS1 2023-01-01T17:45:54.206 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2363 root 2u CHR 4,65 0t0 2157 /dev/ttyS1 2023-01-01T17:45:54.206 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2363 root 3r REG 8,1 6940392 20342 /var/lib/sss/mc/group 2023-01-01T17:45:54.206 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2363 root 4u unix 0xffff8dad40cead00 0t0 36490 type=STREAM 2023-01-01T17:45:54.206 INFO:teuthology.orchestra.run.smithi149.stdout:agetty 2363 root 6r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:54.206 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:54.207 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:54.207 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root txt REG 8,1 886344 11056 /usr/sbin/sshd 2023-01-01T17:45:54.207 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-01-01T17:45:54.207 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:54.207 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 11567160 66904 /var/lib/sss/mc/initgroups 2023-01-01T17:45:54.207 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 20168 19469 /usr/lib64/security/pam_lastlog.so 2023-01-01T17:45:54.207 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 11760 19494 /usr/lib64/security/pam_umask.so 2023-01-01T17:45:54.208 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 15968 19490 /usr/lib64/security/pam_succeed_if.so 2023-01-01T17:45:54.208 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 16608 7487 /usr/lib64/libpam_misc.so.0.82.1 2023-01-01T17:45:54.208 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 918928 19694 /usr/lib64/security/pam_systemd.so 2023-01-01T17:45:54.208 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 24080 19470 /usr/lib64/security/pam_limits.so 2023-01-01T17:45:54.208 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 11872 19476 /usr/lib64/security/pam_motd.so 2023-01-01T17:45:54.208 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 11768 19468 /usr/lib64/security/pam_keyinit.so 2023-01-01T17:45:54.208 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 45384 19477 /usr/lib64/security/pam_namespace.so 2023-01-01T17:45:54.209 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 11800 19473 /usr/lib64/security/pam_loginuid.so 2023-01-01T17:45:54.209 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 24200 19485 /usr/lib64/security/pam_selinux.so 2023-01-01T17:45:54.209 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 46232 6935 /usr/lib64/libcrack.so.2.9.0 2023-01-01T17:45:54.209 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 24744 7447 /usr/lib64/libpwquality.so.1.0.2 2023-01-01T17:45:54.209 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 11720 19411 /usr/lib64/security/pam_pwquality.so 2023-01-01T17:45:54.209 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 7672 19479 /usr/lib64/security/pam_permit.so 2023-01-01T17:45:54.209 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 11808 19478 /usr/lib64/security/pam_nologin.so 2023-01-01T17:45:54.210 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 15920 19487 /usr/lib64/security/pam_sepermit.so 2023-01-01T17:45:54.210 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 7592 19456 /usr/lib64/security/pam_deny.so 2023-01-01T17:45:54.210 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 58048 20616 /usr/lib64/security/pam_sss.so 2023-01-01T17:45:54.210 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 213592 7033 /usr/lib64/libtirpc.so.3.0.0 2023-01-01T17:45:54.210 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 116408 7035 /usr/lib64/libnsl.so.2.0.0 2023-01-01T17:45:54.210 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 58088 19495 /usr/lib64/security/pam_unix.so 2023-01-01T17:45:54.210 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 11776 19472 /usr/lib64/security/pam_localuser.so 2023-01-01T17:45:54.211 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 11856 19501 /usr/lib64/security/pam_usertype.so 2023-01-01T17:45:54.211 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 11752 19460 /usr/lib64/security/pam_faildelay.so 2023-01-01T17:45:54.211 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 20192 19458 /usr/lib64/security/pam_env.so 2023-01-01T17:45:54.211 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 6940392 20342 /var/lib/sss/mc/group 2023-01-01T17:45:54.211 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 9253600 20335 /var/lib/sss/mc/passwd 2023-01-01T17:45:54.211 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:54.211 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:54.212 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:54.212 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:54.212 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-01-01T17:45:54.212 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-01-01T17:45:54.212 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:54.212 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:54.212 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:54.212 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:54.213 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:54.213 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:54.213 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:54.213 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:54.213 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:54.213 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-01-01T17:45:54.214 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:54.214 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-01-01T17:45:54.214 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-01-01T17:45:54.214 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-01-01T17:45:54.214 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-01-01T17:45:54.214 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:54.214 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:54.214 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-01-01T17:45:54.215 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:54.215 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-01-01T17:45:54.215 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:54.215 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-01-01T17:45:54.215 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:54.215 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-01-01T17:45:54.215 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-01-01T17:45:54.216 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:54.216 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root 0u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.216 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root 1u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.216 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root 2u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.216 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root 3u unix 0xffff8dad40243a80 0t0 39766 type=DGRAM 2023-01-01T17:45:54.216 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root 4r REG 8,1 9253600 20335 /var/lib/sss/mc/passwd 2023-01-01T17:45:54.216 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root 5u IPv4 39750 0t0 TCP smithi149.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:45206 (ESTABLISHED) 2023-01-01T17:45:54.217 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root 6u unix 0xffff8dad403ba400 0t0 37758 type=STREAM 2023-01-01T17:45:54.217 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root 7r REG 8,1 11567160 66904 /var/lib/sss/mc/initgroups 2023-01-01T17:45:54.217 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root 8r REG 8,1 6940392 20342 /var/lib/sss/mc/group 2023-01-01T17:45:54.217 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root 9u unix 0xffff8dad403be780 0t0 37762 type=STREAM 2023-01-01T17:45:54.217 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root 11w FIFO 0,24 0t0 41880 /run/systemd/sessions/1.ref 2023-01-01T17:45:54.217 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6006 root 12u unix 0xffff8dad40240480 0t0 39770 type=STREAM 2023-01-01T17:45:54.217 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu cwd DIR 8,1 4096 2 / 2023-01-01T17:45:54.218 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu rtd DIR 8,1 4096 2 / 2023-01-01T17:45:54.218 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu txt REG 8,1 1601312 8116 /usr/lib/systemd/systemd 2023-01-01T17:45:54.218 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-01-01T17:45:54.218 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-01-01T17:45:54.218 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu mem REG 8,1 735192 5135 /usr/lib64/libsepol.so.1 2023-01-01T17:45:54.218 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-01-01T17:45:54.218 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:54.219 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu mem REG 8,1 66912 5393 /usr/lib64/libjson-c.so.4.0.0 2023-01-01T17:45:54.219 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu mem REG 8,1 371240 32501 /usr/lib64/libdevmapper.so.1.02 2023-01-01T17:45:54.219 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu mem REG 8,1 26192 5300 /usr/lib64/libattr.so.1.1.2448 2023-01-01T17:45:54.219 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-01-01T17:45:54.219 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-01-01T17:45:54.219 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:54.219 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-01-01T17:45:54.220 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:54.220 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:54.220 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:54.220 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:54.220 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:54.220 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:54.220 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-01-01T17:45:54.221 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:54.221 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu mem REG 8,1 526360 7346 /usr/lib64/libcryptsetup.so.12.6.0 2023-01-01T17:45:54.221 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu mem REG 8,1 54816 5302 /usr/lib64/libacl.so.1.1.2253 2023-01-01T17:45:54.221 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:54.221 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:54.221 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:54.222 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:54.222 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu mem REG 8,1 100200 7343 /usr/lib64/libkmod.so.2.3.3 2023-01-01T17:45:54.222 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-01-01T17:45:54.222 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-01-01T17:45:54.222 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:54.222 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:54.232 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu mem REG 8,1 128784 5906 /usr/lib64/libseccomp.so.2.5.2 2023-01-01T17:45:54.232 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:54.232 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu mem REG 8,1 2740672 8111 /usr/lib/systemd/libsystemd-shared-239.so 2023-01-01T17:45:54.232 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:54.232 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.233 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu 1u unix 0xffff8dad41994380 0t0 38835 type=STREAM 2023-01-01T17:45:54.233 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu 2u unix 0xffff8dad41994380 0t0 38835 type=STREAM 2023-01-01T17:45:54.233 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu 3u unix 0xffff8dad41993180 0t0 38852 type=DGRAM 2023-01-01T17:45:54.233 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu 4u a_inode 0,14 0 11447 [eventpoll] 2023-01-01T17:45:54.233 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu 5u a_inode 0,14 0 11447 [signalfd] 2023-01-01T17:45:54.233 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu 6r DIR 0,26 0 818 /sys/fs/cgroup/systemd/user.slice/user-1000.slice/user@1000.service 2023-01-01T17:45:54.234 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu 7u a_inode 0,14 0 11447 [timerfd] 2023-01-01T17:45:54.234 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu 8u netlink 0t0 38859 KOBJECT_UEVENT 2023-01-01T17:45:54.234 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu 9u a_inode 0,14 0 11447 [eventpoll] 2023-01-01T17:45:54.234 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu 10r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:54.234 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu 11u unix 0xffff8dad41993a80 0t0 38877 /run/user/1000/bus type=STREAM 2023-01-01T17:45:54.235 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu 12r REG 0,5 0 38864 /proc/6011/mountinfo 2023-01-01T17:45:54.235 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu 13r a_inode 0,14 0 11447 inotify 2023-01-01T17:45:54.236 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu 14r REG 0,5 0 4026532074 /proc/swaps 2023-01-01T17:45:54.236 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu 15u unix 0xffff8dad41994800 0t0 38865 /run/user/1000/systemd/notify type=DGRAM 2023-01-01T17:45:54.236 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu 16u unix 0xffff8dad41990000 0t0 38867 type=DGRAM 2023-01-01T17:45:54.236 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu 17u unix 0xffff8dad41994c80 0t0 38868 type=DGRAM 2023-01-01T17:45:54.236 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu 18u unix 0xffff8dad41990480 0t0 38869 /run/user/1000/systemd/private type=STREAM 2023-01-01T17:45:54.236 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu 19u unix 0xffff8dad41995100 0t0 38871 type=STREAM 2023-01-01T17:45:54.236 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu 20u a_inode 0,14 0 11447 [timerfd] 2023-01-01T17:45:54.236 INFO:teuthology.orchestra.run.smithi149.stdout:systemd 6011 ubuntu 26u netlink 0t0 38880 SELINUX 2023-01-01T17:45:54.237 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu cwd DIR 8,1 4096 2 / 2023-01-01T17:45:54.237 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu rtd DIR 8,1 4096 2 / 2023-01-01T17:45:54.237 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu txt REG 8,1 1601312 8116 /usr/lib/systemd/systemd 2023-01-01T17:45:54.237 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 7592 19456 /usr/lib64/security/pam_deny.so 2023-01-01T17:45:54.237 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 15968 19490 /usr/lib64/security/pam_succeed_if.so 2023-01-01T17:45:54.237 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 16608 7487 /usr/lib64/libpam_misc.so.0.82.1 2023-01-01T17:45:54.237 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 918928 19694 /usr/lib64/security/pam_systemd.so 2023-01-01T17:45:54.237 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 24080 19470 /usr/lib64/security/pam_limits.so 2023-01-01T17:45:54.238 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 11768 19468 /usr/lib64/security/pam_keyinit.so 2023-01-01T17:45:54.238 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 11800 19473 /usr/lib64/security/pam_loginuid.so 2023-01-01T17:45:54.238 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 24200 19485 /usr/lib64/security/pam_selinux.so 2023-01-01T17:45:54.238 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 7672 19479 /usr/lib64/security/pam_permit.so 2023-01-01T17:45:54.238 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 58048 20616 /usr/lib64/security/pam_sss.so 2023-01-01T17:45:54.238 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 11856 19501 /usr/lib64/security/pam_usertype.so 2023-01-01T17:45:54.238 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 11776 19472 /usr/lib64/security/pam_localuser.so 2023-01-01T17:45:54.239 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:54.239 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-01-01T17:45:54.239 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-01-01T17:45:54.239 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-01-01T17:45:54.239 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-01-01T17:45:54.239 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-01-01T17:45:54.239 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-01-01T17:45:54.239 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 213592 7033 /usr/lib64/libtirpc.so.3.0.0 2023-01-01T17:45:54.240 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 116408 7035 /usr/lib64/libnsl.so.2.0.0 2023-01-01T17:45:54.240 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-01-01T17:45:54.240 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 58088 19495 /usr/lib64/security/pam_unix.so 2023-01-01T17:45:54.240 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-01-01T17:45:54.240 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:54.240 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 11567160 66904 /var/lib/sss/mc/initgroups 2023-01-01T17:45:54.240 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 9253600 20335 /var/lib/sss/mc/passwd 2023-01-01T17:45:54.241 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:54.241 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-01-01T17:45:54.241 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-01-01T17:45:54.241 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 735192 5135 /usr/lib64/libsepol.so.1 2023-01-01T17:45:54.241 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-01-01T17:45:54.241 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:54.241 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 66912 5393 /usr/lib64/libjson-c.so.4.0.0 2023-01-01T17:45:54.242 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 371240 32501 /usr/lib64/libdevmapper.so.1.02 2023-01-01T17:45:54.242 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 26192 5300 /usr/lib64/libattr.so.1.1.2448 2023-01-01T17:45:54.242 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-01-01T17:45:54.242 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-01-01T17:45:54.242 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:54.242 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-01-01T17:45:54.242 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:54.243 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:54.243 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:54.243 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:54.243 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:54.243 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:54.243 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-01-01T17:45:54.244 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:54.244 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 526360 7346 /usr/lib64/libcryptsetup.so.12.6.0 2023-01-01T17:45:54.244 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 54816 5302 /usr/lib64/libacl.so.1.1.2253 2023-01-01T17:45:54.244 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:54.244 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:54.244 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:54.244 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:54.245 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 100200 7343 /usr/lib64/libkmod.so.2.3.3 2023-01-01T17:45:54.245 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-01-01T17:45:54.245 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-01-01T17:45:54.246 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:54.246 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:54.246 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 128784 5906 /usr/lib64/libseccomp.so.2.5.2 2023-01-01T17:45:54.246 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:54.246 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 2740672 8111 /usr/lib/systemd/libsystemd-shared-239.so 2023-01-01T17:45:54.246 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:54.246 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 576141 1062 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-01-01T17:45:54.247 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu mem REG 8,1 19983 1966 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-01-01T17:45:54.247 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.247 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu 1u unix 0xffff8dad41994380 0t0 38835 type=STREAM 2023-01-01T17:45:54.247 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu 2u unix 0xffff8dad41994380 0t0 38835 type=STREAM 2023-01-01T17:45:54.248 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu 3r REG 8,1 9253600 20335 /var/lib/sss/mc/passwd 2023-01-01T17:45:54.248 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu 4r REG 8,1 11567160 66904 /var/lib/sss/mc/initgroups 2023-01-01T17:45:54.248 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu 5u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:54.248 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu 6u a_inode 0,14 0 11447 [eventfd] 2023-01-01T17:45:54.248 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu 8w FIFO 0,13 0t0 38836 pipe 2023-01-01T17:45:54.248 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu 9u unix 0xffff8dad41997500 0t0 38848 type=STREAM 2023-01-01T17:45:54.248 INFO:teuthology.orchestra.run.smithi149.stdout:(sd-pam) 6014 ubuntu 10u unix 0xffff8dad41992880 0t0 38849 type=DGRAM 2023-01-01T17:45:54.249 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu cwd DIR 8,1 4096 2 / 2023-01-01T17:45:54.249 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu rtd DIR 8,1 4096 2 / 2023-01-01T17:45:54.249 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu txt REG 8,1 886344 11056 /usr/sbin/sshd 2023-01-01T17:45:54.249 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-01-01T17:45:54.249 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:54.250 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 11567160 66904 /var/lib/sss/mc/initgroups 2023-01-01T17:45:54.250 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 20168 19469 /usr/lib64/security/pam_lastlog.so 2023-01-01T17:45:54.250 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 11760 19494 /usr/lib64/security/pam_umask.so 2023-01-01T17:45:54.251 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 15968 19490 /usr/lib64/security/pam_succeed_if.so 2023-01-01T17:45:54.251 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 16608 7487 /usr/lib64/libpam_misc.so.0.82.1 2023-01-01T17:45:54.251 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 918928 19694 /usr/lib64/security/pam_systemd.so 2023-01-01T17:45:54.251 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 24080 19470 /usr/lib64/security/pam_limits.so 2023-01-01T17:45:54.252 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 11872 19476 /usr/lib64/security/pam_motd.so 2023-01-01T17:45:54.252 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 11768 19468 /usr/lib64/security/pam_keyinit.so 2023-01-01T17:45:54.252 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 45384 19477 /usr/lib64/security/pam_namespace.so 2023-01-01T17:45:54.252 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 11800 19473 /usr/lib64/security/pam_loginuid.so 2023-01-01T17:45:54.252 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 24200 19485 /usr/lib64/security/pam_selinux.so 2023-01-01T17:45:54.253 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 46232 6935 /usr/lib64/libcrack.so.2.9.0 2023-01-01T17:45:54.253 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 24744 7447 /usr/lib64/libpwquality.so.1.0.2 2023-01-01T17:45:54.253 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 11720 19411 /usr/lib64/security/pam_pwquality.so 2023-01-01T17:45:54.253 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 7672 19479 /usr/lib64/security/pam_permit.so 2023-01-01T17:45:54.253 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 11808 19478 /usr/lib64/security/pam_nologin.so 2023-01-01T17:45:54.254 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 15920 19487 /usr/lib64/security/pam_sepermit.so 2023-01-01T17:45:54.254 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 7592 19456 /usr/lib64/security/pam_deny.so 2023-01-01T17:45:54.254 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 58048 20616 /usr/lib64/security/pam_sss.so 2023-01-01T17:45:54.254 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 213592 7033 /usr/lib64/libtirpc.so.3.0.0 2023-01-01T17:45:54.254 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 116408 7035 /usr/lib64/libnsl.so.2.0.0 2023-01-01T17:45:54.254 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 58088 19495 /usr/lib64/security/pam_unix.so 2023-01-01T17:45:54.254 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 11776 19472 /usr/lib64/security/pam_localuser.so 2023-01-01T17:45:54.255 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 11856 19501 /usr/lib64/security/pam_usertype.so 2023-01-01T17:45:54.255 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 11752 19460 /usr/lib64/security/pam_faildelay.so 2023-01-01T17:45:54.255 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 20192 19458 /usr/lib64/security/pam_env.so 2023-01-01T17:45:54.255 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 6940392 20342 /var/lib/sss/mc/group 2023-01-01T17:45:54.256 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 9253600 20335 /var/lib/sss/mc/passwd 2023-01-01T17:45:54.256 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:54.256 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-01-01T17:45:54.256 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:54.256 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:54.256 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-01-01T17:45:54.257 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-01-01T17:45:54.257 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:54.257 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:54.257 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:54.257 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-01-01T17:45:54.257 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:54.258 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:54.258 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-01-01T17:45:54.258 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-01-01T17:45:54.258 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:54.258 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-01-01T17:45:54.258 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:54.258 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-01-01T17:45:54.259 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-01-01T17:45:54.259 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-01-01T17:45:54.259 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-01-01T17:45:54.259 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:54.259 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:54.259 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-01-01T17:45:54.259 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:54.260 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-01-01T17:45:54.260 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:54.260 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-01-01T17:45:54.260 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 1379360 7239 /usr/lib64/libsystemd.so.0.23.0 2023-01-01T17:45:54.260 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-01-01T17:45:54.260 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-01-01T17:45:54.260 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:54.260 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu 0u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.261 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu 1u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.261 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu 2u CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.261 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu 3u unix 0xffff8dad40243a80 0t0 39766 type=DGRAM 2023-01-01T17:45:54.261 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu 4r REG 8,1 9253600 20335 /var/lib/sss/mc/passwd 2023-01-01T17:45:54.261 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu 5u IPv4 39750 0t0 TCP smithi149.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:45206 (ESTABLISHED) 2023-01-01T17:45:54.261 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu 6u unix 0xffff8dad403ba400 0t0 37758 type=STREAM 2023-01-01T17:45:54.261 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu 7r REG 8,1 11567160 66904 /var/lib/sss/mc/initgroups 2023-01-01T17:45:54.262 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu 8r REG 8,1 6940392 20342 /var/lib/sss/mc/group 2023-01-01T17:45:54.262 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu 9u unix 0xffff8dad403be780 0t0 37762 type=STREAM 2023-01-01T17:45:54.262 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu 10u unix 0xffff8dad40241b00 0t0 39769 type=STREAM 2023-01-01T17:45:54.262 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu 11w FIFO 0,24 0t0 41880 /run/systemd/sessions/1.ref 2023-01-01T17:45:54.262 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu 12r FIFO 0,13 0t0 43299 pipe 2023-01-01T17:45:54.262 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu 13w FIFO 0,13 0t0 43299 pipe 2023-01-01T17:45:54.262 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu 18r FIFO 0,13 0t0 48172 pipe 2023-01-01T17:45:54.263 INFO:teuthology.orchestra.run.smithi149.stdout:sshd 6020 ubuntu 20r FIFO 0,13 0t0 48173 pipe 2023-01-01T17:45:54.263 INFO:teuthology.orchestra.run.smithi149.stdout:sleep 6222 root cwd DIR 8,1 4096 2 / 2023-01-01T17:45:54.263 INFO:teuthology.orchestra.run.smithi149.stdout:sleep 6222 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:54.263 INFO:teuthology.orchestra.run.smithi149.stdout:sleep 6222 root txt REG 8,1 38296 7205 /usr/bin/sleep 2023-01-01T17:45:54.263 INFO:teuthology.orchestra.run.smithi149.stdout:sleep 6222 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-01-01T17:45:54.263 INFO:teuthology.orchestra.run.smithi149.stdout:sleep 6222 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:54.263 INFO:teuthology.orchestra.run.smithi149.stdout:sleep 6222 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:54.264 INFO:teuthology.orchestra.run.smithi149.stdout:sleep 6222 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-01-01T17:45:54.264 INFO:teuthology.orchestra.run.smithi149.stdout:sleep 6222 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-01-01T17:45:54.264 INFO:teuthology.orchestra.run.smithi149.stdout:sleep 6222 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-01-01T17:45:54.264 INFO:teuthology.orchestra.run.smithi149.stdout:sleep 6222 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-01-01T17:45:54.264 INFO:teuthology.orchestra.run.smithi149.stdout:sleep 6222 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-01-01T17:45:54.264 INFO:teuthology.orchestra.run.smithi149.stdout:sleep 6222 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-01-01T17:45:54.264 INFO:teuthology.orchestra.run.smithi149.stdout:sleep 6222 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-01-01T17:45:54.264 INFO:teuthology.orchestra.run.smithi149.stdout:sleep 6222 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-01-01T17:45:54.265 INFO:teuthology.orchestra.run.smithi149.stdout:sleep 6222 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-01-01T17:45:54.265 INFO:teuthology.orchestra.run.smithi149.stdout:sleep 6222 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-01-01T17:45:54.265 INFO:teuthology.orchestra.run.smithi149.stdout:sleep 6222 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:54.265 INFO:teuthology.orchestra.run.smithi149.stdout:sleep 6222 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-01-01T17:45:54.265 INFO:teuthology.orchestra.run.smithi149.stdout:sleep 6222 root 0r CHR 1,3 0t0 2051 /dev/null 2023-01-01T17:45:54.265 INFO:teuthology.orchestra.run.smithi149.stdout:sleep 6222 root 1u unix 0xffff8dad402bc380 0t0 24494 type=STREAM 2023-01-01T17:45:54.266 INFO:teuthology.orchestra.run.smithi149.stdout:sleep 6222 root 2u unix 0xffff8dad402bc380 0t0 24494 type=STREAM 2023-01-01T17:45:54.266 INFO:teuthology.orchestra.run.smithi149.stdout:bash 6288 ubuntu cwd DIR 8,1 4096 1010 /home/ubuntu 2023-01-01T17:45:54.266 INFO:teuthology.orchestra.run.smithi149.stdout:bash 6288 ubuntu rtd DIR 8,1 4096 2 / 2023-01-01T17:45:54.266 INFO:teuthology.orchestra.run.smithi149.stdout:bash 6288 ubuntu txt REG 8,1 1150584 5025 /usr/bin/bash 2023-01-01T17:45:54.267 INFO:teuthology.orchestra.run.smithi149.stdout:bash 6288 ubuntu mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-01-01T17:45:54.267 INFO:teuthology.orchestra.run.smithi149.stdout:bash 6288 ubuntu mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:54.267 INFO:teuthology.orchestra.run.smithi149.stdout:bash 6288 ubuntu mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:54.267 INFO:teuthology.orchestra.run.smithi149.stdout:bash 6288 ubuntu mem REG 8,1 187496 4713 /usr/lib64/libtinfo.so.6.1 2023-01-01T17:45:54.267 INFO:teuthology.orchestra.run.smithi149.stdout:bash 6288 ubuntu mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:54.267 INFO:teuthology.orchestra.run.smithi149.stdout:bash 6288 ubuntu mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-01-01T17:45:54.267 INFO:teuthology.orchestra.run.smithi149.stdout:bash 6288 ubuntu mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-01-01T17:45:54.267 INFO:teuthology.orchestra.run.smithi149.stdout:bash 6288 ubuntu mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-01-01T17:45:54.268 INFO:teuthology.orchestra.run.smithi149.stdout:bash 6288 ubuntu mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-01-01T17:45:54.268 INFO:teuthology.orchestra.run.smithi149.stdout:bash 6288 ubuntu mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-01-01T17:45:54.268 INFO:teuthology.orchestra.run.smithi149.stdout:bash 6288 ubuntu mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-01-01T17:45:54.268 INFO:teuthology.orchestra.run.smithi149.stdout:bash 6288 ubuntu mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-01-01T17:45:54.268 INFO:teuthology.orchestra.run.smithi149.stdout:bash 6288 ubuntu mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-01-01T17:45:54.268 INFO:teuthology.orchestra.run.smithi149.stdout:bash 6288 ubuntu mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-01-01T17:45:54.268 INFO:teuthology.orchestra.run.smithi149.stdout:bash 6288 ubuntu mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-01-01T17:45:54.269 INFO:teuthology.orchestra.run.smithi149.stdout:bash 6288 ubuntu mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:54.269 INFO:teuthology.orchestra.run.smithi149.stdout:bash 6288 ubuntu mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-01-01T17:45:54.269 INFO:teuthology.orchestra.run.smithi149.stdout:bash 6288 ubuntu 0r FIFO 0,13 0t0 48171 pipe 2023-01-01T17:45:54.269 INFO:teuthology.orchestra.run.smithi149.stdout:bash 6288 ubuntu 1w FIFO 0,13 0t0 48172 pipe 2023-01-01T17:45:54.269 INFO:teuthology.orchestra.run.smithi149.stdout:bash 6288 ubuntu 2w FIFO 0,13 0t0 48173 pipe 2023-01-01T17:45:54.269 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root cwd DIR 8,1 4096 1010 /home/ubuntu 2023-01-01T17:45:54.269 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:54.270 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root txt REG 8,1 165528 9884 /usr/bin/sudo 2023-01-01T17:45:54.270 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 15968 19490 /usr/lib64/security/pam_succeed_if.so 2023-01-01T17:45:54.270 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 16608 7487 /usr/lib64/libpam_misc.so.0.82.1 2023-01-01T17:45:54.270 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 918928 19694 /usr/lib64/security/pam_systemd.so 2023-01-01T17:45:54.270 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 24080 19470 /usr/lib64/security/pam_limits.so 2023-01-01T17:45:54.270 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 11768 19468 /usr/lib64/security/pam_keyinit.so 2023-01-01T17:45:54.270 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 46232 6935 /usr/lib64/libcrack.so.2.9.0 2023-01-01T17:45:54.270 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 24744 7447 /usr/lib64/libpwquality.so.1.0.2 2023-01-01T17:45:54.271 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 11720 19411 /usr/lib64/security/pam_pwquality.so 2023-01-01T17:45:54.271 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 7672 19479 /usr/lib64/security/pam_permit.so 2023-01-01T17:45:54.271 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 7592 19456 /usr/lib64/security/pam_deny.so 2023-01-01T17:45:54.271 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 58048 20616 /usr/lib64/security/pam_sss.so 2023-01-01T17:45:54.271 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 213592 7033 /usr/lib64/libtirpc.so.3.0.0 2023-01-01T17:45:54.271 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 116408 7035 /usr/lib64/libnsl.so.2.0.0 2023-01-01T17:45:54.272 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 58088 19495 /usr/lib64/security/pam_unix.so 2023-01-01T17:45:54.272 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 11776 19472 /usr/lib64/security/pam_localuser.so 2023-01-01T17:45:54.272 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 11856 19501 /usr/lib64/security/pam_usertype.so 2023-01-01T17:45:54.272 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 11752 19460 /usr/lib64/security/pam_faildelay.so 2023-01-01T17:45:54.272 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 20192 19458 /usr/lib64/security/pam_env.so 2023-01-01T17:45:54.272 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 6940392 20342 /var/lib/sss/mc/group 2023-01-01T17:45:54.272 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-01-01T17:45:54.272 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-01-01T17:45:54.273 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-01-01T17:45:54.273 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-01-01T17:45:54.273 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-01-01T17:45:54.273 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-01-01T17:45:54.273 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 919088 7237 /usr/lib64/libnss_systemd.so.2 2023-01-01T17:45:54.273 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 11567160 66904 /var/lib/sss/mc/initgroups 2023-01-01T17:45:54.273 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 54352 4998 /usr/lib64/libnss_files-2.28.so 2023-01-01T17:45:54.274 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-01-01T17:45:54.274 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-01-01T17:45:54.274 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-01-01T17:45:54.274 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-01-01T17:45:54.274 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-01-01T17:45:54.274 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-01-01T17:45:54.274 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 136040 5205 /usr/lib64/libcrypt.so.1.1.0 2023-01-01T17:45:54.275 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-01-01T17:45:54.275 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-01-01T17:45:54.275 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 125440 6685 /usr/lib64/libsasl2.so.3.0.0 2023-01-01T17:45:54.275 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:54.275 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:54.275 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 67232 6713 /usr/lib64/liblber-2.4.so.2.10.9 2023-01-01T17:45:54.275 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 329184 6715 /usr/lib64/libldap-2.4.so.2.10.9 2023-01-01T17:45:54.276 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-01-01T17:45:54.276 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 432960 47003 /usr/libexec/sudo/sudoers.so 2023-01-01T17:45:54.276 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 9253600 20335 /var/lib/sss/mc/passwd 2023-01-01T17:45:54.276 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 46312 9881 /usr/lib64/libnss_sss.so.2 2023-01-01T17:45:54.277 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-01-01T17:45:54.277 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:54.277 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-01-01T17:45:54.277 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:54.277 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:54.277 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:54.277 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 104520 47000 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-01-01T17:45:54.277 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 17008 5008 /usr/lib64/libutil-2.28.so 2023-01-01T17:45:54.278 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:54.278 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-01-01T17:45:54.278 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:54.278 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-01-01T17:45:54.278 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-01-01T17:45:54.278 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-01-01T17:45:54.278 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-01-01T17:45:54.278 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-01-01T17:45:54.279 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-01-01T17:45:54.279 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-01-01T17:45:54.280 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-01-01T17:45:54.280 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-01-01T17:45:54.280 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-01-01T17:45:54.280 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:54.280 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-01-01T17:45:54.280 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root 0r FIFO 0,13 0t0 48171 pipe 2023-01-01T17:45:54.281 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root 1w FIFO 0,13 0t0 48172 pipe 2023-01-01T17:45:54.281 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root 2w FIFO 0,13 0t0 48173 pipe 2023-01-01T17:45:54.281 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root 3r REG 8,1 9253600 20335 /var/lib/sss/mc/passwd 2023-01-01T17:45:54.281 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root 4u unix 0xffff8dad403b9f80 0t0 47273 type=STREAM 2023-01-01T17:45:54.281 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root 5u netlink 0t0 44906 AUDIT 2023-01-01T17:45:54.281 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root 6r REG 8,1 11567160 66904 /var/lib/sss/mc/initgroups 2023-01-01T17:45:54.281 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root 7r REG 8,1 6940392 20342 /var/lib/sss/mc/group 2023-01-01T17:45:54.282 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root 9u unix 0xffff8dad09283600 0t0 44909 type=DGRAM 2023-01-01T17:45:54.282 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root 10r FIFO 0,13 0t0 44912 pipe 2023-01-01T17:45:54.282 INFO:teuthology.orchestra.run.smithi149.stdout:sudo 6307 root 11w FIFO 0,13 0t0 44912 pipe 2023-01-01T17:45:54.282 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6309 root cwd DIR 8,1 4096 1010 /home/ubuntu 2023-01-01T17:45:54.282 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6309 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:54.282 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6309 root txt REG 8,1 179672 11398 /usr/bin/lsof 2023-01-01T17:45:54.282 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6309 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:54.283 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6309 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:54.283 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6309 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-01-01T17:45:54.283 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6309 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-01-01T17:45:54.283 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6309 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-01-01T17:45:54.283 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6309 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:54.283 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6309 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-01-01T17:45:54.283 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6309 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-01-01T17:45:54.284 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6309 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-01-01T17:45:54.284 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6309 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-01-01T17:45:54.284 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6309 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:54.284 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6309 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:54.284 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6309 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:54.284 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6309 root mem REG 8,1 213592 7033 /usr/lib64/libtirpc.so.3.0.0 2023-01-01T17:45:54.284 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6309 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:54.285 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6309 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:54.285 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6309 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-01-01T17:45:54.285 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6309 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:54.285 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6309 root 0r FIFO 0,13 0t0 48171 pipe 2023-01-01T17:45:54.285 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6309 root 1w FIFO 0,13 0t0 48172 pipe 2023-01-01T17:45:54.285 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6309 root 2w FIFO 0,13 0t0 48173 pipe 2023-01-01T17:45:54.286 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6309 root 3r DIR 0,5 0 1 /proc 2023-01-01T17:45:54.286 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6309 root 4r DIR 0,5 0 47284 /proc/6309/fd 2023-01-01T17:45:54.286 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6309 root 5w FIFO 0,13 0t0 47294 pipe 2023-01-01T17:45:54.286 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6309 root 6r FIFO 0,13 0t0 47295 pipe 2023-01-01T17:45:54.286 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6310 root cwd DIR 8,1 4096 1010 /home/ubuntu 2023-01-01T17:45:54.286 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6310 root rtd DIR 8,1 4096 2 / 2023-01-01T17:45:54.286 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6310 root txt REG 8,1 179672 11398 /usr/bin/lsof 2023-01-01T17:45:54.286 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6310 root mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-01-01T17:45:54.287 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6310 root mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-01-01T17:45:54.287 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6310 root mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-01-01T17:45:54.287 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6310 root mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-01-01T17:45:54.287 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6310 root mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-01-01T17:45:54.287 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6310 root mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-01-01T17:45:54.287 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6310 root mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-01-01T17:45:54.287 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6310 root mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-01-01T17:45:54.288 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6310 root mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-01-01T17:45:54.288 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6310 root mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-01-01T17:45:54.288 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6310 root mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-01-01T17:45:54.288 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6310 root mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-01-01T17:45:54.288 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6310 root mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-01-01T17:45:54.288 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6310 root mem REG 8,1 213592 7033 /usr/lib64/libtirpc.so.3.0.0 2023-01-01T17:45:54.288 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6310 root mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-01-01T17:45:54.288 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6310 root mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-01-01T17:45:54.289 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6310 root mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-01-01T17:45:54.289 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6310 root mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-01-01T17:45:54.289 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6310 root 4r FIFO 0,13 0t0 47294 pipe 2023-01-01T17:45:54.289 INFO:teuthology.orchestra.run.smithi149.stdout:lsof 6310 root 7w FIFO 0,13 0t0 47295 pipe 2023-01-01T17:45:54.289 INFO:teuthology.orchestra.run.smithi149.stdout:USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND 2023-01-01T17:45:54.289 INFO:teuthology.orchestra.run.smithi149.stdout:root 2 0.0 0.0 0 0 ? S 17:42 0:00 [kthreadd] 2023-01-01T17:45:54.289 INFO:teuthology.orchestra.run.smithi149.stdout:root 3 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [rcu_gp] 2023-01-01T17:45:54.290 INFO:teuthology.orchestra.run.smithi149.stdout:root 4 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [rcu_par_gp] 2023-01-01T17:45:54.290 INFO:teuthology.orchestra.run.smithi149.stdout:root 5 0.0 0.0 0 0 ? I 17:42 0:00 \_ [kworker/0:0-events] 2023-01-01T17:45:54.290 INFO:teuthology.orchestra.run.smithi149.stdout:root 6 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [kworker/0:0H-events_highpri] 2023-01-01T17:45:54.290 INFO:teuthology.orchestra.run.smithi149.stdout:root 7 0.2 0.0 0 0 ? I 17:42 0:00 \_ [kworker/0:1-events] 2023-01-01T17:45:54.290 INFO:teuthology.orchestra.run.smithi149.stdout:root 8 0.0 0.0 0 0 ? I 17:42 0:00 \_ [kworker/u16:0-events_unbound] 2023-01-01T17:45:54.290 INFO:teuthology.orchestra.run.smithi149.stdout:root 9 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [mm_percpu_wq] 2023-01-01T17:45:54.290 INFO:teuthology.orchestra.run.smithi149.stdout:root 10 0.0 0.0 0 0 ? S 17:42 0:00 \_ [rcu_tasks_rude_] 2023-01-01T17:45:54.291 INFO:teuthology.orchestra.run.smithi149.stdout:root 11 0.0 0.0 0 0 ? S 17:42 0:00 \_ [rcu_tasks_trace] 2023-01-01T17:45:54.291 INFO:teuthology.orchestra.run.smithi149.stdout:root 12 0.0 0.0 0 0 ? S 17:42 0:00 \_ [ksoftirqd/0] 2023-01-01T17:45:54.291 INFO:teuthology.orchestra.run.smithi149.stdout:root 13 0.0 0.0 0 0 ? I 17:42 0:00 \_ [rcu_sched] 2023-01-01T17:45:54.291 INFO:teuthology.orchestra.run.smithi149.stdout:root 14 0.0 0.0 0 0 ? S 17:42 0:00 \_ [migration/0] 2023-01-01T17:45:54.291 INFO:teuthology.orchestra.run.smithi149.stdout:root 15 0.0 0.0 0 0 ? S 17:42 0:00 \_ [watchdog/0] 2023-01-01T17:45:54.291 INFO:teuthology.orchestra.run.smithi149.stdout:root 16 0.0 0.0 0 0 ? S 17:42 0:00 \_ [cpuhp/0] 2023-01-01T17:45:54.291 INFO:teuthology.orchestra.run.smithi149.stdout:root 17 0.0 0.0 0 0 ? S 17:42 0:00 \_ [cpuhp/1] 2023-01-01T17:45:54.291 INFO:teuthology.orchestra.run.smithi149.stdout:root 18 0.0 0.0 0 0 ? S 17:42 0:00 \_ [watchdog/1] 2023-01-01T17:45:54.292 INFO:teuthology.orchestra.run.smithi149.stdout:root 19 0.0 0.0 0 0 ? S 17:42 0:00 \_ [migration/1] 2023-01-01T17:45:54.292 INFO:teuthology.orchestra.run.smithi149.stdout:root 20 0.0 0.0 0 0 ? S 17:42 0:00 \_ [ksoftirqd/1] 2023-01-01T17:45:54.292 INFO:teuthology.orchestra.run.smithi149.stdout:root 21 0.1 0.0 0 0 ? I 17:42 0:00 \_ [kworker/1:0-events] 2023-01-01T17:45:54.292 INFO:teuthology.orchestra.run.smithi149.stdout:root 22 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [kworker/1:0H-events_highpri] 2023-01-01T17:45:54.292 INFO:teuthology.orchestra.run.smithi149.stdout:root 23 0.0 0.0 0 0 ? S 17:42 0:00 \_ [cpuhp/2] 2023-01-01T17:45:54.292 INFO:teuthology.orchestra.run.smithi149.stdout:root 24 0.0 0.0 0 0 ? S 17:42 0:00 \_ [watchdog/2] 2023-01-01T17:45:54.292 INFO:teuthology.orchestra.run.smithi149.stdout:root 25 0.0 0.0 0 0 ? S 17:42 0:00 \_ [migration/2] 2023-01-01T17:45:54.293 INFO:teuthology.orchestra.run.smithi149.stdout:root 26 0.0 0.0 0 0 ? S 17:42 0:00 \_ [ksoftirqd/2] 2023-01-01T17:45:54.293 INFO:teuthology.orchestra.run.smithi149.stdout:root 27 0.0 0.0 0 0 ? I 17:42 0:00 \_ [kworker/2:0-cgroup_pidlist_destroy] 2023-01-01T17:45:54.293 INFO:teuthology.orchestra.run.smithi149.stdout:root 28 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [kworker/2:0H-events_highpri] 2023-01-01T17:45:54.293 INFO:teuthology.orchestra.run.smithi149.stdout:root 29 0.0 0.0 0 0 ? S 17:42 0:00 \_ [cpuhp/3] 2023-01-01T17:45:54.293 INFO:teuthology.orchestra.run.smithi149.stdout:root 30 0.0 0.0 0 0 ? S 17:42 0:00 \_ [watchdog/3] 2023-01-01T17:45:54.293 INFO:teuthology.orchestra.run.smithi149.stdout:root 31 0.0 0.0 0 0 ? S 17:42 0:00 \_ [migration/3] 2023-01-01T17:45:54.293 INFO:teuthology.orchestra.run.smithi149.stdout:root 32 0.0 0.0 0 0 ? S 17:42 0:00 \_ [ksoftirqd/3] 2023-01-01T17:45:54.294 INFO:teuthology.orchestra.run.smithi149.stdout:root 33 0.0 0.0 0 0 ? I 17:42 0:00 \_ [kworker/3:0-cgroup_pidlist_destroy] 2023-01-01T17:45:54.294 INFO:teuthology.orchestra.run.smithi149.stdout:root 34 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [kworker/3:0H-events_highpri] 2023-01-01T17:45:54.294 INFO:teuthology.orchestra.run.smithi149.stdout:root 35 0.0 0.0 0 0 ? S 17:42 0:00 \_ [cpuhp/4] 2023-01-01T17:45:54.294 INFO:teuthology.orchestra.run.smithi149.stdout:root 36 0.0 0.0 0 0 ? S 17:42 0:00 \_ [watchdog/4] 2023-01-01T17:45:54.294 INFO:teuthology.orchestra.run.smithi149.stdout:root 37 0.0 0.0 0 0 ? S 17:42 0:00 \_ [migration/4] 2023-01-01T17:45:54.294 INFO:teuthology.orchestra.run.smithi149.stdout:root 38 0.0 0.0 0 0 ? S 17:42 0:00 \_ [ksoftirqd/4] 2023-01-01T17:45:54.294 INFO:teuthology.orchestra.run.smithi149.stdout:root 39 0.0 0.0 0 0 ? I 17:42 0:00 \_ [kworker/4:0-cgroup_pidlist_destroy] 2023-01-01T17:45:54.294 INFO:teuthology.orchestra.run.smithi149.stdout:root 40 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [kworker/4:0H-events_highpri] 2023-01-01T17:45:54.295 INFO:teuthology.orchestra.run.smithi149.stdout:root 41 0.0 0.0 0 0 ? S 17:42 0:00 \_ [cpuhp/5] 2023-01-01T17:45:54.295 INFO:teuthology.orchestra.run.smithi149.stdout:root 42 0.0 0.0 0 0 ? S 17:42 0:00 \_ [watchdog/5] 2023-01-01T17:45:54.295 INFO:teuthology.orchestra.run.smithi149.stdout:root 43 0.0 0.0 0 0 ? S 17:42 0:00 \_ [migration/5] 2023-01-01T17:45:54.295 INFO:teuthology.orchestra.run.smithi149.stdout:root 44 0.0 0.0 0 0 ? S 17:42 0:00 \_ [ksoftirqd/5] 2023-01-01T17:45:54.295 INFO:teuthology.orchestra.run.smithi149.stdout:root 45 0.0 0.0 0 0 ? I 17:42 0:00 \_ [kworker/5:0-cgroup_pidlist_destroy] 2023-01-01T17:45:54.295 INFO:teuthology.orchestra.run.smithi149.stdout:root 46 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [kworker/5:0H-events_highpri] 2023-01-01T17:45:54.295 INFO:teuthology.orchestra.run.smithi149.stdout:root 47 0.0 0.0 0 0 ? S 17:42 0:00 \_ [cpuhp/6] 2023-01-01T17:45:54.296 INFO:teuthology.orchestra.run.smithi149.stdout:root 48 0.0 0.0 0 0 ? S 17:42 0:00 \_ [watchdog/6] 2023-01-01T17:45:54.296 INFO:teuthology.orchestra.run.smithi149.stdout:root 49 0.0 0.0 0 0 ? S 17:42 0:00 \_ [migration/6] 2023-01-01T17:45:54.296 INFO:teuthology.orchestra.run.smithi149.stdout:root 50 0.0 0.0 0 0 ? S 17:42 0:00 \_ [ksoftirqd/6] 2023-01-01T17:45:54.296 INFO:teuthology.orchestra.run.smithi149.stdout:root 51 0.0 0.0 0 0 ? I 17:42 0:00 \_ [kworker/6:0-events] 2023-01-01T17:45:54.296 INFO:teuthology.orchestra.run.smithi149.stdout:root 52 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [kworker/6:0H-events_highpri] 2023-01-01T17:45:54.296 INFO:teuthology.orchestra.run.smithi149.stdout:root 53 0.0 0.0 0 0 ? S 17:42 0:00 \_ [cpuhp/7] 2023-01-01T17:45:54.296 INFO:teuthology.orchestra.run.smithi149.stdout:root 54 0.0 0.0 0 0 ? S 17:42 0:00 \_ [watchdog/7] 2023-01-01T17:45:54.296 INFO:teuthology.orchestra.run.smithi149.stdout:root 55 0.0 0.0 0 0 ? S 17:42 0:00 \_ [migration/7] 2023-01-01T17:45:54.297 INFO:teuthology.orchestra.run.smithi149.stdout:root 56 0.0 0.0 0 0 ? S 17:42 0:00 \_ [ksoftirqd/7] 2023-01-01T17:45:54.297 INFO:teuthology.orchestra.run.smithi149.stdout:root 57 0.0 0.0 0 0 ? I 17:42 0:00 \_ [kworker/7:0-cgroup_pidlist_destroy] 2023-01-01T17:45:54.297 INFO:teuthology.orchestra.run.smithi149.stdout:root 58 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [kworker/7:0H-events_highpri] 2023-01-01T17:45:54.297 INFO:teuthology.orchestra.run.smithi149.stdout:root 60 0.0 0.0 0 0 ? I 17:42 0:00 \_ [kworker/u16:1-events_unbound] 2023-01-01T17:45:54.297 INFO:teuthology.orchestra.run.smithi149.stdout:root 61 0.0 0.0 0 0 ? I 17:42 0:00 \_ [kworker/u16:2-events_unbound] 2023-01-01T17:45:54.297 INFO:teuthology.orchestra.run.smithi149.stdout:root 62 0.0 0.0 0 0 ? I 17:42 0:00 \_ [kworker/u16:3-events_unbound] 2023-01-01T17:45:54.297 INFO:teuthology.orchestra.run.smithi149.stdout:root 63 0.0 0.0 0 0 ? I 17:42 0:00 \_ [kworker/u16:4-events_unbound] 2023-01-01T17:45:54.298 INFO:teuthology.orchestra.run.smithi149.stdout:root 64 0.0 0.0 0 0 ? I 17:42 0:00 \_ [kworker/u16:5-events_unbound] 2023-01-01T17:45:54.298 INFO:teuthology.orchestra.run.smithi149.stdout:root 65 0.0 0.0 0 0 ? I 17:42 0:00 \_ [kworker/u16:6-events_unbound] 2023-01-01T17:45:54.298 INFO:teuthology.orchestra.run.smithi149.stdout:root 66 0.0 0.0 0 0 ? I 17:42 0:00 \_ [kworker/u16:7-writeback] 2023-01-01T17:45:54.298 INFO:teuthology.orchestra.run.smithi149.stdout:root 67 0.0 0.0 0 0 ? S 17:42 0:00 \_ [kdevtmpfs] 2023-01-01T17:45:54.299 INFO:teuthology.orchestra.run.smithi149.stdout:root 68 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [netns] 2023-01-01T17:45:54.299 INFO:teuthology.orchestra.run.smithi149.stdout:root 69 0.0 0.0 0 0 ? S 17:42 0:00 \_ [kauditd] 2023-01-01T17:45:54.299 INFO:teuthology.orchestra.run.smithi149.stdout:root 70 0.0 0.0 0 0 ? I 17:42 0:00 \_ [kworker/4:1-cgroup_pidlist_destroy] 2023-01-01T17:45:54.299 INFO:teuthology.orchestra.run.smithi149.stdout:root 71 0.0 0.0 0 0 ? S 17:42 0:00 \_ [khungtaskd] 2023-01-01T17:45:54.299 INFO:teuthology.orchestra.run.smithi149.stdout:root 72 0.0 0.0 0 0 ? S 17:42 0:00 \_ [oom_reaper] 2023-01-01T17:45:54.299 INFO:teuthology.orchestra.run.smithi149.stdout:root 73 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [writeback] 2023-01-01T17:45:54.300 INFO:teuthology.orchestra.run.smithi149.stdout:root 74 0.0 0.0 0 0 ? S 17:42 0:00 \_ [kcompactd0] 2023-01-01T17:45:54.300 INFO:teuthology.orchestra.run.smithi149.stdout:root 75 0.0 0.0 0 0 ? SN 17:42 0:00 \_ [ksmd] 2023-01-01T17:45:54.300 INFO:teuthology.orchestra.run.smithi149.stdout:root 76 0.0 0.0 0 0 ? SN 17:42 0:00 \_ [khugepaged] 2023-01-01T17:45:54.300 INFO:teuthology.orchestra.run.smithi149.stdout:root 77 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [crypto] 2023-01-01T17:45:54.300 INFO:teuthology.orchestra.run.smithi149.stdout:root 78 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [kintegrityd] 2023-01-01T17:45:54.301 INFO:teuthology.orchestra.run.smithi149.stdout:root 79 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [kblockd] 2023-01-01T17:45:54.301 INFO:teuthology.orchestra.run.smithi149.stdout:root 80 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [blkcg_punt_bio] 2023-01-01T17:45:54.301 INFO:teuthology.orchestra.run.smithi149.stdout:root 81 0.0 0.0 0 0 ? I 17:42 0:00 \_ [kworker/2:1-events] 2023-01-01T17:45:54.301 INFO:teuthology.orchestra.run.smithi149.stdout:root 82 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [tpm_dev_wq] 2023-01-01T17:45:54.301 INFO:teuthology.orchestra.run.smithi149.stdout:root 83 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [md] 2023-01-01T17:45:54.301 INFO:teuthology.orchestra.run.smithi149.stdout:root 84 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [edac-poller] 2023-01-01T17:45:54.302 INFO:teuthology.orchestra.run.smithi149.stdout:root 85 0.0 0.0 0 0 ? S 17:42 0:00 \_ [watchdogd] 2023-01-01T17:45:54.302 INFO:teuthology.orchestra.run.smithi149.stdout:root 86 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [kworker/0:1H-kblockd] 2023-01-01T17:45:54.302 INFO:teuthology.orchestra.run.smithi149.stdout:root 87 0.1 0.0 0 0 ? I 17:42 0:00 \_ [kworker/5:1-events] 2023-01-01T17:45:54.302 INFO:teuthology.orchestra.run.smithi149.stdout:root 93 0.1 0.0 0 0 ? I 17:42 0:00 \_ [kworker/7:1-events] 2023-01-01T17:45:54.302 INFO:teuthology.orchestra.run.smithi149.stdout:root 113 0.0 0.0 0 0 ? I 17:42 0:00 \_ [kworker/1:1-events] 2023-01-01T17:45:54.302 INFO:teuthology.orchestra.run.smithi149.stdout:root 114 0.0 0.0 0 0 ? I 17:42 0:00 \_ [kworker/6:1-events] 2023-01-01T17:45:54.302 INFO:teuthology.orchestra.run.smithi149.stdout:root 115 0.0 0.0 0 0 ? I 17:42 0:00 \_ [kworker/3:1-events] 2023-01-01T17:45:54.302 INFO:teuthology.orchestra.run.smithi149.stdout:root 124 0.0 0.0 0 0 ? S 17:42 0:00 \_ [kswapd0] 2023-01-01T17:45:54.303 INFO:teuthology.orchestra.run.smithi149.stdout:root 226 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [kthrotld] 2023-01-01T17:45:54.303 INFO:teuthology.orchestra.run.smithi149.stdout:root 227 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [acpi_thermal_pm] 2023-01-01T17:45:54.303 INFO:teuthology.orchestra.run.smithi149.stdout:root 228 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [kmpath_rdacd] 2023-01-01T17:45:54.303 INFO:teuthology.orchestra.run.smithi149.stdout:root 229 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [kaluad] 2023-01-01T17:45:54.303 INFO:teuthology.orchestra.run.smithi149.stdout:root 230 0.0 0.0 0 0 ? I 17:42 0:00 \_ [kworker/1:2-events] 2023-01-01T17:45:54.303 INFO:teuthology.orchestra.run.smithi149.stdout:root 231 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [kworker/3:1H-kblockd] 2023-01-01T17:45:54.303 INFO:teuthology.orchestra.run.smithi149.stdout:root 232 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [ipv6_addrconf] 2023-01-01T17:45:54.304 INFO:teuthology.orchestra.run.smithi149.stdout:root 233 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [kstrp] 2023-01-01T17:45:54.304 INFO:teuthology.orchestra.run.smithi149.stdout:root 254 0.0 0.0 0 0 ? I 17:42 0:00 \_ [kworker/1:3-cgroup_pidlist_destroy] 2023-01-01T17:45:54.304 INFO:teuthology.orchestra.run.smithi149.stdout:root 271 0.0 0.0 0 0 ? I 17:42 0:00 \_ [kworker/5:2-cgroup_destroy] 2023-01-01T17:45:54.304 INFO:teuthology.orchestra.run.smithi149.stdout:root 315 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [kworker/7:1H-kblockd] 2023-01-01T17:45:54.304 INFO:teuthology.orchestra.run.smithi149.stdout:root 348 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [kworker/2:1H-kblockd] 2023-01-01T17:45:54.304 INFO:teuthology.orchestra.run.smithi149.stdout:root 351 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [kworker/5:1H-kblockd] 2023-01-01T17:45:54.304 INFO:teuthology.orchestra.run.smithi149.stdout:root 361 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [kworker/4:1H-kblockd] 2023-01-01T17:45:54.304 INFO:teuthology.orchestra.run.smithi149.stdout:root 372 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [kworker/1:1H-kblockd] 2023-01-01T17:45:54.305 INFO:teuthology.orchestra.run.smithi149.stdout:root 376 0.0 0.0 0 0 ? I 17:42 0:00 \_ [kworker/7:2-cgroup_pidlist_destroy] 2023-01-01T17:45:54.305 INFO:teuthology.orchestra.run.smithi149.stdout:root 377 0.0 0.0 0 0 ? I 17:42 0:00 \_ [kworker/7:3-cgroup_pidlist_destroy] 2023-01-01T17:45:54.305 INFO:teuthology.orchestra.run.smithi149.stdout:root 444 0.1 0.0 0 0 ? I 17:42 0:00 \_ [kworker/3:2-mm_percpu_wq] 2023-01-01T17:45:54.305 INFO:teuthology.orchestra.run.smithi149.stdout:root 461 0.0 0.0 0 0 ? I 17:42 0:00 \_ [kworker/0:2-events] 2023-01-01T17:45:54.309 INFO:teuthology.orchestra.run.smithi149.stdout:root 462 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [kworker/6:1H-kblockd] 2023-01-01T17:45:54.309 INFO:teuthology.orchestra.run.smithi149.stdout:root 494 0.0 0.0 0 0 ? I 17:42 0:00 \_ [kworker/5:3-events] 2023-01-01T17:45:54.309 INFO:teuthology.orchestra.run.smithi149.stdout:root 501 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [ata_sff] 2023-01-01T17:45:54.310 INFO:teuthology.orchestra.run.smithi149.stdout:root 503 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [nvme-wq] 2023-01-01T17:45:54.310 INFO:teuthology.orchestra.run.smithi149.stdout:root 505 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [nvme-reset-wq] 2023-01-01T17:45:54.310 INFO:teuthology.orchestra.run.smithi149.stdout:root 506 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [nvme-delete-wq] 2023-01-01T17:45:54.310 INFO:teuthology.orchestra.run.smithi149.stdout:root 507 0.0 0.0 0 0 ? S 17:42 0:00 \_ [scsi_eh_0] 2023-01-01T17:45:54.310 INFO:teuthology.orchestra.run.smithi149.stdout:root 508 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [scsi_tmf_0] 2023-01-01T17:45:54.311 INFO:teuthology.orchestra.run.smithi149.stdout:root 509 0.0 0.0 0 0 ? S 17:42 0:00 \_ [scsi_eh_1] 2023-01-01T17:45:54.311 INFO:teuthology.orchestra.run.smithi149.stdout:root 510 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [scsi_tmf_1] 2023-01-01T17:45:54.311 INFO:teuthology.orchestra.run.smithi149.stdout:root 511 0.0 0.0 0 0 ? S 17:42 0:00 \_ [scsi_eh_2] 2023-01-01T17:45:54.311 INFO:teuthology.orchestra.run.smithi149.stdout:root 513 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [scsi_tmf_2] 2023-01-01T17:45:54.311 INFO:teuthology.orchestra.run.smithi149.stdout:root 514 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [ixgbe] 2023-01-01T17:45:54.311 INFO:teuthology.orchestra.run.smithi149.stdout:root 515 0.0 0.0 0 0 ? I 17:42 0:00 \_ [kworker/0:3-cgroup_pidlist_destroy] 2023-01-01T17:45:54.311 INFO:teuthology.orchestra.run.smithi149.stdout:root 516 0.0 0.0 0 0 ? S 17:42 0:00 \_ [scsi_eh_3] 2023-01-01T17:45:54.311 INFO:teuthology.orchestra.run.smithi149.stdout:root 517 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [scsi_tmf_3] 2023-01-01T17:45:54.311 INFO:teuthology.orchestra.run.smithi149.stdout:root 520 0.0 0.0 0 0 ? S 17:42 0:00 \_ [scsi_eh_4] 2023-01-01T17:45:54.312 INFO:teuthology.orchestra.run.smithi149.stdout:root 521 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [scsi_tmf_4] 2023-01-01T17:45:54.312 INFO:teuthology.orchestra.run.smithi149.stdout:root 522 0.0 0.0 0 0 ? S 17:42 0:00 \_ [scsi_eh_5] 2023-01-01T17:45:54.312 INFO:teuthology.orchestra.run.smithi149.stdout:root 523 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [scsi_tmf_5] 2023-01-01T17:45:54.312 INFO:teuthology.orchestra.run.smithi149.stdout:root 524 0.0 0.0 0 0 ? S 17:42 0:00 \_ [scsi_eh_6] 2023-01-01T17:45:54.312 INFO:teuthology.orchestra.run.smithi149.stdout:root 525 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [scsi_tmf_6] 2023-01-01T17:45:54.312 INFO:teuthology.orchestra.run.smithi149.stdout:root 526 0.0 0.0 0 0 ? S 17:42 0:00 \_ [scsi_eh_7] 2023-01-01T17:45:54.312 INFO:teuthology.orchestra.run.smithi149.stdout:root 527 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [scsi_tmf_7] 2023-01-01T17:45:54.312 INFO:teuthology.orchestra.run.smithi149.stdout:root 528 0.0 0.0 0 0 ? S 17:42 0:00 \_ [scsi_eh_8] 2023-01-01T17:45:54.313 INFO:teuthology.orchestra.run.smithi149.stdout:root 529 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [scsi_tmf_8] 2023-01-01T17:45:54.313 INFO:teuthology.orchestra.run.smithi149.stdout:root 530 0.0 0.0 0 0 ? S 17:42 0:00 \_ [scsi_eh_9] 2023-01-01T17:45:54.313 INFO:teuthology.orchestra.run.smithi149.stdout:root 531 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [scsi_tmf_9] 2023-01-01T17:45:54.313 INFO:teuthology.orchestra.run.smithi149.stdout:root 532 0.0 0.0 0 0 ? I 17:42 0:00 \_ [kworker/u16:8-writeback] 2023-01-01T17:45:54.313 INFO:teuthology.orchestra.run.smithi149.stdout:root 533 0.0 0.0 0 0 ? I 17:42 0:00 \_ [kworker/u16:9-events_unbound] 2023-01-01T17:45:54.314 INFO:teuthology.orchestra.run.smithi149.stdout:root 534 0.0 0.0 0 0 ? I 17:42 0:00 \_ [kworker/u16:10] 2023-01-01T17:45:54.314 INFO:teuthology.orchestra.run.smithi149.stdout:root 560 0.1 0.0 0 0 ? I 17:42 0:00 \_ [kworker/3:3-cgroup_destroy] 2023-01-01T17:45:54.314 INFO:teuthology.orchestra.run.smithi149.stdout:root 562 0.0 0.0 0 0 ? S 17:42 0:00 \_ [jbd2/sda1-8] 2023-01-01T17:45:54.314 INFO:teuthology.orchestra.run.smithi149.stdout:root 563 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [ext4-rsv-conver] 2023-01-01T17:45:54.314 INFO:teuthology.orchestra.run.smithi149.stdout:root 630 0.1 0.0 0 0 ? I 17:42 0:00 \_ [kworker/6:2-events] 2023-01-01T17:45:54.314 INFO:teuthology.orchestra.run.smithi149.stdout:root 633 0.0 0.0 0 0 ? I 17:42 0:00 \_ [kworker/4:2-cgroup_pidlist_destroy] 2023-01-01T17:45:54.314 INFO:teuthology.orchestra.run.smithi149.stdout:root 639 0.2 0.0 0 0 ? I 17:42 0:00 \_ [kworker/2:2-events] 2023-01-01T17:45:54.314 INFO:teuthology.orchestra.run.smithi149.stdout:root 668 0.0 0.0 0 0 ? S 17:42 0:00 \_ [ext4lazyinit] 2023-01-01T17:45:54.315 INFO:teuthology.orchestra.run.smithi149.stdout:root 718 0.1 0.0 0 0 ? I 17:42 0:00 \_ [kworker/4:3-mm_percpu_wq] 2023-01-01T17:45:54.315 INFO:teuthology.orchestra.run.smithi149.stdout:root 754 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [rpciod] 2023-01-01T17:45:54.315 INFO:teuthology.orchestra.run.smithi149.stdout:root 755 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [kworker/u17:0] 2023-01-01T17:45:54.315 INFO:teuthology.orchestra.run.smithi149.stdout:root 756 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [xprtiod] 2023-01-01T17:45:54.316 INFO:teuthology.orchestra.run.smithi149.stdout:root 784 0.0 0.0 0 0 ? SN 17:42 0:00 \_ [kipmi0] 2023-01-01T17:45:54.316 INFO:teuthology.orchestra.run.smithi149.stdout:root 787 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [kdmflush/253:0] 2023-01-01T17:45:54.316 INFO:teuthology.orchestra.run.smithi149.stdout:root 788 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [kdmflush/253:1] 2023-01-01T17:45:54.316 INFO:teuthology.orchestra.run.smithi149.stdout:root 789 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [kdmflush/253:2] 2023-01-01T17:45:54.316 INFO:teuthology.orchestra.run.smithi149.stdout:root 790 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [kdmflush/253:3] 2023-01-01T17:45:54.317 INFO:teuthology.orchestra.run.smithi149.stdout:root 791 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [kdmflush/253:4] 2023-01-01T17:45:54.317 INFO:teuthology.orchestra.run.smithi149.stdout:root 898 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [xfsalloc] 2023-01-01T17:45:54.317 INFO:teuthology.orchestra.run.smithi149.stdout:root 899 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [xfs_mru_cache] 2023-01-01T17:45:54.317 INFO:teuthology.orchestra.run.smithi149.stdout:root 901 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [xfs-buf/dm-4] 2023-01-01T17:45:54.317 INFO:teuthology.orchestra.run.smithi149.stdout:root 903 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [xfs-conv/dm-4] 2023-01-01T17:45:54.317 INFO:teuthology.orchestra.run.smithi149.stdout:root 904 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [xfs-cil/dm-4] 2023-01-01T17:45:54.318 INFO:teuthology.orchestra.run.smithi149.stdout:root 905 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [xfs-reclaim/dm-] 2023-01-01T17:45:54.318 INFO:teuthology.orchestra.run.smithi149.stdout:root 906 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [xfs-blockgc/dm-] 2023-01-01T17:45:54.318 INFO:teuthology.orchestra.run.smithi149.stdout:root 909 0.0 0.0 0 0 ? I< 17:42 0:00 \_ [xfs-log/dm-4] 2023-01-01T17:45:54.318 INFO:teuthology.orchestra.run.smithi149.stdout:root 910 0.0 0.0 0 0 ? S 17:42 0:00 \_ [xfsaild/dm-4] 2023-01-01T17:45:54.318 INFO:teuthology.orchestra.run.smithi149.stdout:root 1 1.2 0.0 241460 14564 ? Ss 17:42 0:02 /usr/lib/systemd/systemd --switched-root --system --deserialize 18 2023-01-01T17:45:54.318 INFO:teuthology.orchestra.run.smithi149.stdout:root 660 0.1 0.0 89476 11416 ? Ss 17:42 0:00 /usr/lib/systemd/systemd-journald 2023-01-01T17:45:54.318 INFO:teuthology.orchestra.run.smithi149.stdout:root 700 0.3 0.0 117836 14156 ? Ss 17:42 0:00 /usr/lib/systemd/systemd-udevd 2023-01-01T17:45:54.318 INFO:teuthology.orchestra.run.smithi149.stdout:rpc 746 0.0 0.0 67220 5508 ? Ss 17:42 0:00 /usr/bin/rpcbind -w -f 2023-01-01T17:45:54.319 INFO:teuthology.orchestra.run.smithi149.stdout:root 750 0.0 0.0 148732 2800 ? S sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-01-01T17:45:54.327 DEBUG:teuthology.orchestra.run.smithi149:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-01-01T17:45:54.369 INFO:teuthology.orchestra.run.smithi061.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-01-01T17:45:54.372 INFO:teuthology.orchestra.run.smithi149.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-01-01T17:45:54.379 INFO:tasks.ceph:Archiving crash dumps... 2023-01-01T17:45:54.383 DEBUG:teuthology.misc:Transferring archived files from smithi061:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-01-01_15:14:18-fs-wip-vshankar-testing-20221221.044733-testing-default-smithi/7130185/remote/smithi061/crash 2023-01-01T17:45:54.384 DEBUG:teuthology.orchestra.run.smithi061:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2023-01-01T17:45:54.432 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-01-01_15:14:18-fs-wip-vshankar-testing-20221221.044733-testing-default-smithi/7130185/remote/smithi149/crash 2023-01-01T17:45:54.434 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2023-01-01T17:45:54.477 INFO:tasks.ceph:Shutting down logrotate 2023-01-01T17:45:54.477 DEBUG:teuthology.orchestra.run.smithi061:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-01-01T17:45:54.480 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-01-01T17:45:54.571 DEBUG:teuthology.orchestra.run.smithi061:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-01-01T17:45:54.603 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-01-01T17:45:54.631 INFO:tasks.ceph:Compressing logs... 2023-01-01T17:45:54.632 DEBUG:teuthology.orchestra.run.smithi061:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-01-01T17:45:54.645 DEBUG:teuthology.orchestra.run.smithi149:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-01-01T17:45:54.776 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~122s 2023-01-01T17:45:54.777 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~122s 2023-01-01T17:45:54.777 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~122s 2023-01-01T17:45:54.777 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~122s 2023-01-01T17:45:54.777 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~122s 2023-01-01T17:45:54.777 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~122s 2023-01-01T17:45:54.778 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~122s 2023-01-01T17:45:54.778 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~122s 2023-01-01T17:45:54.778 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~122s 2023-01-01T17:45:58.071 INFO:tasks.ceph:Archiving logs... 2023-01-01T17:45:58.071 DEBUG:teuthology.misc:Transferring archived files from smithi061:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-01-01_15:14:18-fs-wip-vshankar-testing-20221221.044733-testing-default-smithi/7130185/remote/smithi061/log 2023-01-01T17:45:58.072 DEBUG:teuthology.orchestra.run.smithi061:> sudo tar cz -f - -C /var/log/ceph -- . 2023-01-01T17:45:58.797 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-01-01_15:14:18-fs-wip-vshankar-testing-20221221.044733-testing-default-smithi/7130185/remote/smithi149/log 2023-01-01T17:45:58.798 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar cz -f - -C /var/log/ceph -- . 2023-01-01T17:45:59.329 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1441, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1902, in task ctx.managers[config['cluster']].stop_pg_num_changes() File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 2302, in stop_pg_num_changes osd_dump = self.get_osd_dump_json() File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 2536, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 1609, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 1600, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi061 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/run_tasks.py", line 188, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1914, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/contextutil.py", line 55, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/contextutil.py", line 47, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1175, in cluster raise e File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1157, in cluster remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi149 with status 32: 'sync && sudo umount -f /var/lib/ceph/osd/ceph-4' 2023-01-01T17:45:59.396 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-01-01T17:45:59.407 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1441, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1902, in task ctx.managers[config['cluster']].stop_pg_num_changes() File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 2302, in stop_pg_num_changes osd_dump = self.get_osd_dump_json() File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 2536, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 1609, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph_manager.py", line 1600, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi061 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/task/install/__init__.py", line 619, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/run_tasks.py", line 188, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1914, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/contextutil.py", line 55, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/contextutil.py", line 47, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1175, in cluster raise e File "/home/teuthworker/src/git.ceph.com_ceph-c_2d451fdbbd7269d7b4c18c135c79703e6d1c0c1a/qa/tasks/ceph.py", line 1157, in cluster remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi149 with status 32: 'sync && sudo umount -f /var/lib/ceph/osd/ceph-4' 2023-01-01T17:45:59.414 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits... 2023-01-01T17:45:59.415 DEBUG:teuthology.orchestra.run.smithi061:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2023-01-01T17:45:59.424 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2023-01-01T17:45:59.495 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-01-01T17:45:59.506 INFO:teuthology.task.clock:Checking final clock skew... 2023-01-01T17:45:59.506 DEBUG:teuthology.orchestra.run.smithi061:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-01-01T17:45:59.509 DEBUG:teuthology.orchestra.run.smithi149:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-01-01T17:45:59.524 INFO:teuthology.orchestra.run.smithi061.stderr:bash: ntpq: command not found 2023-01-01T17:45:59.526 INFO:teuthology.orchestra.run.smithi149.stderr:bash: ntpq: command not found 2023-01-01T17:45:59.529 INFO:teuthology.orchestra.run.smithi061.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-01-01T17:45:59.529 INFO:teuthology.orchestra.run.smithi061.stdout:=============================================================================== 2023-01-01T17:45:59.529 INFO:teuthology.orchestra.run.smithi061.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 31 -897us[ -897us] +/- 89ms 2023-01-01T17:45:59.530 INFO:teuthology.orchestra.run.smithi061.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 31 +261us[ +261us] +/- 46ms 2023-01-01T17:45:59.530 INFO:teuthology.orchestra.run.smithi061.stdout:^* hv03.front.sepia.ceph.com 3 6 377 32 +449us[ +467us] +/- 58ms 2023-01-01T17:45:59.530 INFO:teuthology.orchestra.run.smithi061.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-01-01T17:45:59.531 INFO:teuthology.orchestra.run.smithi149.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-01-01T17:45:59.531 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================== 2023-01-01T17:45:59.531 INFO:teuthology.orchestra.run.smithi149.stdout:^+ hv01.front.sepia.ceph.com 3 6 77 42 -936us[ -936us] +/- 89ms 2023-01-01T17:45:59.532 INFO:teuthology.orchestra.run.smithi149.stdout:^+ hv02.front.sepia.ceph.com 3 6 77 42 +240us[ +240us] +/- 46ms 2023-01-01T17:45:59.532 INFO:teuthology.orchestra.run.smithi149.stdout:^* hv03.front.sepia.ceph.com 3 6 77 43 +422us[ +428us] +/- 57ms 2023-01-01T17:45:59.532 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-01-01T17:45:59.532 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-01-01T17:45:59.542 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-01-01T17:45:59.543 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-01-01T17:45:59.590 DEBUG:teuthology.orchestra.run.smithi061:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-01-01T17:45:59.685 DEBUG:teuthology.orchestra.run.smithi149:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-01-01T17:45:59.779 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~127s 2023-01-01T17:45:59.816 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~127s 2023-01-01T17:45:59.816 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~127s 2023-01-01T17:45:59.816 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~127s 2023-01-01T17:45:59.816 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~127s 2023-01-01T17:45:59.816 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~127s 2023-01-01T17:45:59.817 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~127s 2023-01-01T17:45:59.817 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~127s 2023-01-01T17:45:59.817 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~127s 2023-01-01T17:45:59.843 DEBUG:teuthology.orchestra.run.smithi061:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2023-01-01T17:46:00.006 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-01T17:46:00.158 DEBUG:teuthology.orchestra.run.smithi149:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2023-01-01T17:46:00.192 INFO:teuthology.orchestra.run.smithi149.stdout:type=AVC msg=audit(1672594985.819:44): avc: denied { node_bind } for pid=2048 comm="ping" saddr=172.21.15.149 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1 2023-01-01T17:46:00.238 DEBUG:teuthology.task.selinux:ubuntu@smithi149.front.sepia.ceph.com has 1 denials 2023-01-01T17:46:00.239 ERROR:teuthology.run_tasks:Manager failed: selinux Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/run_tasks.py", line 188, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/task/__init__.py", line 136, in __exit__ self.teardown() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/task/selinux.py", line 165, in teardown self.get_new_denials() File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/task/selinux.py", line 214, in get_new_denials raise SELinuxError(node=remote, teuthology.exceptions.SELinuxError: SELinux denials found on ubuntu@smithi149.front.sepia.ceph.com: ['type=AVC msg=audit(1672594985.819:44): avc: denied { node_bind } for pid=2048 comm="ping" saddr=172.21.15.149 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] 2023-01-01T17:46:00.253 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-01-01T17:46:00.290 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-01-01T17:46:00.341 INFO:teuthology.task.internal:Duration was 973.759517 seconds 2023-01-01T17:46:00.342 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-01-01T17:46:00.389 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-01-01T17:46:00.389 DEBUG:teuthology.orchestra.run.smithi061:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-01-01T17:46:00.395 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-01-01T17:46:00.446 INFO:teuthology.orchestra.run.smithi061.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-01-01T17:46:00.473 INFO:teuthology.orchestra.run.smithi149.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-01-01T17:46:00.816 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-01-01T17:46:00.817 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi061.front.sepia.ceph.com 2023-01-01T17:46:00.817 DEBUG:teuthology.orchestra.run.smithi061:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-01-01T17:46:00.844 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi149.front.sepia.ceph.com 2023-01-01T17:46:00.845 DEBUG:teuthology.orchestra.run.smithi149:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-01-01T17:46:00.879 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-01-01T17:46:00.880 DEBUG:teuthology.orchestra.run.smithi061:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-01-01T17:46:00.888 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-01-01T17:46:00.986 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-01-01T17:46:00.986 DEBUG:teuthology.orchestra.run.smithi061:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-01-01T17:46:00.989 DEBUG:teuthology.orchestra.run.smithi149:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-01-01T17:46:01.064 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-01-01T17:46:01.079 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-01-01T17:46:01.079 DEBUG:teuthology.orchestra.run.smithi061:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-01-01T17:46:01.108 DEBUG:teuthology.orchestra.run.smithi149:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-01-01T17:46:01.149 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-01-01T17:46:01.163 DEBUG:teuthology.orchestra.run.smithi061:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-01-01T17:46:01.166 DEBUG:teuthology.orchestra.run.smithi149:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-01-01T17:46:01.191 INFO:teuthology.orchestra.run.smithi061.stdout:kernel.core_pattern = core 2023-01-01T17:46:01.229 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = core 2023-01-01T17:46:01.258 DEBUG:teuthology.orchestra.run.smithi061:> test -e /home/ubuntu/cephtest/archive/coredump 2023-01-01T17:46:01.274 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-01T17:46:01.275 DEBUG:teuthology.orchestra.run.smithi149:> test -e /home/ubuntu/cephtest/archive/coredump 2023-01-01T17:46:01.313 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-01T17:46:01.314 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-01-01T17:46:01.328 INFO:teuthology.task.internal:Transferring archived files... 2023-01-01T17:46:01.329 DEBUG:teuthology.misc:Transferring archived files from smithi061:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-01-01_15:14:18-fs-wip-vshankar-testing-20221221.044733-testing-default-smithi/7130185/remote/smithi061 2023-01-01T17:46:01.329 DEBUG:teuthology.orchestra.run.smithi061:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2023-01-01T17:46:01.387 DEBUG:teuthology.misc:Transferring archived files from smithi149:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-01-01_15:14:18-fs-wip-vshankar-testing-20221221.044733-testing-default-smithi/7130185/remote/smithi149 2023-01-01T17:46:01.388 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2023-01-01T17:46:01.438 INFO:teuthology.task.internal:Removing archive directory... 2023-01-01T17:46:01.438 DEBUG:teuthology.orchestra.run.smithi061:> rm -rf -- /home/ubuntu/cephtest/archive 2023-01-01T17:46:01.441 DEBUG:teuthology.orchestra.run.smithi149:> rm -rf -- /home/ubuntu/cephtest/archive 2023-01-01T17:46:01.485 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-01-01T17:46:01.503 INFO:teuthology.task.internal:Not uploading archives. 2023-01-01T17:46:01.503 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-01-01T17:46:01.532 INFO:teuthology.task.internal:Tidying up after the test... 2023-01-01T17:46:01.532 DEBUG:teuthology.orchestra.run.smithi061:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-01-01T17:46:01.534 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-01-01T17:46:01.551 INFO:teuthology.orchestra.run.smithi149.stdout: 262320 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Jan 1 17:46 /home/ubuntu/cephtest 2023-01-01T17:46:01.551 INFO:teuthology.orchestra.run.smithi149.stdout: 393241 4 d--------- 2 ubuntu ubuntu 4096 Jan 1 17:40 /home/ubuntu/cephtest/mnt.1 2023-01-01T17:46:01.552 INFO:teuthology.orchestra.run.smithi149.stderr:find: ‘/home/ubuntu/cephtest/mnt.1’: Permission denied 2023-01-01T17:46:01.579 INFO:teuthology.orchestra.run.smithi149.stdout: 393222 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 1 17:38 /home/ubuntu/cephtest/ceph.data 2023-01-01T17:46:01.579 INFO:teuthology.orchestra.run.smithi149.stdout: 393242 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Jan 1 17:40 /home/ubuntu/cephtest/clone.client.1 2023-01-01T17:46:01.579 INFO:teuthology.orchestra.run.smithi149.stdout: 393243 4 drwxrwxr-x 7 ubuntu ubuntu 4096 Jan 1 17:40 /home/ubuntu/cephtest/clone.client.1/.git 2023-01-01T17:46:01.579 INFO:teuthology.orchestra.run.smithi149.stdout: 393244 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 1 17:40 /home/ubuntu/cephtest/clone.client.1/.git/branches 2023-01-01T17:46:01.579 INFO:teuthology.orchestra.run.smithi149.stdout: 393265 4 -rw-rw-r-- 1 ubuntu ubuntu 23 Jan 1 17:40 /home/ubuntu/cephtest/clone.client.1/.git/HEAD 2023-01-01T17:46:01.579 INFO:teuthology.orchestra.run.smithi149.stdout: 393266 4 drwxrwxr-x 4 ubuntu ubuntu 4096 Jan 1 17:40 /home/ubuntu/cephtest/clone.client.1/.git/objects 2023-01-01T17:46:01.580 INFO:teuthology.orchestra.run.smithi149.stdout: 393268 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 1 17:40 /home/ubuntu/cephtest/clone.client.1/.git/objects/pack 2023-01-01T17:46:01.580 INFO:teuthology.orchestra.run.smithi149.stdout: 393793 122880 -r--r--r-- 1 ubuntu ubuntu 125829120 Jan 1 17:40 /home/ubuntu/cephtest/clone.client.1/.git/objects/pack/tmp_pack_kYP4z5 2023-01-01T17:46:01.580 INFO:teuthology.orchestra.run.smithi149.stdout: 393269 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 1 17:40 /home/ubuntu/cephtest/clone.client.1/.git/objects/info 2023-01-01T17:46:01.580 INFO:teuthology.orchestra.run.smithi149.stdout: 393245 4 -rw-rw-r-- 1 ubuntu ubuntu 73 Jan 1 17:40 /home/ubuntu/cephtest/clone.client.1/.git/description 2023-01-01T17:46:01.580 INFO:teuthology.orchestra.run.smithi149.stdout: 393246 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 1 17:40 /home/ubuntu/cephtest/clone.client.1/.git/info 2023-01-01T17:46:01.580 INFO:teuthology.orchestra.run.smithi149.stdout: 393247 4 -rw-rw-r-- 1 ubuntu ubuntu 240 Jan 1 17:40 /home/ubuntu/cephtest/clone.client.1/.git/info/exclude 2023-01-01T17:46:01.581 INFO:teuthology.orchestra.run.smithi149.stdout: 393792 4 -rw-rw-r-- 1 ubuntu ubuntu 195 Jan 1 17:40 /home/ubuntu/cephtest/clone.client.1/.git/config 2023-01-01T17:46:01.581 INFO:teuthology.orchestra.run.smithi149.stdout: 393262 4 drwxrwxr-x 4 ubuntu ubuntu 4096 Jan 1 17:40 /home/ubuntu/cephtest/clone.client.1/.git/refs 2023-01-01T17:46:01.581 INFO:teuthology.orchestra.run.smithi149.stdout: 393263 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 1 17:40 /home/ubuntu/cephtest/clone.client.1/.git/refs/heads 2023-01-01T17:46:01.581 INFO:teuthology.orchestra.run.smithi149.stdout: 393264 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 1 17:40 /home/ubuntu/cephtest/clone.client.1/.git/refs/tags 2023-01-01T17:46:01.581 INFO:teuthology.orchestra.run.smithi149.stdout: 393248 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 1 17:40 /home/ubuntu/cephtest/clone.client.1/.git/hooks 2023-01-01T17:46:01.581 INFO:teuthology.orchestra.run.smithi149.stdout: 393249 4 -rwxrwxr-x 1 ubuntu ubuntu 1492 Jan 1 17:40 /home/ubuntu/cephtest/clone.client.1/.git/hooks/prepare-commit-msg.sample 2023-01-01T17:46:01.581 INFO:teuthology.orchestra.run.smithi149.stdout: 393250 4 -rwxrwxr-x 1 ubuntu ubuntu 1374 Jan 1 17:40 /home/ubuntu/cephtest/clone.client.1/.git/hooks/pre-push.sample 2023-01-01T17:46:01.582 INFO:teuthology.orchestra.run.smithi149.stdout: 393251 4 -rwxrwxr-x 1 ubuntu ubuntu 1643 Jan 1 17:40 /home/ubuntu/cephtest/clone.client.1/.git/hooks/pre-commit.sample 2023-01-01T17:46:01.582 INFO:teuthology.orchestra.run.smithi149.stdout: 393252 4 -rwxrwxr-x 1 ubuntu ubuntu 3650 Jan 1 17:40 /home/ubuntu/cephtest/clone.client.1/.git/hooks/update.sample 2023-01-01T17:46:01.582 INFO:teuthology.orchestra.run.smithi149.stdout: 393253 4 -rwxrwxr-x 1 ubuntu ubuntu 896 Jan 1 17:40 /home/ubuntu/cephtest/clone.client.1/.git/hooks/commit-msg.sample 2023-01-01T17:46:01.582 INFO:teuthology.orchestra.run.smithi149.stdout: 393254 8 -rwxrwxr-x 1 ubuntu ubuntu 4898 Jan 1 17:40 /home/ubuntu/cephtest/clone.client.1/.git/hooks/pre-rebase.sample 2023-01-01T17:46:01.582 INFO:teuthology.orchestra.run.smithi149.stdout: 393255 4 -rwxrwxr-x 1 ubuntu ubuntu 189 Jan 1 17:40 /home/ubuntu/cephtest/clone.client.1/.git/hooks/post-update.sample 2023-01-01T17:46:01.582 INFO:teuthology.orchestra.run.smithi149.stdout: 393256 4 -rwxrwxr-x 1 ubuntu ubuntu 416 Jan 1 17:40 /home/ubuntu/cephtest/clone.client.1/.git/hooks/pre-merge-commit.sample 2023-01-01T17:46:01.582 INFO:teuthology.orchestra.run.smithi149.stdout: 393257 8 -rwxrwxr-x 1 ubuntu ubuntu 4655 Jan 1 17:40 /home/ubuntu/cephtest/clone.client.1/.git/hooks/fsmonitor-watchman.sample 2023-01-01T17:46:01.583 INFO:teuthology.orchestra.run.smithi149.stdout: 393258 4 -rwxrwxr-x 1 ubuntu ubuntu 424 Jan 1 17:40 /home/ubuntu/cephtest/clone.client.1/.git/hooks/pre-applypatch.sample 2023-01-01T17:46:01.583 INFO:teuthology.orchestra.run.smithi149.stdout: 393259 4 -rwxrwxr-x 1 ubuntu ubuntu 478 Jan 1 17:40 /home/ubuntu/cephtest/clone.client.1/.git/hooks/applypatch-msg.sample 2023-01-01T17:46:01.583 INFO:teuthology.orchestra.run.smithi149.stdout: 393260 4 -rwxrwxr-x 1 ubuntu ubuntu 544 Jan 1 17:40 /home/ubuntu/cephtest/clone.client.1/.git/hooks/pre-receive.sample 2023-01-01T17:46:01.583 INFO:teuthology.orchestra.run.smithi149.stdout: 393261 4 -rwxrwxr-x 1 ubuntu ubuntu 2783 Jan 1 17:40 /home/ubuntu/cephtest/clone.client.1/.git/hooks/push-to-checkout.sample 2023-01-01T17:46:01.583 INFO:teuthology.orchestra.run.smithi149.stdout: 393267 12 -rw------- 1 ubuntu ubuntu 10947 Jan 1 17:40 /home/ubuntu/cephtest/clone.client.1/.git/shallow_zEutof 2023-01-01T17:46:01.584 INFO:teuthology.orchestra.run.smithi149.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-01-01T17:46:04.818 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~132s 2023-01-01T17:46:04.996 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~132s 2023-01-01T17:46:04.996 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~132s 2023-01-01T17:46:04.996 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~132s 2023-01-01T17:46:04.996 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~132s 2023-01-01T17:46:04.997 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~132s 2023-01-01T17:46:04.997 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~132s 2023-01-01T17:46:04.997 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~132s 2023-01-01T17:46:04.997 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~132s 2023-01-01T17:46:09.998 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~137s 2023-01-01T17:46:09.999 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~137s 2023-01-01T17:46:09.999 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~137s 2023-01-01T17:46:09.999 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~137s 2023-01-01T17:46:09.999 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~137s 2023-01-01T17:46:09.999 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~137s 2023-01-01T17:46:09.999 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~137s 2023-01-01T17:46:09.999 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~137s 2023-01-01T17:46:09.999 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~137s 2023-01-01T17:46:15.001 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~142s 2023-01-01T17:46:15.002 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~142s 2023-01-01T17:46:15.002 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~142s 2023-01-01T17:46:15.002 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~142s 2023-01-01T17:46:15.002 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~142s 2023-01-01T17:46:15.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~142s 2023-01-01T17:46:15.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~142s 2023-01-01T17:46:15.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~142s 2023-01-01T17:46:15.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~142s 2023-01-01T17:46:20.005 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~147s 2023-01-01T17:46:20.005 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~147s 2023-01-01T17:46:20.005 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~147s 2023-01-01T17:46:20.006 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~147s 2023-01-01T17:46:20.006 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~147s 2023-01-01T17:46:20.006 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~147s 2023-01-01T17:46:20.006 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~147s 2023-01-01T17:46:20.006 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~147s 2023-01-01T17:46:20.006 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~147s 2023-01-01T17:46:25.008 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~152s 2023-01-01T17:46:25.008 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~152s 2023-01-01T17:46:25.008 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~152s 2023-01-01T17:46:25.008 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~152s 2023-01-01T17:46:25.008 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~152s 2023-01-01T17:46:25.009 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~152s 2023-01-01T17:46:25.009 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~152s 2023-01-01T17:46:25.009 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~152s 2023-01-01T17:46:25.009 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~152s 2023-01-01T17:46:30.010 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~157s 2023-01-01T17:46:30.010 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~157s 2023-01-01T17:46:30.010 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~157s 2023-01-01T17:46:30.010 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~157s 2023-01-01T17:46:30.010 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~157s 2023-01-01T17:46:30.011 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~157s 2023-01-01T17:46:30.011 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~157s 2023-01-01T17:46:30.011 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~157s 2023-01-01T17:46:30.011 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~157s 2023-01-01T17:46:35.012 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~162s 2023-01-01T17:46:35.013 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~162s 2023-01-01T17:46:35.013 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~162s 2023-01-01T17:46:35.013 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~162s 2023-01-01T17:46:35.013 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~162s 2023-01-01T17:46:35.013 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~162s 2023-01-01T17:46:35.013 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~162s 2023-01-01T17:46:35.014 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~162s 2023-01-01T17:46:35.014 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~162s 2023-01-01T17:46:40.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~167s 2023-01-01T17:46:40.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~167s 2023-01-01T17:46:40.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~167s 2023-01-01T17:46:40.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~167s 2023-01-01T17:46:40.016 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~167s 2023-01-01T17:46:40.016 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~167s 2023-01-01T17:46:40.016 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~167s 2023-01-01T17:46:40.016 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~167s 2023-01-01T17:46:40.016 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~167s 2023-01-01T17:46:45.018 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~172s 2023-01-01T17:46:45.018 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~172s 2023-01-01T17:46:45.018 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~172s 2023-01-01T17:46:45.018 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~172s 2023-01-01T17:46:45.019 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~172s 2023-01-01T17:46:45.019 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~172s 2023-01-01T17:46:45.019 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~172s 2023-01-01T17:46:45.019 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~172s 2023-01-01T17:46:45.019 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~172s 2023-01-01T17:46:50.020 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~177s 2023-01-01T17:46:50.021 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~177s 2023-01-01T17:46:50.021 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~177s 2023-01-01T17:46:50.021 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~177s 2023-01-01T17:46:50.021 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~177s 2023-01-01T17:46:50.021 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~177s 2023-01-01T17:46:50.022 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~177s 2023-01-01T17:46:50.022 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~177s 2023-01-01T17:46:50.022 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~177s 2023-01-01T17:46:55.022 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~182s 2023-01-01T17:46:55.023 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~182s 2023-01-01T17:46:55.023 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~182s 2023-01-01T17:46:55.023 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~182s 2023-01-01T17:46:55.023 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~182s 2023-01-01T17:46:55.023 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~182s 2023-01-01T17:46:55.023 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~182s 2023-01-01T17:46:55.024 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~182s 2023-01-01T17:46:55.024 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~182s 2023-01-01T17:47:00.024 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~187s 2023-01-01T17:47:00.025 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~187s 2023-01-01T17:47:00.025 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~187s 2023-01-01T17:47:00.025 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~187s 2023-01-01T17:47:00.025 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~187s 2023-01-01T17:47:00.025 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~187s 2023-01-01T17:47:00.025 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~187s 2023-01-01T17:47:00.026 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~187s 2023-01-01T17:47:00.026 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~187s 2023-01-01T17:47:05.027 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~192s 2023-01-01T17:47:05.197 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~192s 2023-01-01T17:47:05.198 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~192s 2023-01-01T17:47:05.198 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~192s 2023-01-01T17:47:05.198 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~192s 2023-01-01T17:47:05.198 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~192s 2023-01-01T17:47:05.198 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~192s 2023-01-01T17:47:05.198 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~192s 2023-01-01T17:47:05.198 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~192s 2023-01-01T17:47:10.200 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~198s 2023-01-01T17:47:10.258 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~198s 2023-01-01T17:47:10.258 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~198s 2023-01-01T17:47:10.258 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~198s 2023-01-01T17:47:10.258 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~198s 2023-01-01T17:47:10.258 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~198s 2023-01-01T17:47:10.258 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~198s 2023-01-01T17:47:10.258 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~198s 2023-01-01T17:47:10.259 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~198s 2023-01-01T17:47:15.260 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~203s 2023-01-01T17:47:15.284 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~203s 2023-01-01T17:47:15.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~203s 2023-01-01T17:47:15.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~203s 2023-01-01T17:47:15.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~203s 2023-01-01T17:47:15.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~203s 2023-01-01T17:47:15.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~203s 2023-01-01T17:47:15.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~203s 2023-01-01T17:47:15.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~203s 2023-01-01T17:47:20.289 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~208s 2023-01-01T17:47:20.289 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~208s 2023-01-01T17:47:20.289 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~208s 2023-01-01T17:47:20.289 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~208s 2023-01-01T17:47:20.290 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~208s 2023-01-01T17:47:20.290 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~208s 2023-01-01T17:47:20.290 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~208s 2023-01-01T17:47:20.290 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~208s 2023-01-01T17:47:20.290 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~208s 2023-01-01T17:47:25.292 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~213s 2023-01-01T17:47:25.292 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~213s 2023-01-01T17:47:25.292 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~213s 2023-01-01T17:47:25.292 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~213s 2023-01-01T17:47:25.293 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~213s 2023-01-01T17:47:25.293 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~213s 2023-01-01T17:47:25.293 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~213s 2023-01-01T17:47:25.293 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~213s 2023-01-01T17:47:25.293 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~213s 2023-01-01T17:47:30.295 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~218s 2023-01-01T17:47:30.295 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~218s 2023-01-01T17:47:30.295 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~218s 2023-01-01T17:47:30.296 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~218s 2023-01-01T17:47:30.296 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~218s 2023-01-01T17:47:30.296 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~218s 2023-01-01T17:47:30.296 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~218s 2023-01-01T17:47:30.296 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~218s 2023-01-01T17:47:30.296 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~218s 2023-01-01T17:47:35.298 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~223s 2023-01-01T17:47:35.299 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~223s 2023-01-01T17:47:35.299 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~223s 2023-01-01T17:47:35.300 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~223s 2023-01-01T17:47:35.301 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~223s 2023-01-01T17:47:35.301 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~223s 2023-01-01T17:47:35.301 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~223s 2023-01-01T17:47:35.302 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~223s 2023-01-01T17:47:35.302 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~223s 2023-01-01T17:47:40.303 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~228s 2023-01-01T17:47:40.335 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~228s 2023-01-01T17:47:40.335 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~228s 2023-01-01T17:47:40.335 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~228s 2023-01-01T17:47:40.336 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~228s 2023-01-01T17:47:40.336 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~228s 2023-01-01T17:47:40.336 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~228s 2023-01-01T17:47:40.336 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~228s 2023-01-01T17:47:40.336 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~228s 2023-01-01T17:47:45.337 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~233s 2023-01-01T17:47:45.337 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~233s 2023-01-01T17:47:45.338 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~233s 2023-01-01T17:47:45.338 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~233s 2023-01-01T17:47:45.338 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~233s 2023-01-01T17:47:45.338 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~233s 2023-01-01T17:47:45.338 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~233s 2023-01-01T17:47:45.338 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~233s 2023-01-01T17:47:45.338 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~233s 2023-01-01T17:47:50.340 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~238s 2023-01-01T17:47:50.340 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~238s 2023-01-01T17:47:50.340 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~238s 2023-01-01T17:47:50.340 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~238s 2023-01-01T17:47:50.341 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~238s 2023-01-01T17:47:50.341 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~238s 2023-01-01T17:47:50.341 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~238s 2023-01-01T17:47:50.341 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~238s 2023-01-01T17:47:50.341 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~238s 2023-01-01T17:47:55.343 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~243s 2023-01-01T17:47:55.343 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~243s 2023-01-01T17:47:55.343 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~243s 2023-01-01T17:47:55.343 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~243s 2023-01-01T17:47:55.343 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~243s 2023-01-01T17:47:55.344 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~243s 2023-01-01T17:47:55.344 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~243s 2023-01-01T17:47:55.344 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~243s 2023-01-01T17:47:55.344 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~243s 2023-01-01T17:48:00.349 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~248s 2023-01-01T17:48:00.349 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~248s 2023-01-01T17:48:00.349 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~248s 2023-01-01T17:48:00.349 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~248s 2023-01-01T17:48:00.349 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~248s 2023-01-01T17:48:00.350 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~248s 2023-01-01T17:48:00.350 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~248s 2023-01-01T17:48:00.350 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~248s 2023-01-01T17:48:00.350 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~248s 2023-01-01T17:48:05.351 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~253s 2023-01-01T17:48:05.352 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~253s 2023-01-01T17:48:05.352 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~253s 2023-01-01T17:48:05.352 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~253s 2023-01-01T17:48:05.352 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~253s 2023-01-01T17:48:05.352 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~253s 2023-01-01T17:48:05.352 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~253s 2023-01-01T17:48:05.353 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~253s 2023-01-01T17:48:05.353 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~253s 2023-01-01T17:48:10.354 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~258s 2023-01-01T17:48:10.354 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~258s 2023-01-01T17:48:10.356 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~258s 2023-01-01T17:48:10.356 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~258s 2023-01-01T17:48:10.357 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~258s 2023-01-01T17:48:10.357 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~258s 2023-01-01T17:48:10.357 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~258s 2023-01-01T17:48:10.357 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~258s 2023-01-01T17:48:10.357 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~258s 2023-01-01T17:48:15.358 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~263s 2023-01-01T17:48:15.358 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~263s 2023-01-01T17:48:15.359 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~263s 2023-01-01T17:48:15.359 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~263s 2023-01-01T17:48:15.359 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~263s 2023-01-01T17:48:15.359 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~263s 2023-01-01T17:48:15.359 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~263s 2023-01-01T17:48:15.359 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~263s 2023-01-01T17:48:15.359 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~263s 2023-01-01T17:48:20.361 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~268s 2023-01-01T17:48:20.361 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~268s 2023-01-01T17:48:20.361 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~268s 2023-01-01T17:48:20.362 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~268s 2023-01-01T17:48:20.362 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~268s 2023-01-01T17:48:20.362 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~268s 2023-01-01T17:48:20.362 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~268s 2023-01-01T17:48:20.362 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~268s 2023-01-01T17:48:20.362 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~268s 2023-01-01T17:48:25.365 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~273s 2023-01-01T17:48:25.365 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~273s 2023-01-01T17:48:25.366 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~273s 2023-01-01T17:48:25.366 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~273s 2023-01-01T17:48:25.366 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~273s 2023-01-01T17:48:25.366 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~273s 2023-01-01T17:48:25.366 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~273s 2023-01-01T17:48:25.366 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~273s 2023-01-01T17:48:25.367 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~273s 2023-01-01T17:48:30.369 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~278s 2023-01-01T17:48:30.369 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~278s 2023-01-01T17:48:30.369 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~278s 2023-01-01T17:48:30.370 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~278s 2023-01-01T17:48:30.370 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~278s 2023-01-01T17:48:30.370 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~278s 2023-01-01T17:48:30.370 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~278s 2023-01-01T17:48:30.371 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~278s 2023-01-01T17:48:30.373 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~278s 2023-01-01T17:48:35.374 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~283s 2023-01-01T17:48:35.374 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~283s 2023-01-01T17:48:35.374 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~283s 2023-01-01T17:48:35.375 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~283s 2023-01-01T17:48:35.375 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~283s 2023-01-01T17:48:35.375 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~283s 2023-01-01T17:48:35.375 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~283s 2023-01-01T17:48:35.375 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~283s 2023-01-01T17:48:35.376 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~283s 2023-01-01T17:48:40.377 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~288s 2023-01-01T17:48:40.377 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~288s 2023-01-01T17:48:40.377 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~288s 2023-01-01T17:48:40.377 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~288s 2023-01-01T17:48:40.377 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~288s 2023-01-01T17:48:40.378 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~288s 2023-01-01T17:48:40.378 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~288s 2023-01-01T17:48:40.378 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~288s 2023-01-01T17:48:40.378 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~288s 2023-01-01T17:48:45.380 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~293s 2023-01-01T17:48:45.380 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~293s 2023-01-01T17:48:45.380 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~293s 2023-01-01T17:48:45.380 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~293s 2023-01-01T17:48:45.381 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~293s 2023-01-01T17:48:45.381 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~293s 2023-01-01T17:48:45.381 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~293s 2023-01-01T17:48:45.381 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~293s 2023-01-01T17:48:45.381 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~293s 2023-01-01T17:48:50.383 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~298s 2023-01-01T17:48:50.383 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~298s 2023-01-01T17:48:50.383 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~298s 2023-01-01T17:48:50.383 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~298s 2023-01-01T17:48:50.383 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~298s 2023-01-01T17:48:50.383 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~298s 2023-01-01T17:48:50.384 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~298s 2023-01-01T17:48:50.384 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~298s 2023-01-01T17:48:50.384 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~298s 2023-01-01T17:48:55.385 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~303s 2023-01-01T17:48:55.385 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~303s 2023-01-01T17:48:55.385 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~303s 2023-01-01T17:48:55.385 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~303s 2023-01-01T17:48:55.385 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~303s 2023-01-01T17:48:55.386 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~303s 2023-01-01T17:48:55.386 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~303s 2023-01-01T17:48:55.386 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~303s 2023-01-01T17:48:55.386 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~303s 2023-01-01T17:48:55.386 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-01-01T17:48:55.386 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-01-01T17:48:55.387 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-01-01T17:48:55.410 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=8026740k,nr_inodes=2006685,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=40,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18119 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1609048k,mode=700,uid=1000,gid=1265 0 0 2023-01-01T17:48:55.410 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2023-01-01T17:48:55.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-01-01T17:48:55.411 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-01-02T05:30:18.558 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-01-02T05:30:18.578 DEBUG:teuthology.task.console_log:Killing console logger for smithi061 2023-01-02T05:30:18.578 DEBUG:teuthology.task.console_log:Killing console logger for smithi149 2023-01-02T05:30:18.578 DEBUG:teuthology.exit:Finished running handlers